00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2382 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3643 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.040 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.040 The recommended git tool is: git 00:00:00.040 using credential 00000000-0000-0000-0000-000000000002 00:00:00.041 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.050 Fetching changes from the remote Git repository 00:00:00.054 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.067 Using shallow fetch with depth 1 00:00:00.067 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.067 > git --version # timeout=10 00:00:00.079 > git --version # 'git version 2.39.2' 00:00:00.079 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.092 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.092 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.425 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.436 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.447 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:04.447 > git config core.sparsecheckout # timeout=10 00:00:04.460 > git read-tree -mu HEAD # timeout=10 00:00:04.474 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:04.491 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:04.491 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:04.592 [Pipeline] Start of Pipeline 00:00:04.607 [Pipeline] library 00:00:04.609 Loading library shm_lib@master 00:00:04.609 Library shm_lib@master is cached. Copying from home. 00:00:04.627 [Pipeline] node 00:00:04.637 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.639 [Pipeline] { 00:00:04.651 [Pipeline] catchError 00:00:04.653 [Pipeline] { 00:00:04.668 [Pipeline] wrap 00:00:04.677 [Pipeline] { 00:00:04.687 [Pipeline] stage 00:00:04.688 [Pipeline] { (Prologue) 00:00:04.933 [Pipeline] sh 00:00:05.214 + logger -p user.info -t JENKINS-CI 00:00:05.229 [Pipeline] echo 00:00:05.230 Node: GP11 00:00:05.240 [Pipeline] sh 00:00:05.538 [Pipeline] setCustomBuildProperty 00:00:05.552 [Pipeline] echo 00:00:05.553 Cleanup processes 00:00:05.559 [Pipeline] sh 00:00:05.838 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.838 3243049 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.853 [Pipeline] sh 00:00:06.133 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.133 ++ awk '{print $1}' 00:00:06.133 ++ grep -v 'sudo pgrep' 00:00:06.133 + sudo kill -9 00:00:06.133 + true 00:00:06.146 [Pipeline] cleanWs 00:00:06.154 [WS-CLEANUP] Deleting project workspace... 00:00:06.154 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.158 [WS-CLEANUP] done 00:00:06.161 [Pipeline] setCustomBuildProperty 00:00:06.173 [Pipeline] sh 00:00:06.447 + sudo git config --global --replace-all safe.directory '*' 00:00:06.515 [Pipeline] httpRequest 00:00:07.032 [Pipeline] echo 00:00:07.033 Sorcerer 10.211.164.20 is alive 00:00:07.042 [Pipeline] retry 00:00:07.044 [Pipeline] { 00:00:07.053 [Pipeline] httpRequest 00:00:07.057 HttpMethod: GET 00:00:07.058 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.058 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.060 Response Code: HTTP/1.1 200 OK 00:00:07.060 Success: Status code 200 is in the accepted range: 200,404 00:00:07.061 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.904 [Pipeline] } 00:00:07.924 [Pipeline] // retry 00:00:07.932 [Pipeline] sh 00:00:08.216 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.230 [Pipeline] httpRequest 00:00:09.356 [Pipeline] echo 00:00:09.358 Sorcerer 10.211.164.20 is alive 00:00:09.369 [Pipeline] retry 00:00:09.372 [Pipeline] { 00:00:09.390 [Pipeline] httpRequest 00:00:09.394 HttpMethod: GET 00:00:09.395 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:09.395 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:09.414 Response Code: HTTP/1.1 200 OK 00:00:09.414 Success: Status code 200 is in the accepted range: 200,404 00:00:09.415 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:07.466 [Pipeline] } 00:01:07.484 [Pipeline] // retry 00:01:07.492 [Pipeline] sh 00:01:07.772 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:11.068 [Pipeline] sh 00:01:11.348 + git -C spdk log --oneline -n5 00:01:11.348 c13c99a5e test: Various fixes for Fedora40 00:01:11.348 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:11.348 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:11.348 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:11.348 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:11.359 [Pipeline] } 00:01:11.374 [Pipeline] // stage 00:01:11.383 [Pipeline] stage 00:01:11.385 [Pipeline] { (Prepare) 00:01:11.404 [Pipeline] writeFile 00:01:11.421 [Pipeline] sh 00:01:11.702 + logger -p user.info -t JENKINS-CI 00:01:11.714 [Pipeline] sh 00:01:11.993 + logger -p user.info -t JENKINS-CI 00:01:12.004 [Pipeline] sh 00:01:12.283 + cat autorun-spdk.conf 00:01:12.283 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.283 SPDK_TEST_NVMF=1 00:01:12.283 SPDK_TEST_NVME_CLI=1 00:01:12.283 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.283 SPDK_TEST_NVMF_NICS=e810 00:01:12.283 SPDK_RUN_UBSAN=1 00:01:12.283 NET_TYPE=phy 00:01:12.290 RUN_NIGHTLY=1 00:01:12.295 [Pipeline] readFile 00:01:12.319 [Pipeline] withEnv 00:01:12.321 [Pipeline] { 00:01:12.333 [Pipeline] sh 00:01:12.614 + set -ex 00:01:12.614 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:12.614 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:12.614 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.614 ++ SPDK_TEST_NVMF=1 00:01:12.614 ++ SPDK_TEST_NVME_CLI=1 00:01:12.614 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.614 ++ SPDK_TEST_NVMF_NICS=e810 00:01:12.614 ++ SPDK_RUN_UBSAN=1 00:01:12.614 ++ NET_TYPE=phy 00:01:12.614 ++ RUN_NIGHTLY=1 00:01:12.614 + case $SPDK_TEST_NVMF_NICS in 00:01:12.614 + DRIVERS=ice 00:01:12.614 + [[ tcp == \r\d\m\a ]] 00:01:12.614 + [[ -n ice ]] 00:01:12.614 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:12.614 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:12.614 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:12.614 rmmod: ERROR: Module irdma is not currently loaded 00:01:12.614 rmmod: ERROR: Module i40iw is not currently loaded 00:01:12.614 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:12.614 + true 00:01:12.614 + for D in $DRIVERS 00:01:12.614 + sudo modprobe ice 00:01:12.614 + exit 0 00:01:12.622 [Pipeline] } 00:01:12.636 [Pipeline] // withEnv 00:01:12.641 [Pipeline] } 00:01:12.655 [Pipeline] // stage 00:01:12.664 [Pipeline] catchError 00:01:12.666 [Pipeline] { 00:01:12.680 [Pipeline] timeout 00:01:12.680 Timeout set to expire in 1 hr 0 min 00:01:12.682 [Pipeline] { 00:01:12.696 [Pipeline] stage 00:01:12.698 [Pipeline] { (Tests) 00:01:12.712 [Pipeline] sh 00:01:12.993 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.993 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.993 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.993 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:12.993 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:12.993 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:12.993 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:12.993 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:12.993 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:12.993 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:12.993 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:12.993 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:12.993 + source /etc/os-release 00:01:12.993 ++ NAME='Fedora Linux' 00:01:12.993 ++ VERSION='39 (Cloud Edition)' 00:01:12.993 ++ ID=fedora 00:01:12.993 ++ VERSION_ID=39 00:01:12.993 ++ VERSION_CODENAME= 00:01:12.993 ++ PLATFORM_ID=platform:f39 00:01:12.993 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:12.993 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:12.993 ++ LOGO=fedora-logo-icon 00:01:12.993 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:12.993 ++ HOME_URL=https://fedoraproject.org/ 00:01:12.993 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:12.993 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:12.993 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:12.993 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:12.993 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:12.993 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:12.993 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:12.993 ++ SUPPORT_END=2024-11-12 00:01:12.993 ++ VARIANT='Cloud Edition' 00:01:12.993 ++ VARIANT_ID=cloud 00:01:12.993 + uname -a 00:01:12.993 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:12.993 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:13.925 Hugepages 00:01:13.925 node hugesize free / total 00:01:13.925 node0 1048576kB 0 / 0 00:01:13.925 node0 2048kB 0 / 0 00:01:13.925 node1 1048576kB 0 / 0 00:01:13.925 node1 2048kB 0 / 0 00:01:13.925 00:01:13.925 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:13.925 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:13.925 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:13.925 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:13.925 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:13.925 + rm -f /tmp/spdk-ld-path 00:01:13.925 + source autorun-spdk.conf 00:01:13.925 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:13.925 ++ SPDK_TEST_NVMF=1 00:01:13.925 ++ SPDK_TEST_NVME_CLI=1 00:01:13.926 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:13.926 ++ SPDK_TEST_NVMF_NICS=e810 00:01:13.926 ++ SPDK_RUN_UBSAN=1 00:01:13.926 ++ NET_TYPE=phy 00:01:13.926 ++ RUN_NIGHTLY=1 00:01:13.926 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:13.926 + [[ -n '' ]] 00:01:13.926 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:13.926 + for M in /var/spdk/build-*-manifest.txt 00:01:13.926 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:13.926 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.185 + for M in /var/spdk/build-*-manifest.txt 00:01:14.185 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:14.185 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.185 + for M in /var/spdk/build-*-manifest.txt 00:01:14.185 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:14.185 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.185 ++ uname 00:01:14.185 + [[ Linux == \L\i\n\u\x ]] 00:01:14.185 + sudo dmesg -T 00:01:14.185 + sudo dmesg --clear 00:01:14.185 + dmesg_pid=3243714 00:01:14.185 + [[ Fedora Linux == FreeBSD ]] 00:01:14.185 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:14.185 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:14.185 + sudo dmesg -Tw 00:01:14.185 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:14.185 + [[ -x /usr/src/fio-static/fio ]] 00:01:14.185 + export FIO_BIN=/usr/src/fio-static/fio 00:01:14.185 + FIO_BIN=/usr/src/fio-static/fio 00:01:14.185 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:14.185 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:14.185 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:14.185 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:14.185 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:14.185 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:14.185 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:14.185 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:14.185 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:14.185 Test configuration: 00:01:14.185 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:14.185 SPDK_TEST_NVMF=1 00:01:14.185 SPDK_TEST_NVME_CLI=1 00:01:14.185 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:14.185 SPDK_TEST_NVMF_NICS=e810 00:01:14.185 SPDK_RUN_UBSAN=1 00:01:14.185 NET_TYPE=phy 00:01:14.185 RUN_NIGHTLY=1 18:59:32 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:14.185 18:59:32 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:14.185 18:59:32 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:14.185 18:59:32 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:14.185 18:59:32 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:14.185 18:59:32 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.185 18:59:32 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.185 18:59:32 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.185 18:59:32 -- paths/export.sh@5 -- $ export PATH 00:01:14.185 18:59:32 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.185 18:59:32 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:14.185 18:59:32 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:14.185 18:59:32 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731952772.XXXXXX 00:01:14.185 18:59:32 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731952772.fUu6rG 00:01:14.185 18:59:32 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:14.185 18:59:32 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:14.185 18:59:32 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:14.185 18:59:32 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:14.185 18:59:32 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:14.185 18:59:32 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:14.185 18:59:32 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:14.185 18:59:32 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.185 18:59:32 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:14.185 18:59:32 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:14.185 18:59:32 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:14.185 18:59:32 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.185 18:59:32 -- spdk/autobuild.sh@16 -- $ date -u 00:01:14.185 Mon Nov 18 05:59:32 PM UTC 2024 00:01:14.185 18:59:32 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:14.185 LTS-67-gc13c99a5e 00:01:14.185 18:59:32 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:14.185 18:59:32 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:14.185 18:59:32 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:14.185 18:59:32 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:14.185 18:59:32 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:14.185 18:59:32 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.185 ************************************ 00:01:14.185 START TEST ubsan 00:01:14.185 ************************************ 00:01:14.185 18:59:32 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:14.185 using ubsan 00:01:14.185 00:01:14.185 real 0m0.000s 00:01:14.185 user 0m0.000s 00:01:14.185 sys 0m0.000s 00:01:14.185 18:59:32 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:14.185 18:59:32 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.185 ************************************ 00:01:14.185 END TEST ubsan 00:01:14.185 ************************************ 00:01:14.185 18:59:32 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:14.185 18:59:32 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:14.185 18:59:32 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:14.185 18:59:32 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:14.185 18:59:32 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:14.185 18:59:32 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:14.185 18:59:32 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:14.185 18:59:32 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:14.185 18:59:32 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:14.185 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:14.185 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:14.444 Using 'verbs' RDMA provider 00:01:24.981 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:34.981 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:34.981 Creating mk/config.mk...done. 00:01:34.981 Creating mk/cc.flags.mk...done. 00:01:34.981 Type 'make' to build. 00:01:34.981 18:59:52 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:34.981 18:59:52 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:34.981 18:59:52 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:34.981 18:59:52 -- common/autotest_common.sh@10 -- $ set +x 00:01:34.981 ************************************ 00:01:34.981 START TEST make 00:01:34.981 ************************************ 00:01:34.981 18:59:52 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:34.981 make[1]: Nothing to be done for 'all'. 00:01:44.977 The Meson build system 00:01:44.977 Version: 1.5.0 00:01:44.977 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:44.977 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:44.977 Build type: native build 00:01:44.977 Program cat found: YES (/usr/bin/cat) 00:01:44.977 Project name: DPDK 00:01:44.977 Project version: 23.11.0 00:01:44.977 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:44.977 C linker for the host machine: cc ld.bfd 2.40-14 00:01:44.977 Host machine cpu family: x86_64 00:01:44.977 Host machine cpu: x86_64 00:01:44.977 Message: ## Building in Developer Mode ## 00:01:44.977 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:44.977 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:44.977 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:44.977 Program python3 found: YES (/usr/bin/python3) 00:01:44.977 Program cat found: YES (/usr/bin/cat) 00:01:44.977 Compiler for C supports arguments -march=native: YES 00:01:44.977 Checking for size of "void *" : 8 00:01:44.977 Checking for size of "void *" : 8 (cached) 00:01:44.977 Library m found: YES 00:01:44.977 Library numa found: YES 00:01:44.977 Has header "numaif.h" : YES 00:01:44.977 Library fdt found: NO 00:01:44.977 Library execinfo found: NO 00:01:44.977 Has header "execinfo.h" : YES 00:01:44.977 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:44.977 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:44.977 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:44.977 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:44.977 Run-time dependency openssl found: YES 3.1.1 00:01:44.977 Run-time dependency libpcap found: YES 1.10.4 00:01:44.977 Has header "pcap.h" with dependency libpcap: YES 00:01:44.977 Compiler for C supports arguments -Wcast-qual: YES 00:01:44.977 Compiler for C supports arguments -Wdeprecated: YES 00:01:44.977 Compiler for C supports arguments -Wformat: YES 00:01:44.977 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:44.977 Compiler for C supports arguments -Wformat-security: NO 00:01:44.977 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:44.977 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:44.977 Compiler for C supports arguments -Wnested-externs: YES 00:01:44.977 Compiler for C supports arguments -Wold-style-definition: YES 00:01:44.977 Compiler for C supports arguments -Wpointer-arith: YES 00:01:44.977 Compiler for C supports arguments -Wsign-compare: YES 00:01:44.977 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:44.977 Compiler for C supports arguments -Wundef: YES 00:01:44.977 Compiler for C supports arguments -Wwrite-strings: YES 00:01:44.977 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:44.977 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:44.977 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:44.977 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:44.977 Program objdump found: YES (/usr/bin/objdump) 00:01:44.977 Compiler for C supports arguments -mavx512f: YES 00:01:44.977 Checking if "AVX512 checking" compiles: YES 00:01:44.977 Fetching value of define "__SSE4_2__" : 1 00:01:44.977 Fetching value of define "__AES__" : 1 00:01:44.977 Fetching value of define "__AVX__" : 1 00:01:44.977 Fetching value of define "__AVX2__" : (undefined) 00:01:44.977 Fetching value of define "__AVX512BW__" : (undefined) 00:01:44.977 Fetching value of define "__AVX512CD__" : (undefined) 00:01:44.977 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:44.977 Fetching value of define "__AVX512F__" : (undefined) 00:01:44.977 Fetching value of define "__AVX512VL__" : (undefined) 00:01:44.977 Fetching value of define "__PCLMUL__" : 1 00:01:44.977 Fetching value of define "__RDRND__" : 1 00:01:44.978 Fetching value of define "__RDSEED__" : (undefined) 00:01:44.978 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:44.978 Fetching value of define "__znver1__" : (undefined) 00:01:44.978 Fetching value of define "__znver2__" : (undefined) 00:01:44.978 Fetching value of define "__znver3__" : (undefined) 00:01:44.978 Fetching value of define "__znver4__" : (undefined) 00:01:44.978 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:44.978 Message: lib/log: Defining dependency "log" 00:01:44.978 Message: lib/kvargs: Defining dependency "kvargs" 00:01:44.978 Message: lib/telemetry: Defining dependency "telemetry" 00:01:44.978 Checking for function "getentropy" : NO 00:01:44.978 Message: lib/eal: Defining dependency "eal" 00:01:44.978 Message: lib/ring: Defining dependency "ring" 00:01:44.978 Message: lib/rcu: Defining dependency "rcu" 00:01:44.978 Message: lib/mempool: Defining dependency "mempool" 00:01:44.978 Message: lib/mbuf: Defining dependency "mbuf" 00:01:44.978 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:44.978 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:44.978 Compiler for C supports arguments -mpclmul: YES 00:01:44.978 Compiler for C supports arguments -maes: YES 00:01:44.978 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:44.978 Compiler for C supports arguments -mavx512bw: YES 00:01:44.978 Compiler for C supports arguments -mavx512dq: YES 00:01:44.978 Compiler for C supports arguments -mavx512vl: YES 00:01:44.978 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:44.978 Compiler for C supports arguments -mavx2: YES 00:01:44.978 Compiler for C supports arguments -mavx: YES 00:01:44.978 Message: lib/net: Defining dependency "net" 00:01:44.978 Message: lib/meter: Defining dependency "meter" 00:01:44.978 Message: lib/ethdev: Defining dependency "ethdev" 00:01:44.978 Message: lib/pci: Defining dependency "pci" 00:01:44.978 Message: lib/cmdline: Defining dependency "cmdline" 00:01:44.978 Message: lib/hash: Defining dependency "hash" 00:01:44.978 Message: lib/timer: Defining dependency "timer" 00:01:44.978 Message: lib/compressdev: Defining dependency "compressdev" 00:01:44.978 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:44.978 Message: lib/dmadev: Defining dependency "dmadev" 00:01:44.978 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:44.978 Message: lib/power: Defining dependency "power" 00:01:44.978 Message: lib/reorder: Defining dependency "reorder" 00:01:44.978 Message: lib/security: Defining dependency "security" 00:01:44.978 Has header "linux/userfaultfd.h" : YES 00:01:44.978 Has header "linux/vduse.h" : YES 00:01:44.978 Message: lib/vhost: Defining dependency "vhost" 00:01:44.978 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:44.978 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:44.978 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:44.978 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:44.978 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:44.978 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:44.978 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:44.978 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:44.978 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:44.978 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:44.978 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:44.978 Configuring doxy-api-html.conf using configuration 00:01:44.978 Configuring doxy-api-man.conf using configuration 00:01:44.978 Program mandb found: YES (/usr/bin/mandb) 00:01:44.978 Program sphinx-build found: NO 00:01:44.978 Configuring rte_build_config.h using configuration 00:01:44.978 Message: 00:01:44.978 ================= 00:01:44.978 Applications Enabled 00:01:44.978 ================= 00:01:44.978 00:01:44.978 apps: 00:01:44.978 00:01:44.978 00:01:44.978 Message: 00:01:44.978 ================= 00:01:44.978 Libraries Enabled 00:01:44.978 ================= 00:01:44.978 00:01:44.978 libs: 00:01:44.978 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:44.978 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:44.978 cryptodev, dmadev, power, reorder, security, vhost, 00:01:44.978 00:01:44.978 Message: 00:01:44.978 =============== 00:01:44.978 Drivers Enabled 00:01:44.978 =============== 00:01:44.978 00:01:44.978 common: 00:01:44.978 00:01:44.978 bus: 00:01:44.978 pci, vdev, 00:01:44.978 mempool: 00:01:44.978 ring, 00:01:44.978 dma: 00:01:44.978 00:01:44.978 net: 00:01:44.978 00:01:44.978 crypto: 00:01:44.978 00:01:44.978 compress: 00:01:44.978 00:01:44.978 vdpa: 00:01:44.978 00:01:44.978 00:01:44.978 Message: 00:01:44.978 ================= 00:01:44.978 Content Skipped 00:01:44.978 ================= 00:01:44.978 00:01:44.978 apps: 00:01:44.978 dumpcap: explicitly disabled via build config 00:01:44.978 graph: explicitly disabled via build config 00:01:44.978 pdump: explicitly disabled via build config 00:01:44.978 proc-info: explicitly disabled via build config 00:01:44.978 test-acl: explicitly disabled via build config 00:01:44.978 test-bbdev: explicitly disabled via build config 00:01:44.978 test-cmdline: explicitly disabled via build config 00:01:44.978 test-compress-perf: explicitly disabled via build config 00:01:44.978 test-crypto-perf: explicitly disabled via build config 00:01:44.978 test-dma-perf: explicitly disabled via build config 00:01:44.978 test-eventdev: explicitly disabled via build config 00:01:44.978 test-fib: explicitly disabled via build config 00:01:44.978 test-flow-perf: explicitly disabled via build config 00:01:44.978 test-gpudev: explicitly disabled via build config 00:01:44.978 test-mldev: explicitly disabled via build config 00:01:44.978 test-pipeline: explicitly disabled via build config 00:01:44.978 test-pmd: explicitly disabled via build config 00:01:44.978 test-regex: explicitly disabled via build config 00:01:44.978 test-sad: explicitly disabled via build config 00:01:44.978 test-security-perf: explicitly disabled via build config 00:01:44.978 00:01:44.978 libs: 00:01:44.978 metrics: explicitly disabled via build config 00:01:44.978 acl: explicitly disabled via build config 00:01:44.978 bbdev: explicitly disabled via build config 00:01:44.978 bitratestats: explicitly disabled via build config 00:01:44.978 bpf: explicitly disabled via build config 00:01:44.978 cfgfile: explicitly disabled via build config 00:01:44.978 distributor: explicitly disabled via build config 00:01:44.978 efd: explicitly disabled via build config 00:01:44.978 eventdev: explicitly disabled via build config 00:01:44.978 dispatcher: explicitly disabled via build config 00:01:44.978 gpudev: explicitly disabled via build config 00:01:44.978 gro: explicitly disabled via build config 00:01:44.978 gso: explicitly disabled via build config 00:01:44.978 ip_frag: explicitly disabled via build config 00:01:44.978 jobstats: explicitly disabled via build config 00:01:44.978 latencystats: explicitly disabled via build config 00:01:44.978 lpm: explicitly disabled via build config 00:01:44.978 member: explicitly disabled via build config 00:01:44.978 pcapng: explicitly disabled via build config 00:01:44.978 rawdev: explicitly disabled via build config 00:01:44.978 regexdev: explicitly disabled via build config 00:01:44.978 mldev: explicitly disabled via build config 00:01:44.978 rib: explicitly disabled via build config 00:01:44.978 sched: explicitly disabled via build config 00:01:44.978 stack: explicitly disabled via build config 00:01:44.978 ipsec: explicitly disabled via build config 00:01:44.978 pdcp: explicitly disabled via build config 00:01:44.978 fib: explicitly disabled via build config 00:01:44.978 port: explicitly disabled via build config 00:01:44.978 pdump: explicitly disabled via build config 00:01:44.979 table: explicitly disabled via build config 00:01:44.979 pipeline: explicitly disabled via build config 00:01:44.979 graph: explicitly disabled via build config 00:01:44.979 node: explicitly disabled via build config 00:01:44.979 00:01:44.979 drivers: 00:01:44.979 common/cpt: not in enabled drivers build config 00:01:44.979 common/dpaax: not in enabled drivers build config 00:01:44.979 common/iavf: not in enabled drivers build config 00:01:44.979 common/idpf: not in enabled drivers build config 00:01:44.979 common/mvep: not in enabled drivers build config 00:01:44.979 common/octeontx: not in enabled drivers build config 00:01:44.979 bus/auxiliary: not in enabled drivers build config 00:01:44.979 bus/cdx: not in enabled drivers build config 00:01:44.979 bus/dpaa: not in enabled drivers build config 00:01:44.979 bus/fslmc: not in enabled drivers build config 00:01:44.979 bus/ifpga: not in enabled drivers build config 00:01:44.979 bus/platform: not in enabled drivers build config 00:01:44.979 bus/vmbus: not in enabled drivers build config 00:01:44.979 common/cnxk: not in enabled drivers build config 00:01:44.979 common/mlx5: not in enabled drivers build config 00:01:44.979 common/nfp: not in enabled drivers build config 00:01:44.979 common/qat: not in enabled drivers build config 00:01:44.979 common/sfc_efx: not in enabled drivers build config 00:01:44.979 mempool/bucket: not in enabled drivers build config 00:01:44.979 mempool/cnxk: not in enabled drivers build config 00:01:44.979 mempool/dpaa: not in enabled drivers build config 00:01:44.979 mempool/dpaa2: not in enabled drivers build config 00:01:44.979 mempool/octeontx: not in enabled drivers build config 00:01:44.979 mempool/stack: not in enabled drivers build config 00:01:44.979 dma/cnxk: not in enabled drivers build config 00:01:44.979 dma/dpaa: not in enabled drivers build config 00:01:44.979 dma/dpaa2: not in enabled drivers build config 00:01:44.979 dma/hisilicon: not in enabled drivers build config 00:01:44.979 dma/idxd: not in enabled drivers build config 00:01:44.979 dma/ioat: not in enabled drivers build config 00:01:44.979 dma/skeleton: not in enabled drivers build config 00:01:44.979 net/af_packet: not in enabled drivers build config 00:01:44.979 net/af_xdp: not in enabled drivers build config 00:01:44.979 net/ark: not in enabled drivers build config 00:01:44.979 net/atlantic: not in enabled drivers build config 00:01:44.979 net/avp: not in enabled drivers build config 00:01:44.979 net/axgbe: not in enabled drivers build config 00:01:44.979 net/bnx2x: not in enabled drivers build config 00:01:44.979 net/bnxt: not in enabled drivers build config 00:01:44.979 net/bonding: not in enabled drivers build config 00:01:44.979 net/cnxk: not in enabled drivers build config 00:01:44.979 net/cpfl: not in enabled drivers build config 00:01:44.979 net/cxgbe: not in enabled drivers build config 00:01:44.979 net/dpaa: not in enabled drivers build config 00:01:44.979 net/dpaa2: not in enabled drivers build config 00:01:44.979 net/e1000: not in enabled drivers build config 00:01:44.979 net/ena: not in enabled drivers build config 00:01:44.979 net/enetc: not in enabled drivers build config 00:01:44.979 net/enetfec: not in enabled drivers build config 00:01:44.979 net/enic: not in enabled drivers build config 00:01:44.979 net/failsafe: not in enabled drivers build config 00:01:44.979 net/fm10k: not in enabled drivers build config 00:01:44.979 net/gve: not in enabled drivers build config 00:01:44.979 net/hinic: not in enabled drivers build config 00:01:44.979 net/hns3: not in enabled drivers build config 00:01:44.979 net/i40e: not in enabled drivers build config 00:01:44.979 net/iavf: not in enabled drivers build config 00:01:44.979 net/ice: not in enabled drivers build config 00:01:44.979 net/idpf: not in enabled drivers build config 00:01:44.979 net/igc: not in enabled drivers build config 00:01:44.979 net/ionic: not in enabled drivers build config 00:01:44.979 net/ipn3ke: not in enabled drivers build config 00:01:44.979 net/ixgbe: not in enabled drivers build config 00:01:44.979 net/mana: not in enabled drivers build config 00:01:44.979 net/memif: not in enabled drivers build config 00:01:44.979 net/mlx4: not in enabled drivers build config 00:01:44.979 net/mlx5: not in enabled drivers build config 00:01:44.979 net/mvneta: not in enabled drivers build config 00:01:44.979 net/mvpp2: not in enabled drivers build config 00:01:44.979 net/netvsc: not in enabled drivers build config 00:01:44.979 net/nfb: not in enabled drivers build config 00:01:44.979 net/nfp: not in enabled drivers build config 00:01:44.979 net/ngbe: not in enabled drivers build config 00:01:44.979 net/null: not in enabled drivers build config 00:01:44.979 net/octeontx: not in enabled drivers build config 00:01:44.979 net/octeon_ep: not in enabled drivers build config 00:01:44.979 net/pcap: not in enabled drivers build config 00:01:44.979 net/pfe: not in enabled drivers build config 00:01:44.979 net/qede: not in enabled drivers build config 00:01:44.979 net/ring: not in enabled drivers build config 00:01:44.979 net/sfc: not in enabled drivers build config 00:01:44.979 net/softnic: not in enabled drivers build config 00:01:44.979 net/tap: not in enabled drivers build config 00:01:44.979 net/thunderx: not in enabled drivers build config 00:01:44.979 net/txgbe: not in enabled drivers build config 00:01:44.979 net/vdev_netvsc: not in enabled drivers build config 00:01:44.979 net/vhost: not in enabled drivers build config 00:01:44.979 net/virtio: not in enabled drivers build config 00:01:44.979 net/vmxnet3: not in enabled drivers build config 00:01:44.979 raw/*: missing internal dependency, "rawdev" 00:01:44.979 crypto/armv8: not in enabled drivers build config 00:01:44.979 crypto/bcmfs: not in enabled drivers build config 00:01:44.979 crypto/caam_jr: not in enabled drivers build config 00:01:44.979 crypto/ccp: not in enabled drivers build config 00:01:44.979 crypto/cnxk: not in enabled drivers build config 00:01:44.979 crypto/dpaa_sec: not in enabled drivers build config 00:01:44.979 crypto/dpaa2_sec: not in enabled drivers build config 00:01:44.979 crypto/ipsec_mb: not in enabled drivers build config 00:01:44.979 crypto/mlx5: not in enabled drivers build config 00:01:44.979 crypto/mvsam: not in enabled drivers build config 00:01:44.979 crypto/nitrox: not in enabled drivers build config 00:01:44.979 crypto/null: not in enabled drivers build config 00:01:44.979 crypto/octeontx: not in enabled drivers build config 00:01:44.979 crypto/openssl: not in enabled drivers build config 00:01:44.979 crypto/scheduler: not in enabled drivers build config 00:01:44.979 crypto/uadk: not in enabled drivers build config 00:01:44.979 crypto/virtio: not in enabled drivers build config 00:01:44.979 compress/isal: not in enabled drivers build config 00:01:44.979 compress/mlx5: not in enabled drivers build config 00:01:44.979 compress/octeontx: not in enabled drivers build config 00:01:44.979 compress/zlib: not in enabled drivers build config 00:01:44.979 regex/*: missing internal dependency, "regexdev" 00:01:44.979 ml/*: missing internal dependency, "mldev" 00:01:44.979 vdpa/ifc: not in enabled drivers build config 00:01:44.979 vdpa/mlx5: not in enabled drivers build config 00:01:44.979 vdpa/nfp: not in enabled drivers build config 00:01:44.979 vdpa/sfc: not in enabled drivers build config 00:01:44.979 event/*: missing internal dependency, "eventdev" 00:01:44.979 baseband/*: missing internal dependency, "bbdev" 00:01:44.979 gpu/*: missing internal dependency, "gpudev" 00:01:44.979 00:01:44.979 00:01:44.979 Build targets in project: 85 00:01:44.979 00:01:44.979 DPDK 23.11.0 00:01:44.979 00:01:44.979 User defined options 00:01:44.979 buildtype : debug 00:01:44.979 default_library : shared 00:01:44.979 libdir : lib 00:01:44.979 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:44.979 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:44.979 c_link_args : 00:01:44.979 cpu_instruction_set: native 00:01:44.979 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:44.979 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:44.979 enable_docs : false 00:01:44.979 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:44.979 enable_kmods : false 00:01:44.979 tests : false 00:01:44.979 00:01:44.979 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:44.979 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:44.979 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:44.979 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:44.980 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:44.980 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:44.980 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:44.980 [6/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:44.980 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:44.980 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:44.980 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:44.980 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:44.980 [11/265] Linking static target lib/librte_kvargs.a 00:01:44.980 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:44.980 [13/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:44.980 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:44.980 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:44.980 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:44.980 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:44.980 [18/265] Linking static target lib/librte_log.a 00:01:44.980 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:44.980 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:44.980 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:44.980 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.980 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:45.242 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:45.242 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:45.242 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:45.242 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:45.242 [28/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:45.242 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:45.242 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:45.242 [31/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:45.242 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:45.242 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:45.242 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:45.242 [35/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:45.242 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:45.242 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:45.242 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:45.242 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:45.242 [40/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:45.242 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:45.242 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:45.242 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:45.242 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:45.242 [45/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:45.242 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:45.242 [47/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:45.242 [48/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:45.242 [49/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:45.242 [50/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:45.242 [51/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:45.242 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:45.242 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:45.242 [54/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:45.242 [55/265] Linking static target lib/librte_telemetry.a 00:01:45.242 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:45.242 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:45.242 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:45.242 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:45.242 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:45.242 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:45.242 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:45.242 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:45.504 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:45.504 [65/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:45.504 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:45.504 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:45.504 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:45.504 [69/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:45.504 [70/265] Linking static target lib/librte_pci.a 00:01:45.504 [71/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.504 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:45.504 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:45.504 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:45.504 [75/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:45.504 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:45.504 [77/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:45.504 [78/265] Linking target lib/librte_log.so.24.0 00:01:45.762 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:45.762 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:45.762 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:45.762 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:45.762 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:45.762 [84/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:45.762 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:45.762 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:45.762 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:46.021 [88/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:46.021 [89/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:46.021 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:46.021 [91/265] Linking target lib/librte_kvargs.so.24.0 00:01:46.021 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.021 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:46.021 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:46.021 [95/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:46.021 [96/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:46.021 [97/265] Linking static target lib/librte_ring.a 00:01:46.021 [98/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:46.279 [99/265] Linking static target lib/librte_meter.a 00:01:46.279 [100/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:46.279 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:46.279 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:46.279 [103/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.279 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:46.279 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:46.279 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:46.279 [107/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:46.279 [108/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:46.279 [109/265] Linking target lib/librte_telemetry.so.24.0 00:01:46.279 [110/265] Linking static target lib/librte_eal.a 00:01:46.279 [111/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:46.279 [112/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:46.279 [113/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:46.279 [114/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:46.279 [115/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:46.279 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:46.279 [117/265] Linking static target lib/librte_rcu.a 00:01:46.279 [118/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:46.279 [119/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:46.279 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:46.540 [121/265] Linking static target lib/librte_mempool.a 00:01:46.540 [122/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:46.540 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:46.540 [124/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:46.540 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:46.540 [126/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:46.540 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:46.540 [128/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:46.540 [129/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:46.541 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:46.541 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:46.541 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:46.541 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:46.541 [134/265] Linking static target lib/librte_cmdline.a 00:01:46.541 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:46.541 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:46.799 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.799 [138/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:46.799 [139/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.799 [140/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:46.799 [141/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:46.799 [142/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:46.799 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:46.799 [144/265] Linking static target lib/librte_net.a 00:01:46.799 [145/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:46.799 [146/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:46.799 [147/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:46.799 [148/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:46.799 [149/265] Linking static target lib/librte_timer.a 00:01:47.059 [150/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.059 [151/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:47.059 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:47.059 [153/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:47.059 [154/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:47.059 [155/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:47.059 [156/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.059 [157/265] Linking static target lib/librte_dmadev.a 00:01:47.317 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:47.317 [159/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:47.317 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:47.317 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.317 [162/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.317 [163/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:47.317 [164/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:47.317 [165/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:47.317 [166/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:47.317 [167/265] Linking static target lib/librte_hash.a 00:01:47.317 [168/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:47.576 [169/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:47.576 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:47.576 [171/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:47.576 [172/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:47.576 [173/265] Linking static target lib/librte_compressdev.a 00:01:47.576 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:47.576 [175/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:47.576 [176/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:47.576 [177/265] Linking static target lib/librte_power.a 00:01:47.576 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:47.576 [179/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.576 [180/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.576 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:47.576 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:47.576 [183/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:47.576 [184/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:47.576 [185/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:47.576 [186/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:47.834 [187/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:47.834 [188/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:47.834 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:47.834 [190/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:47.834 [191/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:47.834 [192/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:47.834 [193/265] Linking static target lib/librte_reorder.a 00:01:47.834 [194/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:47.834 [195/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:47.834 [196/265] Linking static target lib/librte_mbuf.a 00:01:47.834 [197/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:47.834 [198/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:47.834 [199/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.834 [200/265] Linking static target drivers/librte_bus_vdev.a 00:01:47.834 [201/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:47.834 [202/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.834 [203/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:47.834 [204/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:48.092 [205/265] Linking static target drivers/librte_bus_pci.a 00:01:48.093 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:48.093 [207/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.093 [208/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:48.093 [209/265] Linking static target drivers/librte_mempool_ring.a 00:01:48.093 [210/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:48.093 [211/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.093 [212/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.093 [213/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:48.093 [214/265] Linking static target lib/librte_security.a 00:01:48.093 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.093 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:48.351 [217/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:48.351 [218/265] Linking static target lib/librte_ethdev.a 00:01:48.351 [219/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.351 [220/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.609 [221/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.609 [222/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:48.609 [223/265] Linking static target lib/librte_cryptodev.a 00:01:49.543 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.917 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:52.291 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.549 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.549 [228/265] Linking target lib/librte_eal.so.24.0 00:01:52.549 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:52.549 [230/265] Linking target lib/librte_ring.so.24.0 00:01:52.549 [231/265] Linking target lib/librte_pci.so.24.0 00:01:52.549 [232/265] Linking target lib/librte_timer.so.24.0 00:01:52.549 [233/265] Linking target lib/librte_dmadev.so.24.0 00:01:52.549 [234/265] Linking target lib/librte_meter.so.24.0 00:01:52.549 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:52.807 [236/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:52.807 [237/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:52.807 [238/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:52.807 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:52.807 [240/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:52.807 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:52.807 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:52.807 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:53.064 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:53.064 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:53.064 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:53.064 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:53.064 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:53.064 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:53.064 [250/265] Linking target lib/librte_net.so.24.0 00:01:53.064 [251/265] Linking target lib/librte_compressdev.so.24.0 00:01:53.065 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:53.323 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:53.323 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:53.323 [255/265] Linking target lib/librte_cmdline.so.24.0 00:01:53.323 [256/265] Linking target lib/librte_hash.so.24.0 00:01:53.323 [257/265] Linking target lib/librte_security.so.24.0 00:01:53.323 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:53.582 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:53.582 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:53.582 [261/265] Linking target lib/librte_power.so.24.0 00:01:56.114 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:56.114 [263/265] Linking static target lib/librte_vhost.a 00:01:57.048 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.048 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:57.048 INFO: autodetecting backend as ninja 00:01:57.048 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:57.982 CC lib/ut_mock/mock.o 00:01:57.982 CC lib/log/log.o 00:01:57.982 CC lib/log/log_flags.o 00:01:57.982 CC lib/log/log_deprecated.o 00:01:57.982 CC lib/ut/ut.o 00:01:58.240 LIB libspdk_ut_mock.a 00:01:58.240 SO libspdk_ut_mock.so.5.0 00:01:58.240 LIB libspdk_ut.a 00:01:58.240 LIB libspdk_log.a 00:01:58.240 SO libspdk_ut.so.1.0 00:01:58.240 SO libspdk_log.so.6.1 00:01:58.240 SYMLINK libspdk_ut_mock.so 00:01:58.240 SYMLINK libspdk_ut.so 00:01:58.240 SYMLINK libspdk_log.so 00:01:58.499 CC lib/util/base64.o 00:01:58.499 CC lib/ioat/ioat.o 00:01:58.499 CC lib/util/bit_array.o 00:01:58.499 CC lib/util/cpuset.o 00:01:58.499 CC lib/dma/dma.o 00:01:58.499 CXX lib/trace_parser/trace.o 00:01:58.499 CC lib/util/crc16.o 00:01:58.499 CC lib/util/crc32.o 00:01:58.499 CC lib/util/crc32c.o 00:01:58.499 CC lib/util/crc32_ieee.o 00:01:58.499 CC lib/util/crc64.o 00:01:58.499 CC lib/util/dif.o 00:01:58.499 CC lib/util/fd.o 00:01:58.499 CC lib/util/file.o 00:01:58.499 CC lib/util/hexlify.o 00:01:58.499 CC lib/util/iov.o 00:01:58.499 CC lib/util/math.o 00:01:58.499 CC lib/util/pipe.o 00:01:58.499 CC lib/util/strerror_tls.o 00:01:58.499 CC lib/util/string.o 00:01:58.499 CC lib/util/uuid.o 00:01:58.499 CC lib/util/fd_group.o 00:01:58.499 CC lib/util/xor.o 00:01:58.499 CC lib/util/zipf.o 00:01:58.499 CC lib/vfio_user/host/vfio_user_pci.o 00:01:58.499 CC lib/vfio_user/host/vfio_user.o 00:01:58.758 LIB libspdk_dma.a 00:01:58.758 SO libspdk_dma.so.3.0 00:01:58.758 SYMLINK libspdk_dma.so 00:01:58.758 LIB libspdk_ioat.a 00:01:58.758 SO libspdk_ioat.so.6.0 00:01:58.758 LIB libspdk_vfio_user.a 00:01:58.758 SO libspdk_vfio_user.so.4.0 00:01:58.758 SYMLINK libspdk_ioat.so 00:01:58.758 SYMLINK libspdk_vfio_user.so 00:01:59.017 LIB libspdk_util.a 00:01:59.017 SO libspdk_util.so.8.0 00:01:59.017 SYMLINK libspdk_util.so 00:01:59.276 CC lib/vmd/vmd.o 00:01:59.276 CC lib/json/json_parse.o 00:01:59.276 CC lib/idxd/idxd.o 00:01:59.276 CC lib/env_dpdk/env.o 00:01:59.276 CC lib/rdma/common.o 00:01:59.276 CC lib/vmd/led.o 00:01:59.276 CC lib/env_dpdk/memory.o 00:01:59.276 CC lib/rdma/rdma_verbs.o 00:01:59.276 CC lib/json/json_util.o 00:01:59.276 CC lib/idxd/idxd_kernel.o 00:01:59.276 CC lib/conf/conf.o 00:01:59.276 CC lib/idxd/idxd_user.o 00:01:59.276 CC lib/json/json_write.o 00:01:59.276 CC lib/env_dpdk/pci.o 00:01:59.276 CC lib/env_dpdk/init.o 00:01:59.276 CC lib/env_dpdk/threads.o 00:01:59.276 CC lib/env_dpdk/pci_ioat.o 00:01:59.276 CC lib/env_dpdk/pci_virtio.o 00:01:59.276 CC lib/env_dpdk/pci_vmd.o 00:01:59.276 CC lib/env_dpdk/pci_idxd.o 00:01:59.276 CC lib/env_dpdk/pci_event.o 00:01:59.276 CC lib/env_dpdk/sigbus_handler.o 00:01:59.276 CC lib/env_dpdk/pci_dpdk.o 00:01:59.276 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:59.276 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:59.276 LIB libspdk_trace_parser.a 00:01:59.276 SO libspdk_trace_parser.so.4.0 00:01:59.534 SYMLINK libspdk_trace_parser.so 00:01:59.534 LIB libspdk_conf.a 00:01:59.534 SO libspdk_conf.so.5.0 00:01:59.534 LIB libspdk_json.a 00:01:59.534 SYMLINK libspdk_conf.so 00:01:59.534 SO libspdk_json.so.5.1 00:01:59.534 SYMLINK libspdk_json.so 00:01:59.534 LIB libspdk_rdma.a 00:01:59.793 SO libspdk_rdma.so.5.0 00:01:59.793 SYMLINK libspdk_rdma.so 00:01:59.793 CC lib/jsonrpc/jsonrpc_server.o 00:01:59.793 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:59.793 CC lib/jsonrpc/jsonrpc_client.o 00:01:59.793 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:59.793 LIB libspdk_idxd.a 00:01:59.793 SO libspdk_idxd.so.11.0 00:01:59.793 SYMLINK libspdk_idxd.so 00:02:00.051 LIB libspdk_vmd.a 00:02:00.051 SO libspdk_vmd.so.5.0 00:02:00.051 SYMLINK libspdk_vmd.so 00:02:00.051 LIB libspdk_jsonrpc.a 00:02:00.051 SO libspdk_jsonrpc.so.5.1 00:02:00.051 SYMLINK libspdk_jsonrpc.so 00:02:00.309 CC lib/rpc/rpc.o 00:02:00.310 LIB libspdk_rpc.a 00:02:00.310 SO libspdk_rpc.so.5.0 00:02:00.568 SYMLINK libspdk_rpc.so 00:02:00.568 CC lib/notify/notify.o 00:02:00.568 CC lib/trace/trace.o 00:02:00.568 CC lib/trace/trace_flags.o 00:02:00.568 CC lib/notify/notify_rpc.o 00:02:00.568 CC lib/trace/trace_rpc.o 00:02:00.568 CC lib/sock/sock.o 00:02:00.568 CC lib/sock/sock_rpc.o 00:02:00.825 LIB libspdk_notify.a 00:02:00.825 SO libspdk_notify.so.5.0 00:02:00.825 SYMLINK libspdk_notify.so 00:02:00.825 LIB libspdk_trace.a 00:02:00.825 SO libspdk_trace.so.9.0 00:02:00.825 SYMLINK libspdk_trace.so 00:02:00.825 LIB libspdk_sock.a 00:02:01.083 SO libspdk_sock.so.8.0 00:02:01.083 CC lib/thread/thread.o 00:02:01.083 CC lib/thread/iobuf.o 00:02:01.083 SYMLINK libspdk_sock.so 00:02:01.083 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:01.083 CC lib/nvme/nvme_ctrlr.o 00:02:01.083 CC lib/nvme/nvme_fabric.o 00:02:01.083 CC lib/nvme/nvme_ns_cmd.o 00:02:01.083 CC lib/nvme/nvme_ns.o 00:02:01.083 CC lib/nvme/nvme_pcie_common.o 00:02:01.083 CC lib/nvme/nvme_pcie.o 00:02:01.083 CC lib/nvme/nvme_qpair.o 00:02:01.083 CC lib/nvme/nvme.o 00:02:01.083 CC lib/nvme/nvme_quirks.o 00:02:01.083 CC lib/nvme/nvme_transport.o 00:02:01.083 CC lib/nvme/nvme_discovery.o 00:02:01.083 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:01.083 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:01.083 CC lib/nvme/nvme_tcp.o 00:02:01.083 CC lib/nvme/nvme_opal.o 00:02:01.083 CC lib/nvme/nvme_io_msg.o 00:02:01.083 CC lib/nvme/nvme_zns.o 00:02:01.083 CC lib/nvme/nvme_poll_group.o 00:02:01.084 CC lib/nvme/nvme_cuse.o 00:02:01.084 CC lib/nvme/nvme_vfio_user.o 00:02:01.084 CC lib/nvme/nvme_rdma.o 00:02:01.342 LIB libspdk_env_dpdk.a 00:02:01.342 SO libspdk_env_dpdk.so.13.0 00:02:01.342 SYMLINK libspdk_env_dpdk.so 00:02:02.719 LIB libspdk_thread.a 00:02:02.719 SO libspdk_thread.so.9.0 00:02:02.719 SYMLINK libspdk_thread.so 00:02:02.719 CC lib/init/json_config.o 00:02:02.719 CC lib/blob/blobstore.o 00:02:02.719 CC lib/accel/accel.o 00:02:02.719 CC lib/init/subsystem.o 00:02:02.719 CC lib/blob/request.o 00:02:02.719 CC lib/accel/accel_rpc.o 00:02:02.719 CC lib/virtio/virtio.o 00:02:02.719 CC lib/blob/zeroes.o 00:02:02.719 CC lib/init/subsystem_rpc.o 00:02:02.719 CC lib/accel/accel_sw.o 00:02:02.719 CC lib/blob/blob_bs_dev.o 00:02:02.719 CC lib/virtio/virtio_vhost_user.o 00:02:02.719 CC lib/init/rpc.o 00:02:02.719 CC lib/virtio/virtio_vfio_user.o 00:02:02.719 CC lib/virtio/virtio_pci.o 00:02:02.977 LIB libspdk_init.a 00:02:02.977 SO libspdk_init.so.4.0 00:02:02.977 SYMLINK libspdk_init.so 00:02:03.236 LIB libspdk_virtio.a 00:02:03.236 SO libspdk_virtio.so.6.0 00:02:03.236 SYMLINK libspdk_virtio.so 00:02:03.236 CC lib/event/app.o 00:02:03.236 CC lib/event/reactor.o 00:02:03.236 CC lib/event/log_rpc.o 00:02:03.236 CC lib/event/app_rpc.o 00:02:03.236 CC lib/event/scheduler_static.o 00:02:03.494 LIB libspdk_nvme.a 00:02:03.494 SO libspdk_nvme.so.12.0 00:02:03.494 LIB libspdk_event.a 00:02:03.752 SO libspdk_event.so.12.0 00:02:03.752 SYMLINK libspdk_event.so 00:02:03.752 SYMLINK libspdk_nvme.so 00:02:03.752 LIB libspdk_accel.a 00:02:03.752 SO libspdk_accel.so.14.0 00:02:04.011 SYMLINK libspdk_accel.so 00:02:04.011 CC lib/bdev/bdev.o 00:02:04.011 CC lib/bdev/bdev_rpc.o 00:02:04.011 CC lib/bdev/bdev_zone.o 00:02:04.011 CC lib/bdev/part.o 00:02:04.011 CC lib/bdev/scsi_nvme.o 00:02:05.912 LIB libspdk_blob.a 00:02:05.912 SO libspdk_blob.so.10.1 00:02:05.912 SYMLINK libspdk_blob.so 00:02:05.912 CC lib/blobfs/blobfs.o 00:02:05.912 CC lib/blobfs/tree.o 00:02:05.912 CC lib/lvol/lvol.o 00:02:06.478 LIB libspdk_bdev.a 00:02:06.478 LIB libspdk_blobfs.a 00:02:06.478 SO libspdk_bdev.so.14.0 00:02:06.478 SO libspdk_blobfs.so.9.0 00:02:06.739 SYMLINK libspdk_blobfs.so 00:02:06.739 LIB libspdk_lvol.a 00:02:06.739 SYMLINK libspdk_bdev.so 00:02:06.739 SO libspdk_lvol.so.9.1 00:02:06.739 SYMLINK libspdk_lvol.so 00:02:06.739 CC lib/nbd/nbd.o 00:02:06.739 CC lib/nbd/nbd_rpc.o 00:02:06.739 CC lib/scsi/dev.o 00:02:06.739 CC lib/scsi/lun.o 00:02:06.739 CC lib/ublk/ublk.o 00:02:06.739 CC lib/nvmf/ctrlr.o 00:02:06.739 CC lib/scsi/port.o 00:02:06.739 CC lib/ftl/ftl_core.o 00:02:06.739 CC lib/ublk/ublk_rpc.o 00:02:06.739 CC lib/nvmf/ctrlr_discovery.o 00:02:06.739 CC lib/scsi/scsi.o 00:02:06.739 CC lib/ftl/ftl_init.o 00:02:06.739 CC lib/nvmf/ctrlr_bdev.o 00:02:06.739 CC lib/scsi/scsi_bdev.o 00:02:06.739 CC lib/ftl/ftl_layout.o 00:02:06.739 CC lib/scsi/scsi_pr.o 00:02:06.739 CC lib/nvmf/subsystem.o 00:02:06.739 CC lib/nvmf/nvmf.o 00:02:06.739 CC lib/scsi/scsi_rpc.o 00:02:06.739 CC lib/ftl/ftl_debug.o 00:02:06.739 CC lib/nvmf/nvmf_rpc.o 00:02:06.739 CC lib/scsi/task.o 00:02:06.739 CC lib/ftl/ftl_io.o 00:02:06.739 CC lib/ftl/ftl_sb.o 00:02:06.739 CC lib/ftl/ftl_l2p.o 00:02:06.739 CC lib/nvmf/transport.o 00:02:06.739 CC lib/nvmf/tcp.o 00:02:06.739 CC lib/ftl/ftl_l2p_flat.o 00:02:06.739 CC lib/ftl/ftl_nv_cache.o 00:02:06.739 CC lib/nvmf/rdma.o 00:02:06.739 CC lib/ftl/ftl_band.o 00:02:06.739 CC lib/ftl/ftl_band_ops.o 00:02:06.739 CC lib/ftl/ftl_writer.o 00:02:06.739 CC lib/ftl/ftl_rq.o 00:02:06.739 CC lib/ftl/ftl_reloc.o 00:02:06.739 CC lib/ftl/ftl_l2p_cache.o 00:02:06.739 CC lib/ftl/ftl_p2l.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:06.739 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:07.003 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:07.003 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:07.003 CC lib/ftl/utils/ftl_conf.o 00:02:07.265 CC lib/ftl/utils/ftl_md.o 00:02:07.265 CC lib/ftl/utils/ftl_mempool.o 00:02:07.265 CC lib/ftl/utils/ftl_bitmap.o 00:02:07.265 CC lib/ftl/utils/ftl_property.o 00:02:07.265 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:07.265 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:07.265 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:07.265 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:07.265 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:07.265 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:07.265 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:07.265 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:07.265 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:07.265 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:07.265 CC lib/ftl/base/ftl_base_dev.o 00:02:07.265 CC lib/ftl/base/ftl_base_bdev.o 00:02:07.265 CC lib/ftl/ftl_trace.o 00:02:07.524 LIB libspdk_nbd.a 00:02:07.524 SO libspdk_nbd.so.6.0 00:02:07.524 LIB libspdk_scsi.a 00:02:07.524 SYMLINK libspdk_nbd.so 00:02:07.524 SO libspdk_scsi.so.8.0 00:02:07.782 SYMLINK libspdk_scsi.so 00:02:07.782 LIB libspdk_ublk.a 00:02:07.782 SO libspdk_ublk.so.2.0 00:02:07.782 CC lib/iscsi/conn.o 00:02:07.782 CC lib/iscsi/init_grp.o 00:02:07.782 CC lib/iscsi/iscsi.o 00:02:07.782 CC lib/iscsi/md5.o 00:02:07.782 CC lib/iscsi/param.o 00:02:07.782 CC lib/iscsi/portal_grp.o 00:02:07.782 CC lib/iscsi/tgt_node.o 00:02:07.782 CC lib/vhost/vhost.o 00:02:07.782 CC lib/iscsi/iscsi_subsystem.o 00:02:07.782 CC lib/vhost/vhost_rpc.o 00:02:07.782 CC lib/iscsi/iscsi_rpc.o 00:02:07.782 CC lib/vhost/vhost_scsi.o 00:02:07.782 CC lib/iscsi/task.o 00:02:07.782 CC lib/vhost/vhost_blk.o 00:02:07.782 CC lib/vhost/rte_vhost_user.o 00:02:07.782 SYMLINK libspdk_ublk.so 00:02:08.041 LIB libspdk_ftl.a 00:02:08.299 SO libspdk_ftl.so.8.0 00:02:08.557 SYMLINK libspdk_ftl.so 00:02:09.124 LIB libspdk_vhost.a 00:02:09.124 SO libspdk_vhost.so.7.1 00:02:09.124 SYMLINK libspdk_vhost.so 00:02:09.124 LIB libspdk_iscsi.a 00:02:09.383 SO libspdk_iscsi.so.7.0 00:02:09.383 LIB libspdk_nvmf.a 00:02:09.383 SYMLINK libspdk_iscsi.so 00:02:09.383 SO libspdk_nvmf.so.17.0 00:02:09.641 SYMLINK libspdk_nvmf.so 00:02:09.641 CC module/env_dpdk/env_dpdk_rpc.o 00:02:09.900 CC module/sock/posix/posix.o 00:02:09.900 CC module/scheduler/gscheduler/gscheduler.o 00:02:09.900 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:09.900 CC module/accel/ioat/accel_ioat.o 00:02:09.900 CC module/accel/error/accel_error.o 00:02:09.900 CC module/accel/dsa/accel_dsa.o 00:02:09.900 CC module/blob/bdev/blob_bdev.o 00:02:09.900 CC module/accel/iaa/accel_iaa.o 00:02:09.900 CC module/accel/ioat/accel_ioat_rpc.o 00:02:09.900 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:09.900 CC module/accel/dsa/accel_dsa_rpc.o 00:02:09.900 CC module/accel/error/accel_error_rpc.o 00:02:09.900 CC module/accel/iaa/accel_iaa_rpc.o 00:02:09.900 LIB libspdk_env_dpdk_rpc.a 00:02:09.900 SO libspdk_env_dpdk_rpc.so.5.0 00:02:09.900 LIB libspdk_scheduler_gscheduler.a 00:02:09.900 SYMLINK libspdk_env_dpdk_rpc.so 00:02:09.900 LIB libspdk_scheduler_dpdk_governor.a 00:02:09.900 SO libspdk_scheduler_gscheduler.so.3.0 00:02:09.900 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:09.900 LIB libspdk_accel_error.a 00:02:09.900 LIB libspdk_accel_ioat.a 00:02:09.900 LIB libspdk_scheduler_dynamic.a 00:02:10.159 LIB libspdk_accel_iaa.a 00:02:10.159 SO libspdk_accel_error.so.1.0 00:02:10.159 SO libspdk_scheduler_dynamic.so.3.0 00:02:10.159 SYMLINK libspdk_scheduler_gscheduler.so 00:02:10.159 SO libspdk_accel_ioat.so.5.0 00:02:10.159 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:10.159 SO libspdk_accel_iaa.so.2.0 00:02:10.159 LIB libspdk_accel_dsa.a 00:02:10.159 SYMLINK libspdk_scheduler_dynamic.so 00:02:10.159 SYMLINK libspdk_accel_error.so 00:02:10.159 SYMLINK libspdk_accel_ioat.so 00:02:10.159 SO libspdk_accel_dsa.so.4.0 00:02:10.159 LIB libspdk_blob_bdev.a 00:02:10.159 SYMLINK libspdk_accel_iaa.so 00:02:10.159 SO libspdk_blob_bdev.so.10.1 00:02:10.159 SYMLINK libspdk_accel_dsa.so 00:02:10.159 SYMLINK libspdk_blob_bdev.so 00:02:10.418 CC module/bdev/delay/vbdev_delay.o 00:02:10.418 CC module/bdev/nvme/bdev_nvme.o 00:02:10.418 CC module/bdev/gpt/gpt.o 00:02:10.418 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:10.418 CC module/bdev/lvol/vbdev_lvol.o 00:02:10.418 CC module/bdev/error/vbdev_error.o 00:02:10.418 CC module/bdev/null/bdev_null.o 00:02:10.418 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:10.418 CC module/bdev/gpt/vbdev_gpt.o 00:02:10.418 CC module/bdev/error/vbdev_error_rpc.o 00:02:10.418 CC module/bdev/nvme/nvme_rpc.o 00:02:10.418 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:10.418 CC module/bdev/null/bdev_null_rpc.o 00:02:10.418 CC module/bdev/nvme/bdev_mdns_client.o 00:02:10.418 CC module/bdev/nvme/vbdev_opal.o 00:02:10.418 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:10.418 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:10.418 CC module/bdev/split/vbdev_split.o 00:02:10.418 CC module/bdev/passthru/vbdev_passthru.o 00:02:10.418 CC module/bdev/malloc/bdev_malloc.o 00:02:10.418 CC module/bdev/split/vbdev_split_rpc.o 00:02:10.418 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:10.418 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:10.418 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:10.418 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:10.418 CC module/bdev/iscsi/bdev_iscsi.o 00:02:10.418 CC module/blobfs/bdev/blobfs_bdev.o 00:02:10.418 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:10.418 CC module/bdev/aio/bdev_aio.o 00:02:10.418 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:10.418 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:10.418 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:10.418 CC module/bdev/aio/bdev_aio_rpc.o 00:02:10.418 CC module/bdev/ftl/bdev_ftl.o 00:02:10.418 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:10.418 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:10.418 CC module/bdev/raid/bdev_raid.o 00:02:10.418 CC module/bdev/raid/bdev_raid_rpc.o 00:02:10.418 CC module/bdev/raid/bdev_raid_sb.o 00:02:10.418 CC module/bdev/raid/raid0.o 00:02:10.418 CC module/bdev/raid/raid1.o 00:02:10.418 CC module/bdev/raid/concat.o 00:02:10.677 LIB libspdk_sock_posix.a 00:02:10.677 SO libspdk_sock_posix.so.5.0 00:02:10.677 LIB libspdk_blobfs_bdev.a 00:02:10.677 SO libspdk_blobfs_bdev.so.5.0 00:02:10.677 LIB libspdk_bdev_error.a 00:02:10.677 SO libspdk_bdev_error.so.5.0 00:02:10.677 SYMLINK libspdk_sock_posix.so 00:02:10.677 LIB libspdk_bdev_split.a 00:02:10.677 LIB libspdk_bdev_gpt.a 00:02:10.677 SYMLINK libspdk_blobfs_bdev.so 00:02:10.677 SO libspdk_bdev_split.so.5.0 00:02:10.677 LIB libspdk_bdev_null.a 00:02:10.935 SO libspdk_bdev_gpt.so.5.0 00:02:10.935 SYMLINK libspdk_bdev_error.so 00:02:10.935 SO libspdk_bdev_null.so.5.0 00:02:10.935 SYMLINK libspdk_bdev_split.so 00:02:10.935 SYMLINK libspdk_bdev_gpt.so 00:02:10.935 LIB libspdk_bdev_zone_block.a 00:02:10.935 LIB libspdk_bdev_ftl.a 00:02:10.935 SYMLINK libspdk_bdev_null.so 00:02:10.935 SO libspdk_bdev_zone_block.so.5.0 00:02:10.935 LIB libspdk_bdev_passthru.a 00:02:10.935 SO libspdk_bdev_ftl.so.5.0 00:02:10.935 LIB libspdk_bdev_aio.a 00:02:10.935 LIB libspdk_bdev_malloc.a 00:02:10.935 SO libspdk_bdev_passthru.so.5.0 00:02:10.935 SO libspdk_bdev_aio.so.5.0 00:02:10.935 SO libspdk_bdev_malloc.so.5.0 00:02:10.935 SYMLINK libspdk_bdev_zone_block.so 00:02:10.935 SYMLINK libspdk_bdev_ftl.so 00:02:10.935 LIB libspdk_bdev_iscsi.a 00:02:10.935 SYMLINK libspdk_bdev_passthru.so 00:02:10.935 LIB libspdk_bdev_delay.a 00:02:10.935 SYMLINK libspdk_bdev_aio.so 00:02:10.935 SYMLINK libspdk_bdev_malloc.so 00:02:10.935 SO libspdk_bdev_iscsi.so.5.0 00:02:10.935 SO libspdk_bdev_delay.so.5.0 00:02:10.935 SYMLINK libspdk_bdev_iscsi.so 00:02:10.935 SYMLINK libspdk_bdev_delay.so 00:02:11.193 LIB libspdk_bdev_lvol.a 00:02:11.193 LIB libspdk_bdev_virtio.a 00:02:11.193 SO libspdk_bdev_lvol.so.5.0 00:02:11.193 SO libspdk_bdev_virtio.so.5.0 00:02:11.193 SYMLINK libspdk_bdev_lvol.so 00:02:11.193 SYMLINK libspdk_bdev_virtio.so 00:02:11.452 LIB libspdk_bdev_raid.a 00:02:11.452 SO libspdk_bdev_raid.so.5.0 00:02:11.452 SYMLINK libspdk_bdev_raid.so 00:02:12.826 LIB libspdk_bdev_nvme.a 00:02:12.826 SO libspdk_bdev_nvme.so.6.0 00:02:12.826 SYMLINK libspdk_bdev_nvme.so 00:02:13.084 CC module/event/subsystems/vmd/vmd.o 00:02:13.084 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:13.084 CC module/event/subsystems/iobuf/iobuf.o 00:02:13.084 CC module/event/subsystems/sock/sock.o 00:02:13.084 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:13.084 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:13.084 CC module/event/subsystems/scheduler/scheduler.o 00:02:13.084 LIB libspdk_event_sock.a 00:02:13.084 LIB libspdk_event_vhost_blk.a 00:02:13.084 LIB libspdk_event_vmd.a 00:02:13.084 LIB libspdk_event_scheduler.a 00:02:13.084 SO libspdk_event_sock.so.4.0 00:02:13.084 SO libspdk_event_vhost_blk.so.2.0 00:02:13.084 LIB libspdk_event_iobuf.a 00:02:13.084 SO libspdk_event_vmd.so.5.0 00:02:13.084 SO libspdk_event_scheduler.so.3.0 00:02:13.342 SO libspdk_event_iobuf.so.2.0 00:02:13.342 SYMLINK libspdk_event_sock.so 00:02:13.342 SYMLINK libspdk_event_vhost_blk.so 00:02:13.342 SYMLINK libspdk_event_scheduler.so 00:02:13.342 SYMLINK libspdk_event_vmd.so 00:02:13.342 SYMLINK libspdk_event_iobuf.so 00:02:13.342 CC module/event/subsystems/accel/accel.o 00:02:13.600 LIB libspdk_event_accel.a 00:02:13.600 SO libspdk_event_accel.so.5.0 00:02:13.600 SYMLINK libspdk_event_accel.so 00:02:13.600 CC module/event/subsystems/bdev/bdev.o 00:02:13.859 LIB libspdk_event_bdev.a 00:02:13.859 SO libspdk_event_bdev.so.5.0 00:02:13.859 SYMLINK libspdk_event_bdev.so 00:02:14.126 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:14.126 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:14.126 CC module/event/subsystems/nbd/nbd.o 00:02:14.126 CC module/event/subsystems/scsi/scsi.o 00:02:14.126 CC module/event/subsystems/ublk/ublk.o 00:02:14.126 LIB libspdk_event_nbd.a 00:02:14.126 LIB libspdk_event_ublk.a 00:02:14.126 LIB libspdk_event_scsi.a 00:02:14.126 SO libspdk_event_nbd.so.5.0 00:02:14.126 SO libspdk_event_ublk.so.2.0 00:02:14.126 SO libspdk_event_scsi.so.5.0 00:02:14.422 SYMLINK libspdk_event_nbd.so 00:02:14.422 SYMLINK libspdk_event_ublk.so 00:02:14.422 LIB libspdk_event_nvmf.a 00:02:14.422 SYMLINK libspdk_event_scsi.so 00:02:14.422 SO libspdk_event_nvmf.so.5.0 00:02:14.422 SYMLINK libspdk_event_nvmf.so 00:02:14.422 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:14.422 CC module/event/subsystems/iscsi/iscsi.o 00:02:14.422 LIB libspdk_event_vhost_scsi.a 00:02:14.681 SO libspdk_event_vhost_scsi.so.2.0 00:02:14.681 LIB libspdk_event_iscsi.a 00:02:14.681 SO libspdk_event_iscsi.so.5.0 00:02:14.681 SYMLINK libspdk_event_vhost_scsi.so 00:02:14.681 SYMLINK libspdk_event_iscsi.so 00:02:14.681 SO libspdk.so.5.0 00:02:14.681 SYMLINK libspdk.so 00:02:14.950 CC app/trace_record/trace_record.o 00:02:14.950 CC app/spdk_top/spdk_top.o 00:02:14.950 CC app/spdk_nvme_identify/identify.o 00:02:14.950 CXX app/trace/trace.o 00:02:14.950 CC app/spdk_nvme_perf/perf.o 00:02:14.950 CC app/spdk_nvme_discover/discovery_aer.o 00:02:14.950 CC app/spdk_lspci/spdk_lspci.o 00:02:14.950 TEST_HEADER include/spdk/accel.h 00:02:14.950 TEST_HEADER include/spdk/accel_module.h 00:02:14.950 TEST_HEADER include/spdk/assert.h 00:02:14.950 CC test/rpc_client/rpc_client_test.o 00:02:14.950 TEST_HEADER include/spdk/barrier.h 00:02:14.950 TEST_HEADER include/spdk/base64.h 00:02:14.950 TEST_HEADER include/spdk/bdev.h 00:02:14.950 TEST_HEADER include/spdk/bdev_module.h 00:02:14.950 TEST_HEADER include/spdk/bdev_zone.h 00:02:14.950 TEST_HEADER include/spdk/bit_array.h 00:02:14.950 TEST_HEADER include/spdk/bit_pool.h 00:02:14.950 TEST_HEADER include/spdk/blob_bdev.h 00:02:14.950 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:14.950 TEST_HEADER include/spdk/blobfs.h 00:02:14.950 TEST_HEADER include/spdk/blob.h 00:02:14.950 TEST_HEADER include/spdk/conf.h 00:02:14.950 TEST_HEADER include/spdk/config.h 00:02:14.950 TEST_HEADER include/spdk/cpuset.h 00:02:14.950 CC app/spdk_dd/spdk_dd.o 00:02:14.950 TEST_HEADER include/spdk/crc16.h 00:02:14.950 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:14.950 TEST_HEADER include/spdk/crc32.h 00:02:14.950 CC app/nvmf_tgt/nvmf_main.o 00:02:14.950 TEST_HEADER include/spdk/crc64.h 00:02:14.950 CC app/iscsi_tgt/iscsi_tgt.o 00:02:14.950 TEST_HEADER include/spdk/dif.h 00:02:14.950 CC app/vhost/vhost.o 00:02:14.950 TEST_HEADER include/spdk/dma.h 00:02:14.950 TEST_HEADER include/spdk/endian.h 00:02:14.950 CC examples/vmd/led/led.o 00:02:14.950 CC examples/ioat/verify/verify.o 00:02:14.950 TEST_HEADER include/spdk/env_dpdk.h 00:02:14.950 CC examples/vmd/lsvmd/lsvmd.o 00:02:14.950 TEST_HEADER include/spdk/env.h 00:02:14.950 CC test/app/histogram_perf/histogram_perf.o 00:02:14.950 CC examples/ioat/perf/perf.o 00:02:14.950 CC examples/sock/hello_world/hello_sock.o 00:02:14.950 TEST_HEADER include/spdk/event.h 00:02:14.950 CC examples/idxd/perf/perf.o 00:02:14.950 CC test/app/jsoncat/jsoncat.o 00:02:14.950 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:14.950 TEST_HEADER include/spdk/fd_group.h 00:02:14.950 CC examples/nvme/hotplug/hotplug.o 00:02:14.950 CC app/fio/nvme/fio_plugin.o 00:02:14.950 TEST_HEADER include/spdk/fd.h 00:02:14.950 CC examples/accel/perf/accel_perf.o 00:02:14.950 CC examples/nvme/hello_world/hello_world.o 00:02:14.950 TEST_HEADER include/spdk/file.h 00:02:14.950 CC examples/nvme/arbitration/arbitration.o 00:02:14.950 TEST_HEADER include/spdk/ftl.h 00:02:14.950 CC test/nvme/aer/aer.o 00:02:14.950 CC examples/nvme/reconnect/reconnect.o 00:02:14.950 CC test/event/event_perf/event_perf.o 00:02:14.950 CC examples/util/zipf/zipf.o 00:02:14.950 TEST_HEADER include/spdk/gpt_spec.h 00:02:14.950 CC test/thread/poller_perf/poller_perf.o 00:02:14.950 TEST_HEADER include/spdk/hexlify.h 00:02:14.950 TEST_HEADER include/spdk/histogram_data.h 00:02:14.950 TEST_HEADER include/spdk/idxd.h 00:02:14.950 CC app/spdk_tgt/spdk_tgt.o 00:02:14.950 TEST_HEADER include/spdk/idxd_spec.h 00:02:14.950 TEST_HEADER include/spdk/init.h 00:02:14.950 TEST_HEADER include/spdk/ioat.h 00:02:14.950 TEST_HEADER include/spdk/ioat_spec.h 00:02:14.950 TEST_HEADER include/spdk/iscsi_spec.h 00:02:14.950 TEST_HEADER include/spdk/json.h 00:02:14.950 TEST_HEADER include/spdk/jsonrpc.h 00:02:14.950 TEST_HEADER include/spdk/likely.h 00:02:14.950 TEST_HEADER include/spdk/log.h 00:02:14.950 TEST_HEADER include/spdk/lvol.h 00:02:14.950 CC examples/blob/hello_world/hello_blob.o 00:02:14.950 CC examples/thread/thread/thread_ex.o 00:02:14.950 TEST_HEADER include/spdk/memory.h 00:02:14.950 CC test/blobfs/mkfs/mkfs.o 00:02:14.950 TEST_HEADER include/spdk/mmio.h 00:02:14.950 CC test/app/bdev_svc/bdev_svc.o 00:02:14.950 CC examples/blob/cli/blobcli.o 00:02:14.950 CC examples/bdev/hello_world/hello_bdev.o 00:02:14.950 TEST_HEADER include/spdk/nbd.h 00:02:14.950 CC examples/nvmf/nvmf/nvmf.o 00:02:14.950 CC test/dma/test_dma/test_dma.o 00:02:14.950 CC test/accel/dif/dif.o 00:02:14.950 CC examples/bdev/bdevperf/bdevperf.o 00:02:14.950 TEST_HEADER include/spdk/notify.h 00:02:14.950 TEST_HEADER include/spdk/nvme.h 00:02:14.950 CC test/bdev/bdevio/bdevio.o 00:02:14.950 TEST_HEADER include/spdk/nvme_intel.h 00:02:14.950 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:14.950 CC test/lvol/esnap/esnap.o 00:02:14.950 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:14.950 TEST_HEADER include/spdk/nvme_spec.h 00:02:14.950 TEST_HEADER include/spdk/nvme_zns.h 00:02:14.950 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:14.950 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:14.950 TEST_HEADER include/spdk/nvmf.h 00:02:14.950 TEST_HEADER include/spdk/nvmf_spec.h 00:02:14.950 CC test/env/mem_callbacks/mem_callbacks.o 00:02:14.950 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:14.950 TEST_HEADER include/spdk/nvmf_transport.h 00:02:14.950 TEST_HEADER include/spdk/opal.h 00:02:15.211 TEST_HEADER include/spdk/opal_spec.h 00:02:15.211 TEST_HEADER include/spdk/pci_ids.h 00:02:15.211 TEST_HEADER include/spdk/pipe.h 00:02:15.211 TEST_HEADER include/spdk/queue.h 00:02:15.211 TEST_HEADER include/spdk/reduce.h 00:02:15.211 TEST_HEADER include/spdk/rpc.h 00:02:15.211 TEST_HEADER include/spdk/scheduler.h 00:02:15.211 TEST_HEADER include/spdk/scsi.h 00:02:15.211 TEST_HEADER include/spdk/scsi_spec.h 00:02:15.211 TEST_HEADER include/spdk/sock.h 00:02:15.211 TEST_HEADER include/spdk/stdinc.h 00:02:15.211 TEST_HEADER include/spdk/string.h 00:02:15.211 TEST_HEADER include/spdk/thread.h 00:02:15.211 TEST_HEADER include/spdk/trace.h 00:02:15.211 TEST_HEADER include/spdk/trace_parser.h 00:02:15.211 LINK spdk_lspci 00:02:15.211 TEST_HEADER include/spdk/tree.h 00:02:15.211 TEST_HEADER include/spdk/ublk.h 00:02:15.211 TEST_HEADER include/spdk/util.h 00:02:15.211 TEST_HEADER include/spdk/uuid.h 00:02:15.211 TEST_HEADER include/spdk/version.h 00:02:15.211 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:15.211 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:15.211 TEST_HEADER include/spdk/vhost.h 00:02:15.211 TEST_HEADER include/spdk/vmd.h 00:02:15.211 TEST_HEADER include/spdk/xor.h 00:02:15.211 TEST_HEADER include/spdk/zipf.h 00:02:15.211 CXX test/cpp_headers/accel.o 00:02:15.211 LINK lsvmd 00:02:15.211 LINK jsoncat 00:02:15.211 LINK led 00:02:15.211 LINK rpc_client_test 00:02:15.211 LINK histogram_perf 00:02:15.211 LINK spdk_nvme_discover 00:02:15.211 LINK event_perf 00:02:15.211 LINK poller_perf 00:02:15.211 LINK interrupt_tgt 00:02:15.211 LINK nvmf_tgt 00:02:15.211 LINK zipf 00:02:15.211 LINK vhost 00:02:15.211 LINK spdk_trace_record 00:02:15.474 LINK iscsi_tgt 00:02:15.474 LINK bdev_svc 00:02:15.474 LINK ioat_perf 00:02:15.474 LINK verify 00:02:15.474 LINK spdk_tgt 00:02:15.474 LINK mkfs 00:02:15.474 LINK hello_world 00:02:15.474 LINK hello_sock 00:02:15.474 LINK hotplug 00:02:15.474 LINK hello_blob 00:02:15.474 LINK thread 00:02:15.474 LINK hello_bdev 00:02:15.474 LINK aer 00:02:15.474 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:15.474 CXX test/cpp_headers/accel_module.o 00:02:15.474 LINK idxd_perf 00:02:15.474 LINK nvmf 00:02:15.474 LINK arbitration 00:02:15.474 CXX test/cpp_headers/assert.o 00:02:15.737 LINK spdk_dd 00:02:15.737 CC test/app/stub/stub.o 00:02:15.737 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:15.737 CC examples/nvme/abort/abort.o 00:02:15.737 CC test/event/reactor/reactor.o 00:02:15.737 LINK reconnect 00:02:15.737 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:15.737 CC test/env/vtophys/vtophys.o 00:02:15.737 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:15.737 CC app/fio/bdev/fio_plugin.o 00:02:15.737 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:15.737 LINK spdk_trace 00:02:15.737 CC test/env/pci/pci_ut.o 00:02:15.737 CC test/env/memory/memory_ut.o 00:02:15.737 LINK dif 00:02:15.737 LINK test_dma 00:02:15.737 LINK bdevio 00:02:15.737 CXX test/cpp_headers/barrier.o 00:02:15.737 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:15.737 CC test/nvme/reset/reset.o 00:02:15.737 CC test/nvme/sgl/sgl.o 00:02:15.737 CXX test/cpp_headers/base64.o 00:02:15.737 LINK accel_perf 00:02:15.737 CC test/event/reactor_perf/reactor_perf.o 00:02:15.737 CC test/nvme/e2edp/nvme_dp.o 00:02:15.737 CXX test/cpp_headers/bdev.o 00:02:15.737 CXX test/cpp_headers/bdev_module.o 00:02:16.006 LINK nvme_fuzz 00:02:16.006 CXX test/cpp_headers/bdev_zone.o 00:02:16.006 CC test/nvme/overhead/overhead.o 00:02:16.006 CXX test/cpp_headers/bit_array.o 00:02:16.006 LINK nvme_manage 00:02:16.006 CXX test/cpp_headers/bit_pool.o 00:02:16.006 CXX test/cpp_headers/blob_bdev.o 00:02:16.006 LINK blobcli 00:02:16.006 CC test/event/app_repeat/app_repeat.o 00:02:16.006 LINK vtophys 00:02:16.006 LINK reactor 00:02:16.006 CXX test/cpp_headers/blobfs_bdev.o 00:02:16.006 CXX test/cpp_headers/blobfs.o 00:02:16.006 CC test/event/scheduler/scheduler.o 00:02:16.006 CXX test/cpp_headers/blob.o 00:02:16.006 CC test/nvme/err_injection/err_injection.o 00:02:16.006 LINK stub 00:02:16.006 LINK spdk_nvme 00:02:16.006 LINK cmb_copy 00:02:16.006 LINK env_dpdk_post_init 00:02:16.006 CC test/nvme/startup/startup.o 00:02:16.006 CXX test/cpp_headers/conf.o 00:02:16.006 CC test/nvme/reserve/reserve.o 00:02:16.006 CXX test/cpp_headers/config.o 00:02:16.006 LINK reactor_perf 00:02:16.267 CXX test/cpp_headers/cpuset.o 00:02:16.267 CXX test/cpp_headers/crc16.o 00:02:16.267 LINK pmr_persistence 00:02:16.267 CXX test/cpp_headers/crc32.o 00:02:16.267 CXX test/cpp_headers/crc64.o 00:02:16.267 CXX test/cpp_headers/dif.o 00:02:16.267 CC test/nvme/simple_copy/simple_copy.o 00:02:16.267 CC test/nvme/connect_stress/connect_stress.o 00:02:16.267 LINK app_repeat 00:02:16.267 CXX test/cpp_headers/dma.o 00:02:16.267 CC test/nvme/compliance/nvme_compliance.o 00:02:16.267 CC test/nvme/boot_partition/boot_partition.o 00:02:16.267 LINK mem_callbacks 00:02:16.267 LINK reset 00:02:16.267 CXX test/cpp_headers/endian.o 00:02:16.267 CXX test/cpp_headers/env_dpdk.o 00:02:16.267 CXX test/cpp_headers/env.o 00:02:16.267 LINK sgl 00:02:16.267 CXX test/cpp_headers/event.o 00:02:16.267 CXX test/cpp_headers/fd_group.o 00:02:16.267 CXX test/cpp_headers/fd.o 00:02:16.267 CXX test/cpp_headers/file.o 00:02:16.267 CXX test/cpp_headers/ftl.o 00:02:16.267 LINK err_injection 00:02:16.267 CXX test/cpp_headers/gpt_spec.o 00:02:16.267 CXX test/cpp_headers/hexlify.o 00:02:16.267 CC test/nvme/fused_ordering/fused_ordering.o 00:02:16.267 LINK spdk_nvme_perf 00:02:16.267 LINK startup 00:02:16.267 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:16.267 CC test/nvme/fdp/fdp.o 00:02:16.267 LINK abort 00:02:16.267 CC test/nvme/cuse/cuse.o 00:02:16.533 LINK nvme_dp 00:02:16.533 CXX test/cpp_headers/histogram_data.o 00:02:16.533 LINK scheduler 00:02:16.533 CXX test/cpp_headers/idxd.o 00:02:16.533 LINK vhost_fuzz 00:02:16.533 CXX test/cpp_headers/idxd_spec.o 00:02:16.533 LINK spdk_nvme_identify 00:02:16.533 LINK pci_ut 00:02:16.533 LINK overhead 00:02:16.533 LINK bdevperf 00:02:16.533 CXX test/cpp_headers/init.o 00:02:16.533 LINK spdk_top 00:02:16.533 CXX test/cpp_headers/ioat.o 00:02:16.533 LINK reserve 00:02:16.533 CXX test/cpp_headers/ioat_spec.o 00:02:16.533 CXX test/cpp_headers/iscsi_spec.o 00:02:16.533 CXX test/cpp_headers/json.o 00:02:16.533 CXX test/cpp_headers/jsonrpc.o 00:02:16.533 CXX test/cpp_headers/likely.o 00:02:16.533 CXX test/cpp_headers/log.o 00:02:16.533 LINK connect_stress 00:02:16.533 LINK boot_partition 00:02:16.533 CXX test/cpp_headers/lvol.o 00:02:16.533 CXX test/cpp_headers/memory.o 00:02:16.533 CXX test/cpp_headers/mmio.o 00:02:16.533 CXX test/cpp_headers/nbd.o 00:02:16.793 LINK spdk_bdev 00:02:16.793 LINK simple_copy 00:02:16.793 CXX test/cpp_headers/notify.o 00:02:16.793 CXX test/cpp_headers/nvme.o 00:02:16.793 CXX test/cpp_headers/nvme_intel.o 00:02:16.793 CXX test/cpp_headers/nvme_ocssd.o 00:02:16.793 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:16.793 CXX test/cpp_headers/nvme_spec.o 00:02:16.793 CXX test/cpp_headers/nvme_zns.o 00:02:16.793 CXX test/cpp_headers/nvmf_cmd.o 00:02:16.793 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:16.793 CXX test/cpp_headers/nvmf.o 00:02:16.793 CXX test/cpp_headers/nvmf_spec.o 00:02:16.793 CXX test/cpp_headers/nvmf_transport.o 00:02:16.793 CXX test/cpp_headers/opal.o 00:02:16.793 CXX test/cpp_headers/opal_spec.o 00:02:16.793 LINK fused_ordering 00:02:16.793 CXX test/cpp_headers/pci_ids.o 00:02:16.793 LINK doorbell_aers 00:02:16.793 CXX test/cpp_headers/pipe.o 00:02:16.793 CXX test/cpp_headers/queue.o 00:02:16.793 CXX test/cpp_headers/reduce.o 00:02:16.793 CXX test/cpp_headers/rpc.o 00:02:16.793 CXX test/cpp_headers/scheduler.o 00:02:16.793 CXX test/cpp_headers/scsi.o 00:02:16.793 CXX test/cpp_headers/scsi_spec.o 00:02:16.793 CXX test/cpp_headers/sock.o 00:02:16.793 CXX test/cpp_headers/stdinc.o 00:02:16.793 CXX test/cpp_headers/string.o 00:02:16.793 CXX test/cpp_headers/thread.o 00:02:16.793 CXX test/cpp_headers/trace.o 00:02:16.793 CXX test/cpp_headers/trace_parser.o 00:02:16.793 CXX test/cpp_headers/tree.o 00:02:16.793 LINK nvme_compliance 00:02:16.793 CXX test/cpp_headers/ublk.o 00:02:16.793 CXX test/cpp_headers/util.o 00:02:16.793 CXX test/cpp_headers/uuid.o 00:02:17.051 CXX test/cpp_headers/version.o 00:02:17.051 CXX test/cpp_headers/vfio_user_pci.o 00:02:17.051 CXX test/cpp_headers/vfio_user_spec.o 00:02:17.051 CXX test/cpp_headers/vhost.o 00:02:17.051 CXX test/cpp_headers/vmd.o 00:02:17.051 CXX test/cpp_headers/xor.o 00:02:17.051 CXX test/cpp_headers/zipf.o 00:02:17.051 LINK fdp 00:02:17.616 LINK memory_ut 00:02:17.874 LINK cuse 00:02:18.132 LINK iscsi_fuzz 00:02:20.657 LINK esnap 00:02:20.657 00:02:20.657 real 0m46.217s 00:02:20.657 user 9m39.790s 00:02:20.657 sys 2m11.406s 00:02:20.657 19:00:39 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:20.657 19:00:39 -- common/autotest_common.sh@10 -- $ set +x 00:02:20.657 ************************************ 00:02:20.657 END TEST make 00:02:20.657 ************************************ 00:02:20.657 19:00:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:20.657 19:00:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:20.657 19:00:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:20.914 19:00:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:20.914 19:00:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:20.914 19:00:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:20.914 19:00:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:20.914 19:00:39 -- scripts/common.sh@335 -- # IFS=.-: 00:02:20.914 19:00:39 -- scripts/common.sh@335 -- # read -ra ver1 00:02:20.914 19:00:39 -- scripts/common.sh@336 -- # IFS=.-: 00:02:20.914 19:00:39 -- scripts/common.sh@336 -- # read -ra ver2 00:02:20.914 19:00:39 -- scripts/common.sh@337 -- # local 'op=<' 00:02:20.914 19:00:39 -- scripts/common.sh@339 -- # ver1_l=2 00:02:20.914 19:00:39 -- scripts/common.sh@340 -- # ver2_l=1 00:02:20.914 19:00:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:20.914 19:00:39 -- scripts/common.sh@343 -- # case "$op" in 00:02:20.914 19:00:39 -- scripts/common.sh@344 -- # : 1 00:02:20.915 19:00:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:20.915 19:00:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:20.915 19:00:39 -- scripts/common.sh@364 -- # decimal 1 00:02:20.915 19:00:39 -- scripts/common.sh@352 -- # local d=1 00:02:20.915 19:00:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:20.915 19:00:39 -- scripts/common.sh@354 -- # echo 1 00:02:20.915 19:00:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:20.915 19:00:39 -- scripts/common.sh@365 -- # decimal 2 00:02:20.915 19:00:39 -- scripts/common.sh@352 -- # local d=2 00:02:20.915 19:00:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:20.915 19:00:39 -- scripts/common.sh@354 -- # echo 2 00:02:20.915 19:00:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:20.915 19:00:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:20.915 19:00:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:20.915 19:00:39 -- scripts/common.sh@367 -- # return 0 00:02:20.915 19:00:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:20.915 19:00:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:20.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:20.915 --rc genhtml_branch_coverage=1 00:02:20.915 --rc genhtml_function_coverage=1 00:02:20.915 --rc genhtml_legend=1 00:02:20.915 --rc geninfo_all_blocks=1 00:02:20.915 --rc geninfo_unexecuted_blocks=1 00:02:20.915 00:02:20.915 ' 00:02:20.915 19:00:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:20.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:20.915 --rc genhtml_branch_coverage=1 00:02:20.915 --rc genhtml_function_coverage=1 00:02:20.915 --rc genhtml_legend=1 00:02:20.915 --rc geninfo_all_blocks=1 00:02:20.915 --rc geninfo_unexecuted_blocks=1 00:02:20.915 00:02:20.915 ' 00:02:20.915 19:00:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:20.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:20.915 --rc genhtml_branch_coverage=1 00:02:20.915 --rc genhtml_function_coverage=1 00:02:20.915 --rc genhtml_legend=1 00:02:20.915 --rc geninfo_all_blocks=1 00:02:20.915 --rc geninfo_unexecuted_blocks=1 00:02:20.915 00:02:20.915 ' 00:02:20.915 19:00:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:20.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:20.915 --rc genhtml_branch_coverage=1 00:02:20.915 --rc genhtml_function_coverage=1 00:02:20.915 --rc genhtml_legend=1 00:02:20.915 --rc geninfo_all_blocks=1 00:02:20.915 --rc geninfo_unexecuted_blocks=1 00:02:20.915 00:02:20.915 ' 00:02:20.915 19:00:39 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:20.915 19:00:39 -- nvmf/common.sh@7 -- # uname -s 00:02:20.915 19:00:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:20.915 19:00:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:20.915 19:00:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:20.915 19:00:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:20.915 19:00:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:20.915 19:00:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:20.915 19:00:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:20.915 19:00:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:20.915 19:00:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:20.915 19:00:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:20.915 19:00:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:20.915 19:00:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:20.915 19:00:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:20.915 19:00:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:20.915 19:00:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:20.915 19:00:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:20.915 19:00:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:20.915 19:00:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:20.915 19:00:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:20.915 19:00:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:20.915 19:00:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:20.915 19:00:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:20.915 19:00:39 -- paths/export.sh@5 -- # export PATH 00:02:20.915 19:00:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:20.915 19:00:39 -- nvmf/common.sh@46 -- # : 0 00:02:20.915 19:00:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:20.915 19:00:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:20.915 19:00:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:20.915 19:00:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:20.915 19:00:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:20.915 19:00:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:20.915 19:00:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:20.915 19:00:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:20.915 19:00:39 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:20.915 19:00:39 -- spdk/autotest.sh@32 -- # uname -s 00:02:20.915 19:00:39 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:20.915 19:00:39 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:20.915 19:00:39 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:20.915 19:00:39 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:20.915 19:00:39 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:20.915 19:00:39 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:20.915 19:00:39 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:20.915 19:00:39 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:20.915 19:00:39 -- spdk/autotest.sh@48 -- # udevadm_pid=3286637 00:02:20.915 19:00:39 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:20.915 19:00:39 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:20.915 19:00:39 -- spdk/autotest.sh@54 -- # echo 3286639 00:02:20.915 19:00:39 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:20.915 19:00:39 -- spdk/autotest.sh@56 -- # echo 3286640 00:02:20.915 19:00:39 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:20.915 19:00:39 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:20.915 19:00:39 -- spdk/autotest.sh@60 -- # echo 3286641 00:02:20.915 19:00:39 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:20.915 19:00:39 -- spdk/autotest.sh@62 -- # echo 3286642 00:02:20.915 19:00:39 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:20.915 19:00:39 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:20.915 19:00:39 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:20.915 19:00:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:20.915 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:02:20.915 19:00:39 -- spdk/autotest.sh@70 -- # create_test_list 00:02:20.915 19:00:39 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:20.915 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:02:20.915 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:20.915 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:20.915 19:00:39 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:20.915 19:00:39 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:20.915 19:00:39 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:20.915 19:00:39 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:20.915 19:00:39 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:20.915 19:00:39 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:20.915 19:00:39 -- common/autotest_common.sh@1450 -- # uname 00:02:20.915 19:00:39 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:20.915 19:00:39 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:20.915 19:00:39 -- common/autotest_common.sh@1470 -- # uname 00:02:20.915 19:00:39 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:20.915 19:00:39 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:20.915 19:00:39 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:20.915 lcov: LCOV version 1.15 00:02:20.915 19:00:39 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:25.096 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:25.096 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:25.096 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:25.097 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:25.097 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:25.097 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:57.157 19:01:12 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:57.157 19:01:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:57.157 19:01:12 -- common/autotest_common.sh@10 -- # set +x 00:02:57.157 19:01:12 -- spdk/autotest.sh@89 -- # rm -f 00:02:57.157 19:01:12 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:57.157 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:57.157 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:57.157 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:57.157 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:57.157 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:57.157 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:57.157 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:57.157 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:57.157 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:57.157 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:57.157 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:57.157 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:57.157 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:57.157 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:57.157 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:57.157 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:57.157 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:57.157 19:01:13 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:57.157 19:01:13 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:57.157 19:01:13 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:57.157 19:01:13 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:57.157 19:01:13 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:57.157 19:01:13 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:57.157 19:01:13 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:57.157 19:01:13 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:57.157 19:01:13 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:57.157 19:01:13 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:57.157 19:01:13 -- spdk/autotest.sh@108 -- # grep -v p 00:02:57.157 19:01:13 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:57.157 19:01:13 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:57.157 19:01:13 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:57.157 19:01:13 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:57.157 19:01:13 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:57.157 19:01:13 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:57.157 No valid GPT data, bailing 00:02:57.157 19:01:13 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:57.157 19:01:13 -- scripts/common.sh@393 -- # pt= 00:02:57.157 19:01:13 -- scripts/common.sh@394 -- # return 1 00:02:57.157 19:01:13 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:57.157 1+0 records in 00:02:57.157 1+0 records out 00:02:57.157 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00198729 s, 528 MB/s 00:02:57.157 19:01:13 -- spdk/autotest.sh@116 -- # sync 00:02:57.157 19:01:13 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:57.157 19:01:13 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:57.157 19:01:13 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:57.157 19:01:15 -- spdk/autotest.sh@122 -- # uname -s 00:02:57.157 19:01:15 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:57.157 19:01:15 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:57.157 19:01:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:57.157 19:01:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:57.157 19:01:15 -- common/autotest_common.sh@10 -- # set +x 00:02:57.157 ************************************ 00:02:57.157 START TEST setup.sh 00:02:57.157 ************************************ 00:02:57.157 19:01:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:57.157 * Looking for test storage... 00:02:57.157 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:57.157 19:01:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:57.157 19:01:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:57.157 19:01:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:57.157 19:01:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:57.157 19:01:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:57.157 19:01:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:57.157 19:01:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:57.157 19:01:15 -- scripts/common.sh@335 -- # IFS=.-: 00:02:57.158 19:01:15 -- scripts/common.sh@335 -- # read -ra ver1 00:02:57.158 19:01:15 -- scripts/common.sh@336 -- # IFS=.-: 00:02:57.158 19:01:15 -- scripts/common.sh@336 -- # read -ra ver2 00:02:57.158 19:01:15 -- scripts/common.sh@337 -- # local 'op=<' 00:02:57.158 19:01:15 -- scripts/common.sh@339 -- # ver1_l=2 00:02:57.158 19:01:15 -- scripts/common.sh@340 -- # ver2_l=1 00:02:57.158 19:01:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:57.158 19:01:15 -- scripts/common.sh@343 -- # case "$op" in 00:02:57.158 19:01:15 -- scripts/common.sh@344 -- # : 1 00:02:57.158 19:01:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:57.158 19:01:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:57.158 19:01:15 -- scripts/common.sh@364 -- # decimal 1 00:02:57.158 19:01:15 -- scripts/common.sh@352 -- # local d=1 00:02:57.158 19:01:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:57.158 19:01:15 -- scripts/common.sh@354 -- # echo 1 00:02:57.158 19:01:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:57.158 19:01:15 -- scripts/common.sh@365 -- # decimal 2 00:02:57.158 19:01:15 -- scripts/common.sh@352 -- # local d=2 00:02:57.158 19:01:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:57.158 19:01:15 -- scripts/common.sh@354 -- # echo 2 00:02:57.158 19:01:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:57.158 19:01:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:57.158 19:01:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:57.158 19:01:15 -- scripts/common.sh@367 -- # return 0 00:02:57.158 19:01:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- setup/test-setup.sh@10 -- # uname -s 00:02:57.158 19:01:15 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:57.158 19:01:15 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:57.158 19:01:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:57.158 19:01:15 -- common/autotest_common.sh@10 -- # set +x 00:02:57.158 ************************************ 00:02:57.158 START TEST acl 00:02:57.158 ************************************ 00:02:57.158 19:01:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:57.158 * Looking for test storage... 00:02:57.158 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:57.158 19:01:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:57.158 19:01:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:57.158 19:01:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:57.158 19:01:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:57.158 19:01:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:57.158 19:01:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:57.158 19:01:15 -- scripts/common.sh@335 -- # IFS=.-: 00:02:57.158 19:01:15 -- scripts/common.sh@335 -- # read -ra ver1 00:02:57.158 19:01:15 -- scripts/common.sh@336 -- # IFS=.-: 00:02:57.158 19:01:15 -- scripts/common.sh@336 -- # read -ra ver2 00:02:57.158 19:01:15 -- scripts/common.sh@337 -- # local 'op=<' 00:02:57.158 19:01:15 -- scripts/common.sh@339 -- # ver1_l=2 00:02:57.158 19:01:15 -- scripts/common.sh@340 -- # ver2_l=1 00:02:57.158 19:01:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:57.158 19:01:15 -- scripts/common.sh@343 -- # case "$op" in 00:02:57.158 19:01:15 -- scripts/common.sh@344 -- # : 1 00:02:57.158 19:01:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:57.158 19:01:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:57.158 19:01:15 -- scripts/common.sh@364 -- # decimal 1 00:02:57.158 19:01:15 -- scripts/common.sh@352 -- # local d=1 00:02:57.158 19:01:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:57.158 19:01:15 -- scripts/common.sh@354 -- # echo 1 00:02:57.158 19:01:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:57.158 19:01:15 -- scripts/common.sh@365 -- # decimal 2 00:02:57.158 19:01:15 -- scripts/common.sh@352 -- # local d=2 00:02:57.158 19:01:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:57.158 19:01:15 -- scripts/common.sh@354 -- # echo 2 00:02:57.158 19:01:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:57.158 19:01:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:57.158 19:01:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:57.158 19:01:15 -- scripts/common.sh@367 -- # return 0 00:02:57.158 19:01:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:57.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:57.158 --rc genhtml_branch_coverage=1 00:02:57.158 --rc genhtml_function_coverage=1 00:02:57.158 --rc genhtml_legend=1 00:02:57.158 --rc geninfo_all_blocks=1 00:02:57.158 --rc geninfo_unexecuted_blocks=1 00:02:57.158 00:02:57.158 ' 00:02:57.158 19:01:15 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:57.158 19:01:15 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:57.158 19:01:15 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:57.158 19:01:15 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:57.158 19:01:15 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:57.158 19:01:15 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:57.158 19:01:15 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:57.158 19:01:15 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:57.158 19:01:15 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:57.158 19:01:15 -- setup/acl.sh@12 -- # devs=() 00:02:57.158 19:01:15 -- setup/acl.sh@12 -- # declare -a devs 00:02:57.158 19:01:15 -- setup/acl.sh@13 -- # drivers=() 00:02:57.158 19:01:15 -- setup/acl.sh@13 -- # declare -A drivers 00:02:57.158 19:01:15 -- setup/acl.sh@51 -- # setup reset 00:02:57.158 19:01:15 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:57.158 19:01:15 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:58.532 19:01:17 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:58.532 19:01:17 -- setup/acl.sh@16 -- # local dev driver 00:02:58.532 19:01:17 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:58.532 19:01:17 -- setup/acl.sh@15 -- # setup output status 00:02:58.532 19:01:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:58.532 19:01:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:59.906 Hugepages 00:02:59.906 node hugesize free / total 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 00:02:59.906 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.906 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.906 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.906 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:59.907 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.907 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.907 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.907 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:59.907 19:01:18 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:59.907 19:01:18 -- setup/acl.sh@20 -- # continue 00:02:59.907 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.907 19:01:18 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:02:59.907 19:01:18 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:59.907 19:01:18 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:02:59.907 19:01:18 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:59.907 19:01:18 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:59.907 19:01:18 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.907 19:01:18 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:59.907 19:01:18 -- setup/acl.sh@54 -- # run_test denied denied 00:02:59.907 19:01:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:59.907 19:01:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:59.907 19:01:18 -- common/autotest_common.sh@10 -- # set +x 00:02:59.907 ************************************ 00:02:59.907 START TEST denied 00:02:59.907 ************************************ 00:02:59.907 19:01:18 -- common/autotest_common.sh@1114 -- # denied 00:02:59.907 19:01:18 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:02:59.907 19:01:18 -- setup/acl.sh@38 -- # setup output config 00:02:59.907 19:01:18 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:02:59.907 19:01:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:59.907 19:01:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:01.281 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:01.281 19:01:19 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:01.281 19:01:19 -- setup/acl.sh@28 -- # local dev driver 00:03:01.281 19:01:19 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:01.282 19:01:19 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:01.282 19:01:19 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:01.282 19:01:19 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:01.282 19:01:19 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:01.282 19:01:19 -- setup/acl.sh@41 -- # setup reset 00:03:01.282 19:01:19 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.282 19:01:19 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.810 00:03:03.810 real 0m3.996s 00:03:03.810 user 0m1.174s 00:03:03.810 sys 0m1.936s 00:03:03.810 19:01:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:03.810 19:01:22 -- common/autotest_common.sh@10 -- # set +x 00:03:03.810 ************************************ 00:03:03.810 END TEST denied 00:03:03.810 ************************************ 00:03:03.810 19:01:22 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:03.810 19:01:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:03.810 19:01:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:03.810 19:01:22 -- common/autotest_common.sh@10 -- # set +x 00:03:03.810 ************************************ 00:03:03.810 START TEST allowed 00:03:03.810 ************************************ 00:03:03.810 19:01:22 -- common/autotest_common.sh@1114 -- # allowed 00:03:03.810 19:01:22 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:03.810 19:01:22 -- setup/acl.sh@45 -- # setup output config 00:03:03.810 19:01:22 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:03.810 19:01:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.810 19:01:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:06.336 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:06.336 19:01:24 -- setup/acl.sh@47 -- # verify 00:03:06.336 19:01:24 -- setup/acl.sh@28 -- # local dev driver 00:03:06.336 19:01:24 -- setup/acl.sh@48 -- # setup reset 00:03:06.336 19:01:24 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:06.336 19:01:24 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.709 00:03:07.709 real 0m4.033s 00:03:07.709 user 0m1.020s 00:03:07.709 sys 0m1.862s 00:03:07.709 19:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.709 19:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:07.709 ************************************ 00:03:07.709 END TEST allowed 00:03:07.709 ************************************ 00:03:07.709 00:03:07.709 real 0m10.730s 00:03:07.709 user 0m3.286s 00:03:07.709 sys 0m5.492s 00:03:07.709 19:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:07.709 19:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:07.709 ************************************ 00:03:07.709 END TEST acl 00:03:07.709 ************************************ 00:03:07.709 19:01:26 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:07.709 19:01:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:07.710 19:01:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:07.710 19:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:07.969 ************************************ 00:03:07.969 START TEST hugepages 00:03:07.969 ************************************ 00:03:07.969 19:01:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:07.969 * Looking for test storage... 00:03:07.969 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:07.969 19:01:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:07.969 19:01:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:07.969 19:01:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:07.969 19:01:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:07.969 19:01:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:07.969 19:01:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:07.969 19:01:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:07.969 19:01:26 -- scripts/common.sh@335 -- # IFS=.-: 00:03:07.969 19:01:26 -- scripts/common.sh@335 -- # read -ra ver1 00:03:07.969 19:01:26 -- scripts/common.sh@336 -- # IFS=.-: 00:03:07.969 19:01:26 -- scripts/common.sh@336 -- # read -ra ver2 00:03:07.969 19:01:26 -- scripts/common.sh@337 -- # local 'op=<' 00:03:07.969 19:01:26 -- scripts/common.sh@339 -- # ver1_l=2 00:03:07.969 19:01:26 -- scripts/common.sh@340 -- # ver2_l=1 00:03:07.969 19:01:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:07.969 19:01:26 -- scripts/common.sh@343 -- # case "$op" in 00:03:07.969 19:01:26 -- scripts/common.sh@344 -- # : 1 00:03:07.969 19:01:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:07.969 19:01:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:07.969 19:01:26 -- scripts/common.sh@364 -- # decimal 1 00:03:07.969 19:01:26 -- scripts/common.sh@352 -- # local d=1 00:03:07.969 19:01:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:07.969 19:01:26 -- scripts/common.sh@354 -- # echo 1 00:03:07.969 19:01:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:07.969 19:01:26 -- scripts/common.sh@365 -- # decimal 2 00:03:07.969 19:01:26 -- scripts/common.sh@352 -- # local d=2 00:03:07.969 19:01:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:07.969 19:01:26 -- scripts/common.sh@354 -- # echo 2 00:03:07.969 19:01:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:07.969 19:01:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:07.969 19:01:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:07.969 19:01:26 -- scripts/common.sh@367 -- # return 0 00:03:07.969 19:01:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:07.969 19:01:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:07.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:07.969 --rc genhtml_branch_coverage=1 00:03:07.969 --rc genhtml_function_coverage=1 00:03:07.969 --rc genhtml_legend=1 00:03:07.969 --rc geninfo_all_blocks=1 00:03:07.969 --rc geninfo_unexecuted_blocks=1 00:03:07.969 00:03:07.969 ' 00:03:07.969 19:01:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:07.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:07.969 --rc genhtml_branch_coverage=1 00:03:07.969 --rc genhtml_function_coverage=1 00:03:07.969 --rc genhtml_legend=1 00:03:07.969 --rc geninfo_all_blocks=1 00:03:07.969 --rc geninfo_unexecuted_blocks=1 00:03:07.969 00:03:07.969 ' 00:03:07.969 19:01:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:07.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:07.969 --rc genhtml_branch_coverage=1 00:03:07.969 --rc genhtml_function_coverage=1 00:03:07.969 --rc genhtml_legend=1 00:03:07.969 --rc geninfo_all_blocks=1 00:03:07.969 --rc geninfo_unexecuted_blocks=1 00:03:07.969 00:03:07.969 ' 00:03:07.969 19:01:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:07.969 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:07.969 --rc genhtml_branch_coverage=1 00:03:07.969 --rc genhtml_function_coverage=1 00:03:07.969 --rc genhtml_legend=1 00:03:07.969 --rc geninfo_all_blocks=1 00:03:07.969 --rc geninfo_unexecuted_blocks=1 00:03:07.969 00:03:07.969 ' 00:03:07.969 19:01:26 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:07.969 19:01:26 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:07.969 19:01:26 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:07.969 19:01:26 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:07.969 19:01:26 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:07.969 19:01:26 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:07.969 19:01:26 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:07.969 19:01:26 -- setup/common.sh@18 -- # local node= 00:03:07.969 19:01:26 -- setup/common.sh@19 -- # local var val 00:03:07.969 19:01:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.969 19:01:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.969 19:01:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.969 19:01:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.969 19:01:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.969 19:01:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43204136 kB' 'MemAvailable: 46950964 kB' 'Buffers: 2708 kB' 'Cached: 10648648 kB' 'SwapCached: 0 kB' 'Active: 7352636 kB' 'Inactive: 3753392 kB' 'Active(anon): 6955888 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458424 kB' 'Mapped: 166384 kB' 'Shmem: 6501216 kB' 'KReclaimable: 181020 kB' 'Slab: 687560 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506540 kB' 'KernelStack: 12816 kB' 'PageTables: 8008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 8020428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198168 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.969 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.969 19:01:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # continue 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.970 19:01:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.970 19:01:26 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.970 19:01:26 -- setup/common.sh@33 -- # echo 2048 00:03:07.970 19:01:26 -- setup/common.sh@33 -- # return 0 00:03:07.970 19:01:26 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:07.970 19:01:26 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:07.970 19:01:26 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:07.970 19:01:26 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:07.970 19:01:26 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:07.970 19:01:26 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:07.970 19:01:26 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:07.970 19:01:26 -- setup/hugepages.sh@207 -- # get_nodes 00:03:07.970 19:01:26 -- setup/hugepages.sh@27 -- # local node 00:03:07.971 19:01:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.971 19:01:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:07.971 19:01:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.971 19:01:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:07.971 19:01:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:07.971 19:01:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:07.971 19:01:26 -- setup/hugepages.sh@208 -- # clear_hp 00:03:07.971 19:01:26 -- setup/hugepages.sh@37 -- # local node hp 00:03:07.971 19:01:26 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:07.971 19:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.971 19:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.971 19:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:07.971 19:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.971 19:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.971 19:01:26 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:07.971 19:01:26 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:07.971 19:01:26 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:07.971 19:01:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:07.971 19:01:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:07.971 19:01:26 -- common/autotest_common.sh@10 -- # set +x 00:03:07.971 ************************************ 00:03:07.971 START TEST default_setup 00:03:07.971 ************************************ 00:03:07.971 19:01:26 -- common/autotest_common.sh@1114 -- # default_setup 00:03:07.971 19:01:26 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:07.971 19:01:26 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:07.971 19:01:26 -- setup/hugepages.sh@51 -- # shift 00:03:07.971 19:01:26 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:07.971 19:01:26 -- setup/hugepages.sh@52 -- # local node_ids 00:03:07.971 19:01:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:07.971 19:01:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:07.971 19:01:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:07.971 19:01:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:07.971 19:01:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:07.971 19:01:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:07.971 19:01:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:07.971 19:01:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:07.971 19:01:26 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:07.971 19:01:26 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:07.971 19:01:26 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:07.971 19:01:26 -- setup/hugepages.sh@73 -- # return 0 00:03:07.971 19:01:26 -- setup/hugepages.sh@137 -- # setup output 00:03:07.971 19:01:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.971 19:01:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:09.344 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:09.344 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:09.344 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:10.281 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:10.281 19:01:28 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:10.281 19:01:28 -- setup/hugepages.sh@89 -- # local node 00:03:10.281 19:01:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:10.281 19:01:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:10.281 19:01:28 -- setup/hugepages.sh@92 -- # local surp 00:03:10.281 19:01:28 -- setup/hugepages.sh@93 -- # local resv 00:03:10.281 19:01:28 -- setup/hugepages.sh@94 -- # local anon 00:03:10.281 19:01:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:10.281 19:01:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:10.281 19:01:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:10.281 19:01:28 -- setup/common.sh@18 -- # local node= 00:03:10.281 19:01:28 -- setup/common.sh@19 -- # local var val 00:03:10.281 19:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.281 19:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.281 19:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.281 19:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.281 19:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.281 19:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45342776 kB' 'MemAvailable: 49089604 kB' 'Buffers: 2708 kB' 'Cached: 10648720 kB' 'SwapCached: 0 kB' 'Active: 7355572 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958824 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460780 kB' 'Mapped: 165936 kB' 'Shmem: 6501288 kB' 'KReclaimable: 181020 kB' 'Slab: 687472 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506452 kB' 'KernelStack: 12752 kB' 'PageTables: 8136 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8025920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.281 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.281 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.282 19:01:28 -- setup/common.sh@33 -- # echo 0 00:03:10.282 19:01:28 -- setup/common.sh@33 -- # return 0 00:03:10.282 19:01:28 -- setup/hugepages.sh@97 -- # anon=0 00:03:10.282 19:01:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:10.282 19:01:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.282 19:01:28 -- setup/common.sh@18 -- # local node= 00:03:10.282 19:01:28 -- setup/common.sh@19 -- # local var val 00:03:10.282 19:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.282 19:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.282 19:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.282 19:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.282 19:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.282 19:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45352696 kB' 'MemAvailable: 49099524 kB' 'Buffers: 2708 kB' 'Cached: 10648724 kB' 'SwapCached: 0 kB' 'Active: 7354292 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957544 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459588 kB' 'Mapped: 165836 kB' 'Shmem: 6501292 kB' 'KReclaimable: 181020 kB' 'Slab: 687788 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506768 kB' 'KernelStack: 12736 kB' 'PageTables: 7720 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8025932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.282 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.282 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.283 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.283 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.283 19:01:28 -- setup/common.sh@33 -- # echo 0 00:03:10.283 19:01:28 -- setup/common.sh@33 -- # return 0 00:03:10.283 19:01:28 -- setup/hugepages.sh@99 -- # surp=0 00:03:10.283 19:01:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:10.283 19:01:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:10.283 19:01:28 -- setup/common.sh@18 -- # local node= 00:03:10.283 19:01:28 -- setup/common.sh@19 -- # local var val 00:03:10.283 19:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.283 19:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.283 19:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.283 19:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.283 19:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.284 19:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45352940 kB' 'MemAvailable: 49099768 kB' 'Buffers: 2708 kB' 'Cached: 10648736 kB' 'SwapCached: 0 kB' 'Active: 7354348 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957600 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459604 kB' 'Mapped: 165836 kB' 'Shmem: 6501304 kB' 'KReclaimable: 181020 kB' 'Slab: 687852 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506832 kB' 'KernelStack: 12736 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8025948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.284 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.284 19:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.285 19:01:28 -- setup/common.sh@33 -- # echo 0 00:03:10.285 19:01:28 -- setup/common.sh@33 -- # return 0 00:03:10.285 19:01:28 -- setup/hugepages.sh@100 -- # resv=0 00:03:10.285 19:01:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:10.285 nr_hugepages=1024 00:03:10.285 19:01:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:10.285 resv_hugepages=0 00:03:10.285 19:01:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:10.285 surplus_hugepages=0 00:03:10.285 19:01:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:10.285 anon_hugepages=0 00:03:10.285 19:01:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.285 19:01:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:10.285 19:01:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:10.285 19:01:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:10.285 19:01:28 -- setup/common.sh@18 -- # local node= 00:03:10.285 19:01:28 -- setup/common.sh@19 -- # local var val 00:03:10.285 19:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.285 19:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.285 19:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.285 19:01:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.285 19:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.285 19:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45353716 kB' 'MemAvailable: 49100544 kB' 'Buffers: 2708 kB' 'Cached: 10648748 kB' 'SwapCached: 0 kB' 'Active: 7354256 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957508 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459504 kB' 'Mapped: 165836 kB' 'Shmem: 6501316 kB' 'KReclaimable: 181020 kB' 'Slab: 687852 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506832 kB' 'KernelStack: 12720 kB' 'PageTables: 7692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8025964 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.285 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.285 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.286 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.286 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.287 19:01:28 -- setup/common.sh@33 -- # echo 1024 00:03:10.287 19:01:28 -- setup/common.sh@33 -- # return 0 00:03:10.287 19:01:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.287 19:01:28 -- setup/hugepages.sh@112 -- # get_nodes 00:03:10.287 19:01:28 -- setup/hugepages.sh@27 -- # local node 00:03:10.287 19:01:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.287 19:01:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:10.287 19:01:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.287 19:01:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:10.287 19:01:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:10.287 19:01:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:10.287 19:01:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:10.287 19:01:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:10.287 19:01:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:10.287 19:01:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.287 19:01:28 -- setup/common.sh@18 -- # local node=0 00:03:10.287 19:01:28 -- setup/common.sh@19 -- # local var val 00:03:10.287 19:01:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.287 19:01:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.287 19:01:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:10.287 19:01:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:10.287 19:01:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.287 19:01:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20113732 kB' 'MemUsed: 12761192 kB' 'SwapCached: 0 kB' 'Active: 5787296 kB' 'Inactive: 3591304 kB' 'Active(anon): 5596364 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026584 kB' 'Mapped: 55216 kB' 'AnonPages: 355188 kB' 'Shmem: 5244348 kB' 'KernelStack: 8360 kB' 'PageTables: 5280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394708 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297732 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.287 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.287 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.288 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.288 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # continue 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.546 19:01:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.546 19:01:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.546 19:01:28 -- setup/common.sh@33 -- # echo 0 00:03:10.546 19:01:28 -- setup/common.sh@33 -- # return 0 00:03:10.546 19:01:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:10.546 19:01:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:10.546 19:01:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:10.546 19:01:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:10.546 19:01:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:10.546 node0=1024 expecting 1024 00:03:10.546 19:01:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:10.546 00:03:10.546 real 0m2.376s 00:03:10.546 user 0m0.618s 00:03:10.546 sys 0m0.886s 00:03:10.546 19:01:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:10.546 19:01:28 -- common/autotest_common.sh@10 -- # set +x 00:03:10.546 ************************************ 00:03:10.546 END TEST default_setup 00:03:10.546 ************************************ 00:03:10.546 19:01:28 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:10.546 19:01:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.546 19:01:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.546 19:01:28 -- common/autotest_common.sh@10 -- # set +x 00:03:10.546 ************************************ 00:03:10.546 START TEST per_node_1G_alloc 00:03:10.546 ************************************ 00:03:10.546 19:01:28 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:10.546 19:01:28 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:10.546 19:01:28 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:10.546 19:01:28 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:10.546 19:01:28 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:10.546 19:01:28 -- setup/hugepages.sh@51 -- # shift 00:03:10.546 19:01:28 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:10.546 19:01:28 -- setup/hugepages.sh@52 -- # local node_ids 00:03:10.546 19:01:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.546 19:01:28 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:10.546 19:01:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:10.546 19:01:28 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:10.546 19:01:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.546 19:01:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:10.546 19:01:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.546 19:01:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.546 19:01:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.546 19:01:28 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:10.546 19:01:28 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.546 19:01:28 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.546 19:01:28 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.546 19:01:28 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.546 19:01:28 -- setup/hugepages.sh@73 -- # return 0 00:03:10.546 19:01:28 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:10.546 19:01:28 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:10.546 19:01:28 -- setup/hugepages.sh@146 -- # setup output 00:03:10.546 19:01:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.546 19:01:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:11.480 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:11.480 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:11.480 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:11.481 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:11.481 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:11.481 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:11.481 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:11.481 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:11.481 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:11.481 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:11.481 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:11.481 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:11.481 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:11.481 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:11.481 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:11.741 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:11.741 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:11.741 19:01:30 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:11.741 19:01:30 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:11.741 19:01:30 -- setup/hugepages.sh@89 -- # local node 00:03:11.741 19:01:30 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:11.741 19:01:30 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:11.741 19:01:30 -- setup/hugepages.sh@92 -- # local surp 00:03:11.741 19:01:30 -- setup/hugepages.sh@93 -- # local resv 00:03:11.741 19:01:30 -- setup/hugepages.sh@94 -- # local anon 00:03:11.741 19:01:30 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:11.741 19:01:30 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:11.741 19:01:30 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:11.741 19:01:30 -- setup/common.sh@18 -- # local node= 00:03:11.741 19:01:30 -- setup/common.sh@19 -- # local var val 00:03:11.741 19:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.741 19:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.741 19:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.741 19:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.741 19:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.741 19:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.741 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45363216 kB' 'MemAvailable: 49110044 kB' 'Buffers: 2708 kB' 'Cached: 10648804 kB' 'SwapCached: 0 kB' 'Active: 7355952 kB' 'Inactive: 3753392 kB' 'Active(anon): 6959204 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461300 kB' 'Mapped: 165864 kB' 'Shmem: 6501372 kB' 'KReclaimable: 181020 kB' 'Slab: 687744 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506724 kB' 'KernelStack: 12736 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.742 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.742 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.743 19:01:30 -- setup/common.sh@33 -- # echo 0 00:03:11.743 19:01:30 -- setup/common.sh@33 -- # return 0 00:03:11.743 19:01:30 -- setup/hugepages.sh@97 -- # anon=0 00:03:11.743 19:01:30 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:11.743 19:01:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:11.743 19:01:30 -- setup/common.sh@18 -- # local node= 00:03:11.743 19:01:30 -- setup/common.sh@19 -- # local var val 00:03:11.743 19:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.743 19:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.743 19:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.743 19:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.743 19:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.743 19:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45363696 kB' 'MemAvailable: 49110524 kB' 'Buffers: 2708 kB' 'Cached: 10648804 kB' 'SwapCached: 0 kB' 'Active: 7356188 kB' 'Inactive: 3753392 kB' 'Active(anon): 6959440 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 461600 kB' 'Mapped: 165864 kB' 'Shmem: 6501372 kB' 'KReclaimable: 181020 kB' 'Slab: 687784 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506764 kB' 'KernelStack: 12736 kB' 'PageTables: 7752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 19:01:30 -- setup/common.sh@33 -- # echo 0 00:03:11.744 19:01:30 -- setup/common.sh@33 -- # return 0 00:03:11.744 19:01:30 -- setup/hugepages.sh@99 -- # surp=0 00:03:11.744 19:01:30 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:11.744 19:01:30 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:11.744 19:01:30 -- setup/common.sh@18 -- # local node= 00:03:11.744 19:01:30 -- setup/common.sh@19 -- # local var val 00:03:11.744 19:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.744 19:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.744 19:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.744 19:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.744 19:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.744 19:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45363820 kB' 'MemAvailable: 49110648 kB' 'Buffers: 2708 kB' 'Cached: 10648816 kB' 'SwapCached: 0 kB' 'Active: 7355644 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958896 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460960 kB' 'Mapped: 165840 kB' 'Shmem: 6501384 kB' 'KReclaimable: 181020 kB' 'Slab: 687852 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506832 kB' 'KernelStack: 12752 kB' 'PageTables: 7792 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.744 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.745 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.745 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.745 19:01:30 -- setup/common.sh@33 -- # echo 0 00:03:11.745 19:01:30 -- setup/common.sh@33 -- # return 0 00:03:11.745 19:01:30 -- setup/hugepages.sh@100 -- # resv=0 00:03:11.745 19:01:30 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:11.745 nr_hugepages=1024 00:03:11.745 19:01:30 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:11.745 resv_hugepages=0 00:03:11.745 19:01:30 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:11.745 surplus_hugepages=0 00:03:11.745 19:01:30 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:11.745 anon_hugepages=0 00:03:11.745 19:01:30 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:11.745 19:01:30 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:11.746 19:01:30 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:11.746 19:01:30 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:11.746 19:01:30 -- setup/common.sh@18 -- # local node= 00:03:11.746 19:01:30 -- setup/common.sh@19 -- # local var val 00:03:11.746 19:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.746 19:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.746 19:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.746 19:01:30 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.746 19:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.746 19:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45363064 kB' 'MemAvailable: 49109892 kB' 'Buffers: 2708 kB' 'Cached: 10648832 kB' 'SwapCached: 0 kB' 'Active: 7355600 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958852 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460884 kB' 'Mapped: 165840 kB' 'Shmem: 6501400 kB' 'KReclaimable: 181020 kB' 'Slab: 687820 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506800 kB' 'KernelStack: 12784 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.746 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.746 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # continue 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.747 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.747 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.747 19:01:30 -- setup/common.sh@33 -- # echo 1024 00:03:11.747 19:01:30 -- setup/common.sh@33 -- # return 0 00:03:12.006 19:01:30 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:12.006 19:01:30 -- setup/hugepages.sh@112 -- # get_nodes 00:03:12.006 19:01:30 -- setup/hugepages.sh@27 -- # local node 00:03:12.006 19:01:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.006 19:01:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:12.006 19:01:30 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.006 19:01:30 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:12.006 19:01:30 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:12.006 19:01:30 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:12.006 19:01:30 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:12.006 19:01:30 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:12.006 19:01:30 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:12.006 19:01:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.006 19:01:30 -- setup/common.sh@18 -- # local node=0 00:03:12.006 19:01:30 -- setup/common.sh@19 -- # local var val 00:03:12.006 19:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.006 19:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.006 19:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:12.006 19:01:30 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:12.006 19:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.006 19:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21171576 kB' 'MemUsed: 11703348 kB' 'SwapCached: 0 kB' 'Active: 5787712 kB' 'Inactive: 3591304 kB' 'Active(anon): 5596780 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026596 kB' 'Mapped: 55216 kB' 'AnonPages: 355620 kB' 'Shmem: 5244360 kB' 'KernelStack: 8376 kB' 'PageTables: 5324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394608 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297632 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.006 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.006 19:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@33 -- # echo 0 00:03:12.007 19:01:30 -- setup/common.sh@33 -- # return 0 00:03:12.007 19:01:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:12.007 19:01:30 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:12.007 19:01:30 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:12.007 19:01:30 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:12.007 19:01:30 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.007 19:01:30 -- setup/common.sh@18 -- # local node=1 00:03:12.007 19:01:30 -- setup/common.sh@19 -- # local var val 00:03:12.007 19:01:30 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.007 19:01:30 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.007 19:01:30 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:12.007 19:01:30 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:12.007 19:01:30 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.007 19:01:30 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 24190760 kB' 'MemUsed: 3469980 kB' 'SwapCached: 0 kB' 'Active: 1567756 kB' 'Inactive: 162088 kB' 'Active(anon): 1361940 kB' 'Inactive(anon): 0 kB' 'Active(file): 205816 kB' 'Inactive(file): 162088 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1624972 kB' 'Mapped: 110624 kB' 'AnonPages: 105036 kB' 'Shmem: 1257068 kB' 'KernelStack: 4408 kB' 'PageTables: 2520 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84044 kB' 'Slab: 293212 kB' 'SReclaimable: 84044 kB' 'SUnreclaim: 209168 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.007 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.007 19:01:30 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # continue 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.008 19:01:30 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.008 19:01:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.008 19:01:30 -- setup/common.sh@33 -- # echo 0 00:03:12.008 19:01:30 -- setup/common.sh@33 -- # return 0 00:03:12.008 19:01:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:12.008 19:01:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:12.008 19:01:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:12.008 19:01:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:12.008 19:01:30 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:12.008 node0=512 expecting 512 00:03:12.008 19:01:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:12.008 19:01:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:12.008 19:01:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:12.008 19:01:30 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:12.008 node1=512 expecting 512 00:03:12.008 19:01:30 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:12.008 00:03:12.008 real 0m1.481s 00:03:12.008 user 0m0.594s 00:03:12.008 sys 0m0.853s 00:03:12.008 19:01:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:12.008 19:01:30 -- common/autotest_common.sh@10 -- # set +x 00:03:12.008 ************************************ 00:03:12.008 END TEST per_node_1G_alloc 00:03:12.008 ************************************ 00:03:12.008 19:01:30 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:12.008 19:01:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.008 19:01:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.008 19:01:30 -- common/autotest_common.sh@10 -- # set +x 00:03:12.008 ************************************ 00:03:12.008 START TEST even_2G_alloc 00:03:12.008 ************************************ 00:03:12.008 19:01:30 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:12.008 19:01:30 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:12.009 19:01:30 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:12.009 19:01:30 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:12.009 19:01:30 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:12.009 19:01:30 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:12.009 19:01:30 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:12.009 19:01:30 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:12.009 19:01:30 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:12.009 19:01:30 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:12.009 19:01:30 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:12.009 19:01:30 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:12.009 19:01:30 -- setup/hugepages.sh@83 -- # : 512 00:03:12.009 19:01:30 -- setup/hugepages.sh@84 -- # : 1 00:03:12.009 19:01:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:12.009 19:01:30 -- setup/hugepages.sh@83 -- # : 0 00:03:12.009 19:01:30 -- setup/hugepages.sh@84 -- # : 0 00:03:12.009 19:01:30 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.009 19:01:30 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:12.009 19:01:30 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:12.009 19:01:30 -- setup/hugepages.sh@153 -- # setup output 00:03:12.009 19:01:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.009 19:01:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:13.387 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:13.387 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:13.387 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:13.387 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:13.387 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:13.387 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:13.387 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:13.387 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:13.387 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:13.387 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:13.387 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:13.387 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:13.387 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:13.387 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:13.387 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:13.387 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:13.387 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:13.387 19:01:31 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:13.387 19:01:31 -- setup/hugepages.sh@89 -- # local node 00:03:13.388 19:01:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:13.388 19:01:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:13.388 19:01:31 -- setup/hugepages.sh@92 -- # local surp 00:03:13.388 19:01:31 -- setup/hugepages.sh@93 -- # local resv 00:03:13.388 19:01:31 -- setup/hugepages.sh@94 -- # local anon 00:03:13.388 19:01:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:13.388 19:01:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:13.388 19:01:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:13.388 19:01:31 -- setup/common.sh@18 -- # local node= 00:03:13.388 19:01:31 -- setup/common.sh@19 -- # local var val 00:03:13.388 19:01:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.388 19:01:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.388 19:01:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.388 19:01:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.388 19:01:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.388 19:01:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45364728 kB' 'MemAvailable: 49111556 kB' 'Buffers: 2708 kB' 'Cached: 10648900 kB' 'SwapCached: 0 kB' 'Active: 7354140 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957392 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459184 kB' 'Mapped: 165884 kB' 'Shmem: 6501468 kB' 'KReclaimable: 181020 kB' 'Slab: 687644 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506624 kB' 'KernelStack: 12800 kB' 'PageTables: 7836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.388 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.388 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.389 19:01:31 -- setup/common.sh@33 -- # echo 0 00:03:13.389 19:01:31 -- setup/common.sh@33 -- # return 0 00:03:13.389 19:01:31 -- setup/hugepages.sh@97 -- # anon=0 00:03:13.389 19:01:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:13.389 19:01:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.389 19:01:31 -- setup/common.sh@18 -- # local node= 00:03:13.389 19:01:31 -- setup/common.sh@19 -- # local var val 00:03:13.389 19:01:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.389 19:01:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.389 19:01:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.389 19:01:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.389 19:01:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.389 19:01:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45367096 kB' 'MemAvailable: 49113924 kB' 'Buffers: 2708 kB' 'Cached: 10648904 kB' 'SwapCached: 0 kB' 'Active: 7354160 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957412 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459220 kB' 'Mapped: 165888 kB' 'Shmem: 6501472 kB' 'KReclaimable: 181020 kB' 'Slab: 687644 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506624 kB' 'KernelStack: 12784 kB' 'PageTables: 7796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.389 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.389 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.390 19:01:31 -- setup/common.sh@33 -- # echo 0 00:03:13.390 19:01:31 -- setup/common.sh@33 -- # return 0 00:03:13.390 19:01:31 -- setup/hugepages.sh@99 -- # surp=0 00:03:13.390 19:01:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:13.390 19:01:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:13.390 19:01:31 -- setup/common.sh@18 -- # local node= 00:03:13.390 19:01:31 -- setup/common.sh@19 -- # local var val 00:03:13.390 19:01:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.390 19:01:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.390 19:01:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.390 19:01:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.390 19:01:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.390 19:01:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45367992 kB' 'MemAvailable: 49114820 kB' 'Buffers: 2708 kB' 'Cached: 10648912 kB' 'SwapCached: 0 kB' 'Active: 7353964 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957216 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458988 kB' 'Mapped: 165888 kB' 'Shmem: 6501480 kB' 'KReclaimable: 181020 kB' 'Slab: 687712 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506692 kB' 'KernelStack: 12784 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.390 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.390 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.391 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.391 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.392 19:01:31 -- setup/common.sh@33 -- # echo 0 00:03:13.392 19:01:31 -- setup/common.sh@33 -- # return 0 00:03:13.392 19:01:31 -- setup/hugepages.sh@100 -- # resv=0 00:03:13.392 19:01:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:13.392 nr_hugepages=1024 00:03:13.392 19:01:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:13.392 resv_hugepages=0 00:03:13.392 19:01:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:13.392 surplus_hugepages=0 00:03:13.392 19:01:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:13.392 anon_hugepages=0 00:03:13.392 19:01:31 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.392 19:01:31 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:13.392 19:01:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:13.392 19:01:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:13.392 19:01:31 -- setup/common.sh@18 -- # local node= 00:03:13.392 19:01:31 -- setup/common.sh@19 -- # local var val 00:03:13.392 19:01:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.392 19:01:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.392 19:01:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.392 19:01:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.392 19:01:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.392 19:01:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45367992 kB' 'MemAvailable: 49114820 kB' 'Buffers: 2708 kB' 'Cached: 10648928 kB' 'SwapCached: 0 kB' 'Active: 7353988 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957240 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458992 kB' 'Mapped: 165888 kB' 'Shmem: 6501496 kB' 'KReclaimable: 181020 kB' 'Slab: 687712 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506692 kB' 'KernelStack: 12784 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8026272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.392 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.392 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.393 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.393 19:01:31 -- setup/common.sh@33 -- # echo 1024 00:03:13.393 19:01:31 -- setup/common.sh@33 -- # return 0 00:03:13.393 19:01:31 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.393 19:01:31 -- setup/hugepages.sh@112 -- # get_nodes 00:03:13.393 19:01:31 -- setup/hugepages.sh@27 -- # local node 00:03:13.393 19:01:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.393 19:01:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:13.393 19:01:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.393 19:01:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:13.393 19:01:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:13.393 19:01:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:13.393 19:01:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.393 19:01:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.393 19:01:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:13.393 19:01:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.393 19:01:31 -- setup/common.sh@18 -- # local node=0 00:03:13.393 19:01:31 -- setup/common.sh@19 -- # local var val 00:03:13.393 19:01:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.393 19:01:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.393 19:01:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:13.393 19:01:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:13.393 19:01:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.393 19:01:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.393 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21181956 kB' 'MemUsed: 11692968 kB' 'SwapCached: 0 kB' 'Active: 5788608 kB' 'Inactive: 3591304 kB' 'Active(anon): 5597676 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026600 kB' 'Mapped: 55216 kB' 'AnonPages: 356504 kB' 'Shmem: 5244364 kB' 'KernelStack: 8360 kB' 'PageTables: 5276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394532 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297556 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.394 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.394 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.394 19:01:31 -- setup/common.sh@33 -- # echo 0 00:03:13.394 19:01:31 -- setup/common.sh@33 -- # return 0 00:03:13.394 19:01:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.394 19:01:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.394 19:01:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.394 19:01:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:13.394 19:01:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.394 19:01:31 -- setup/common.sh@18 -- # local node=1 00:03:13.394 19:01:31 -- setup/common.sh@19 -- # local var val 00:03:13.394 19:01:31 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.394 19:01:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.394 19:01:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:13.394 19:01:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:13.394 19:01:31 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.395 19:01:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 24187220 kB' 'MemUsed: 3473520 kB' 'SwapCached: 0 kB' 'Active: 1566536 kB' 'Inactive: 162088 kB' 'Active(anon): 1360720 kB' 'Inactive(anon): 0 kB' 'Active(file): 205816 kB' 'Inactive(file): 162088 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1625064 kB' 'Mapped: 111108 kB' 'AnonPages: 103716 kB' 'Shmem: 1257160 kB' 'KernelStack: 4424 kB' 'PageTables: 2524 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84044 kB' 'Slab: 293180 kB' 'SReclaimable: 84044 kB' 'SUnreclaim: 209136 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # continue 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.395 19:01:31 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.395 19:01:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.396 19:01:31 -- setup/common.sh@33 -- # echo 0 00:03:13.396 19:01:31 -- setup/common.sh@33 -- # return 0 00:03:13.396 19:01:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.396 19:01:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.396 19:01:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.396 19:01:31 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:13.396 node0=512 expecting 512 00:03:13.396 19:01:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.396 19:01:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.396 19:01:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.396 19:01:31 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:13.396 node1=512 expecting 512 00:03:13.396 19:01:31 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:13.396 00:03:13.396 real 0m1.471s 00:03:13.396 user 0m0.573s 00:03:13.396 sys 0m0.864s 00:03:13.396 19:01:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.396 19:01:31 -- common/autotest_common.sh@10 -- # set +x 00:03:13.396 ************************************ 00:03:13.396 END TEST even_2G_alloc 00:03:13.396 ************************************ 00:03:13.396 19:01:31 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:13.396 19:01:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.396 19:01:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.396 19:01:31 -- common/autotest_common.sh@10 -- # set +x 00:03:13.396 ************************************ 00:03:13.396 START TEST odd_alloc 00:03:13.396 ************************************ 00:03:13.396 19:01:31 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:13.396 19:01:31 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:13.396 19:01:31 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:13.396 19:01:31 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:13.396 19:01:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:13.396 19:01:31 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:13.396 19:01:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:13.396 19:01:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:13.396 19:01:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:13.396 19:01:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:13.396 19:01:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:13.396 19:01:31 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:13.396 19:01:31 -- setup/hugepages.sh@83 -- # : 513 00:03:13.396 19:01:31 -- setup/hugepages.sh@84 -- # : 1 00:03:13.396 19:01:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:13.396 19:01:31 -- setup/hugepages.sh@83 -- # : 0 00:03:13.396 19:01:31 -- setup/hugepages.sh@84 -- # : 0 00:03:13.396 19:01:31 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.396 19:01:31 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:13.396 19:01:31 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:13.396 19:01:31 -- setup/hugepages.sh@160 -- # setup output 00:03:13.396 19:01:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.396 19:01:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.780 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:14.780 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.780 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.780 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.780 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.780 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.780 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.780 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.780 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.780 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.780 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.780 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.780 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.780 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.780 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.780 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.780 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.780 19:01:33 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:14.780 19:01:33 -- setup/hugepages.sh@89 -- # local node 00:03:14.780 19:01:33 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.780 19:01:33 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.780 19:01:33 -- setup/hugepages.sh@92 -- # local surp 00:03:14.780 19:01:33 -- setup/hugepages.sh@93 -- # local resv 00:03:14.780 19:01:33 -- setup/hugepages.sh@94 -- # local anon 00:03:14.780 19:01:33 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.780 19:01:33 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.780 19:01:33 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.780 19:01:33 -- setup/common.sh@18 -- # local node= 00:03:14.780 19:01:33 -- setup/common.sh@19 -- # local var val 00:03:14.780 19:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.780 19:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.780 19:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.780 19:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.780 19:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.780 19:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.780 19:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45358604 kB' 'MemAvailable: 49105432 kB' 'Buffers: 2708 kB' 'Cached: 10648992 kB' 'SwapCached: 0 kB' 'Active: 7355172 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958424 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460208 kB' 'Mapped: 164800 kB' 'Shmem: 6501560 kB' 'KReclaimable: 181020 kB' 'Slab: 687580 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506560 kB' 'KernelStack: 13104 kB' 'PageTables: 9312 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8018552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198488 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.780 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.780 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.781 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.781 19:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.781 19:01:33 -- setup/common.sh@33 -- # echo 0 00:03:14.781 19:01:33 -- setup/common.sh@33 -- # return 0 00:03:14.781 19:01:33 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.782 19:01:33 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.782 19:01:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.782 19:01:33 -- setup/common.sh@18 -- # local node= 00:03:14.782 19:01:33 -- setup/common.sh@19 -- # local var val 00:03:14.782 19:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.782 19:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.782 19:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.782 19:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.782 19:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.782 19:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45359012 kB' 'MemAvailable: 49105840 kB' 'Buffers: 2708 kB' 'Cached: 10649000 kB' 'SwapCached: 0 kB' 'Active: 7355380 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958632 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460156 kB' 'Mapped: 164800 kB' 'Shmem: 6501568 kB' 'KReclaimable: 181020 kB' 'Slab: 687568 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506548 kB' 'KernelStack: 13200 kB' 'PageTables: 8884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8018568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198584 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.782 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.782 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.783 19:01:33 -- setup/common.sh@33 -- # echo 0 00:03:14.783 19:01:33 -- setup/common.sh@33 -- # return 0 00:03:14.783 19:01:33 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.783 19:01:33 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.783 19:01:33 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.783 19:01:33 -- setup/common.sh@18 -- # local node= 00:03:14.783 19:01:33 -- setup/common.sh@19 -- # local var val 00:03:14.783 19:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.783 19:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.783 19:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.783 19:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.783 19:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.783 19:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45356980 kB' 'MemAvailable: 49103808 kB' 'Buffers: 2708 kB' 'Cached: 10649008 kB' 'SwapCached: 0 kB' 'Active: 7355020 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958272 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459780 kB' 'Mapped: 164784 kB' 'Shmem: 6501576 kB' 'KReclaimable: 181020 kB' 'Slab: 687560 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506540 kB' 'KernelStack: 13168 kB' 'PageTables: 9248 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8018584 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198680 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.783 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.783 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.784 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.784 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.784 19:01:33 -- setup/common.sh@33 -- # echo 0 00:03:14.784 19:01:33 -- setup/common.sh@33 -- # return 0 00:03:14.784 19:01:33 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.784 19:01:33 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:14.784 nr_hugepages=1025 00:03:14.784 19:01:33 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.784 resv_hugepages=0 00:03:14.784 19:01:33 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.784 surplus_hugepages=0 00:03:14.784 19:01:33 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.784 anon_hugepages=0 00:03:14.784 19:01:33 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:14.784 19:01:33 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:14.784 19:01:33 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.784 19:01:33 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.784 19:01:33 -- setup/common.sh@18 -- # local node= 00:03:14.784 19:01:33 -- setup/common.sh@19 -- # local var val 00:03:14.785 19:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.785 19:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.785 19:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.785 19:01:33 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.785 19:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.785 19:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45359004 kB' 'MemAvailable: 49105832 kB' 'Buffers: 2708 kB' 'Cached: 10649012 kB' 'SwapCached: 0 kB' 'Active: 7353572 kB' 'Inactive: 3753392 kB' 'Active(anon): 6956824 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458524 kB' 'Mapped: 164692 kB' 'Shmem: 6501580 kB' 'KReclaimable: 181020 kB' 'Slab: 687584 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506564 kB' 'KernelStack: 12960 kB' 'PageTables: 8104 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 8014568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.785 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.785 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.786 19:01:33 -- setup/common.sh@33 -- # echo 1025 00:03:14.786 19:01:33 -- setup/common.sh@33 -- # return 0 00:03:14.786 19:01:33 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:14.786 19:01:33 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.786 19:01:33 -- setup/hugepages.sh@27 -- # local node 00:03:14.786 19:01:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.786 19:01:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.786 19:01:33 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.786 19:01:33 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:14.786 19:01:33 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.786 19:01:33 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.786 19:01:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.786 19:01:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.786 19:01:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.786 19:01:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.786 19:01:33 -- setup/common.sh@18 -- # local node=0 00:03:14.786 19:01:33 -- setup/common.sh@19 -- # local var val 00:03:14.786 19:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.786 19:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.786 19:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.786 19:01:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.786 19:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.786 19:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21179656 kB' 'MemUsed: 11695268 kB' 'SwapCached: 0 kB' 'Active: 5786804 kB' 'Inactive: 3591304 kB' 'Active(anon): 5595872 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026632 kB' 'Mapped: 54912 kB' 'AnonPages: 354672 kB' 'Shmem: 5244396 kB' 'KernelStack: 8280 kB' 'PageTables: 4896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394392 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297416 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.786 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.786 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@33 -- # echo 0 00:03:14.787 19:01:33 -- setup/common.sh@33 -- # return 0 00:03:14.787 19:01:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.787 19:01:33 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.787 19:01:33 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.787 19:01:33 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:14.787 19:01:33 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.787 19:01:33 -- setup/common.sh@18 -- # local node=1 00:03:14.787 19:01:33 -- setup/common.sh@19 -- # local var val 00:03:14.787 19:01:33 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.787 19:01:33 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.787 19:01:33 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:14.787 19:01:33 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:14.787 19:01:33 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.787 19:01:33 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 24179868 kB' 'MemUsed: 3480872 kB' 'SwapCached: 0 kB' 'Active: 1566344 kB' 'Inactive: 162088 kB' 'Active(anon): 1360528 kB' 'Inactive(anon): 0 kB' 'Active(file): 205816 kB' 'Inactive(file): 162088 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1625088 kB' 'Mapped: 109856 kB' 'AnonPages: 103424 kB' 'Shmem: 1257184 kB' 'KernelStack: 4424 kB' 'PageTables: 2556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84044 kB' 'Slab: 293284 kB' 'SReclaimable: 84044 kB' 'SUnreclaim: 209240 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.787 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.787 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # continue 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.788 19:01:33 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.788 19:01:33 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.788 19:01:33 -- setup/common.sh@33 -- # echo 0 00:03:14.788 19:01:33 -- setup/common.sh@33 -- # return 0 00:03:14.788 19:01:33 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.788 19:01:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.788 19:01:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.788 19:01:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.788 19:01:33 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:14.788 node0=512 expecting 513 00:03:14.788 19:01:33 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.788 19:01:33 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.788 19:01:33 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.788 19:01:33 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:14.788 node1=513 expecting 512 00:03:14.788 19:01:33 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:14.788 00:03:14.788 real 0m1.431s 00:03:14.788 user 0m0.578s 00:03:14.788 sys 0m0.817s 00:03:14.788 19:01:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.788 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:03:14.788 ************************************ 00:03:14.788 END TEST odd_alloc 00:03:14.788 ************************************ 00:03:14.788 19:01:33 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:14.788 19:01:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:14.789 19:01:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:14.789 19:01:33 -- common/autotest_common.sh@10 -- # set +x 00:03:14.789 ************************************ 00:03:14.789 START TEST custom_alloc 00:03:14.789 ************************************ 00:03:14.789 19:01:33 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:14.789 19:01:33 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:14.789 19:01:33 -- setup/hugepages.sh@169 -- # local node 00:03:14.789 19:01:33 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:14.789 19:01:33 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:14.789 19:01:33 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:14.789 19:01:33 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:14.789 19:01:33 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:14.789 19:01:33 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:14.789 19:01:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:14.789 19:01:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.789 19:01:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.789 19:01:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:14.789 19:01:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.789 19:01:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.789 19:01:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.789 19:01:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:14.789 19:01:33 -- setup/hugepages.sh@83 -- # : 256 00:03:14.789 19:01:33 -- setup/hugepages.sh@84 -- # : 1 00:03:14.789 19:01:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:14.789 19:01:33 -- setup/hugepages.sh@83 -- # : 0 00:03:14.789 19:01:33 -- setup/hugepages.sh@84 -- # : 0 00:03:14.789 19:01:33 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:14.789 19:01:33 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:14.789 19:01:33 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:14.789 19:01:33 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:14.789 19:01:33 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:14.789 19:01:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.789 19:01:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.789 19:01:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.789 19:01:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.789 19:01:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.789 19:01:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.789 19:01:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:14.789 19:01:33 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:14.789 19:01:33 -- setup/hugepages.sh@78 -- # return 0 00:03:14.789 19:01:33 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:14.789 19:01:33 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:14.789 19:01:33 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:14.789 19:01:33 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:14.789 19:01:33 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:14.789 19:01:33 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:14.789 19:01:33 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:14.789 19:01:33 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.789 19:01:33 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.789 19:01:33 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.789 19:01:33 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.789 19:01:33 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.129 19:01:33 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.129 19:01:33 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.129 19:01:33 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:15.129 19:01:33 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:15.129 19:01:33 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:15.129 19:01:33 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:15.129 19:01:33 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:15.129 19:01:33 -- setup/hugepages.sh@78 -- # return 0 00:03:15.129 19:01:33 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:15.129 19:01:33 -- setup/hugepages.sh@187 -- # setup output 00:03:15.129 19:01:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.129 19:01:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.090 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.090 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:16.090 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.090 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.090 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.090 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.090 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.090 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.090 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.090 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.090 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.090 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.090 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.090 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.090 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.090 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.090 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.352 19:01:34 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:16.352 19:01:34 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:16.352 19:01:34 -- setup/hugepages.sh@89 -- # local node 00:03:16.352 19:01:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.352 19:01:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.352 19:01:34 -- setup/hugepages.sh@92 -- # local surp 00:03:16.352 19:01:34 -- setup/hugepages.sh@93 -- # local resv 00:03:16.352 19:01:34 -- setup/hugepages.sh@94 -- # local anon 00:03:16.352 19:01:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.352 19:01:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.352 19:01:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.352 19:01:34 -- setup/common.sh@18 -- # local node= 00:03:16.352 19:01:34 -- setup/common.sh@19 -- # local var val 00:03:16.352 19:01:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.352 19:01:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.352 19:01:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.352 19:01:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.352 19:01:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.352 19:01:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44281096 kB' 'MemAvailable: 48027924 kB' 'Buffers: 2708 kB' 'Cached: 10649088 kB' 'SwapCached: 0 kB' 'Active: 7353624 kB' 'Inactive: 3753392 kB' 'Active(anon): 6956876 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458452 kB' 'Mapped: 164916 kB' 'Shmem: 6501656 kB' 'KReclaimable: 181020 kB' 'Slab: 687528 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506508 kB' 'KernelStack: 12784 kB' 'PageTables: 7516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8014620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.352 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.352 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.353 19:01:34 -- setup/common.sh@33 -- # echo 0 00:03:16.353 19:01:34 -- setup/common.sh@33 -- # return 0 00:03:16.353 19:01:34 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.353 19:01:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.353 19:01:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.353 19:01:34 -- setup/common.sh@18 -- # local node= 00:03:16.353 19:01:34 -- setup/common.sh@19 -- # local var val 00:03:16.353 19:01:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.353 19:01:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.353 19:01:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.353 19:01:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.353 19:01:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.353 19:01:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44286772 kB' 'MemAvailable: 48033600 kB' 'Buffers: 2708 kB' 'Cached: 10649092 kB' 'SwapCached: 0 kB' 'Active: 7353952 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957204 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458768 kB' 'Mapped: 164916 kB' 'Shmem: 6501660 kB' 'KReclaimable: 181020 kB' 'Slab: 687520 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506500 kB' 'KernelStack: 12768 kB' 'PageTables: 7468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8014632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.353 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.353 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.354 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.354 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.354 19:01:34 -- setup/common.sh@33 -- # echo 0 00:03:16.354 19:01:34 -- setup/common.sh@33 -- # return 0 00:03:16.354 19:01:34 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.354 19:01:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.354 19:01:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.354 19:01:34 -- setup/common.sh@18 -- # local node= 00:03:16.355 19:01:34 -- setup/common.sh@19 -- # local var val 00:03:16.355 19:01:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.355 19:01:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.355 19:01:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.355 19:01:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.355 19:01:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.355 19:01:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44286772 kB' 'MemAvailable: 48033600 kB' 'Buffers: 2708 kB' 'Cached: 10649104 kB' 'SwapCached: 0 kB' 'Active: 7353272 kB' 'Inactive: 3753392 kB' 'Active(anon): 6956524 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458064 kB' 'Mapped: 164860 kB' 'Shmem: 6501672 kB' 'KReclaimable: 181020 kB' 'Slab: 687520 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506500 kB' 'KernelStack: 12752 kB' 'PageTables: 7408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8014648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.355 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.355 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.356 19:01:34 -- setup/common.sh@33 -- # echo 0 00:03:16.356 19:01:34 -- setup/common.sh@33 -- # return 0 00:03:16.356 19:01:34 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.356 19:01:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:16.356 nr_hugepages=1536 00:03:16.356 19:01:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.356 resv_hugepages=0 00:03:16.356 19:01:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.356 surplus_hugepages=0 00:03:16.356 19:01:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.356 anon_hugepages=0 00:03:16.356 19:01:34 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:16.356 19:01:34 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:16.356 19:01:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.356 19:01:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.356 19:01:34 -- setup/common.sh@18 -- # local node= 00:03:16.356 19:01:34 -- setup/common.sh@19 -- # local var val 00:03:16.356 19:01:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.356 19:01:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.356 19:01:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.356 19:01:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.356 19:01:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.356 19:01:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44286920 kB' 'MemAvailable: 48033748 kB' 'Buffers: 2708 kB' 'Cached: 10649104 kB' 'SwapCached: 0 kB' 'Active: 7352724 kB' 'Inactive: 3753392 kB' 'Active(anon): 6955976 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457508 kB' 'Mapped: 164780 kB' 'Shmem: 6501672 kB' 'KReclaimable: 181020 kB' 'Slab: 687456 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506436 kB' 'KernelStack: 12768 kB' 'PageTables: 7444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 8014660 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.356 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.356 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.357 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.357 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.358 19:01:34 -- setup/common.sh@33 -- # echo 1536 00:03:16.358 19:01:34 -- setup/common.sh@33 -- # return 0 00:03:16.358 19:01:34 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:16.358 19:01:34 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.358 19:01:34 -- setup/hugepages.sh@27 -- # local node 00:03:16.358 19:01:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.358 19:01:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.358 19:01:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.358 19:01:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:16.358 19:01:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.358 19:01:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.358 19:01:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.358 19:01:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.358 19:01:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.358 19:01:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.358 19:01:34 -- setup/common.sh@18 -- # local node=0 00:03:16.358 19:01:34 -- setup/common.sh@19 -- # local var val 00:03:16.358 19:01:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.358 19:01:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.358 19:01:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.358 19:01:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.358 19:01:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.358 19:01:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 21165740 kB' 'MemUsed: 11709184 kB' 'SwapCached: 0 kB' 'Active: 5787136 kB' 'Inactive: 3591304 kB' 'Active(anon): 5596204 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026756 kB' 'Mapped: 54912 kB' 'AnonPages: 354840 kB' 'Shmem: 5244520 kB' 'KernelStack: 8392 kB' 'PageTables: 4976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394416 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297440 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.358 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.358 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@33 -- # echo 0 00:03:16.359 19:01:34 -- setup/common.sh@33 -- # return 0 00:03:16.359 19:01:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.359 19:01:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.359 19:01:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.359 19:01:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.359 19:01:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.359 19:01:34 -- setup/common.sh@18 -- # local node=1 00:03:16.359 19:01:34 -- setup/common.sh@19 -- # local var val 00:03:16.359 19:01:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.359 19:01:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.359 19:01:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.359 19:01:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.359 19:01:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.359 19:01:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660740 kB' 'MemFree: 23121004 kB' 'MemUsed: 4539736 kB' 'SwapCached: 0 kB' 'Active: 1565892 kB' 'Inactive: 162088 kB' 'Active(anon): 1360076 kB' 'Inactive(anon): 0 kB' 'Active(file): 205816 kB' 'Inactive(file): 162088 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1625084 kB' 'Mapped: 109868 kB' 'AnonPages: 102948 kB' 'Shmem: 1257180 kB' 'KernelStack: 4376 kB' 'PageTables: 2468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 84044 kB' 'Slab: 293040 kB' 'SReclaimable: 84044 kB' 'SUnreclaim: 208996 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.359 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.359 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # continue 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.360 19:01:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.360 19:01:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.360 19:01:34 -- setup/common.sh@33 -- # echo 0 00:03:16.360 19:01:34 -- setup/common.sh@33 -- # return 0 00:03:16.360 19:01:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.360 19:01:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.360 19:01:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.360 19:01:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.360 19:01:34 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.360 node0=512 expecting 512 00:03:16.360 19:01:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.360 19:01:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.360 19:01:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.360 19:01:34 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:16.360 node1=1024 expecting 1024 00:03:16.360 19:01:34 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:16.360 00:03:16.360 real 0m1.512s 00:03:16.360 user 0m0.599s 00:03:16.360 sys 0m0.878s 00:03:16.360 19:01:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.360 19:01:34 -- common/autotest_common.sh@10 -- # set +x 00:03:16.360 ************************************ 00:03:16.360 END TEST custom_alloc 00:03:16.360 ************************************ 00:03:16.360 19:01:34 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:16.360 19:01:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.360 19:01:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.360 19:01:34 -- common/autotest_common.sh@10 -- # set +x 00:03:16.360 ************************************ 00:03:16.360 START TEST no_shrink_alloc 00:03:16.360 ************************************ 00:03:16.360 19:01:34 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:16.360 19:01:34 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:16.360 19:01:34 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:16.360 19:01:34 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:16.360 19:01:34 -- setup/hugepages.sh@51 -- # shift 00:03:16.360 19:01:34 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:16.360 19:01:34 -- setup/hugepages.sh@52 -- # local node_ids 00:03:16.360 19:01:34 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.360 19:01:34 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:16.360 19:01:34 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:16.360 19:01:34 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:16.360 19:01:34 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.360 19:01:34 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:16.360 19:01:34 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.360 19:01:34 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.360 19:01:34 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.360 19:01:34 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:16.360 19:01:34 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.360 19:01:34 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:16.360 19:01:34 -- setup/hugepages.sh@73 -- # return 0 00:03:16.360 19:01:34 -- setup/hugepages.sh@198 -- # setup output 00:03:16.360 19:01:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.360 19:01:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.747 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.747 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.747 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.747 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.747 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.747 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.747 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.747 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.747 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.747 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.747 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.747 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.747 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.747 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.748 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.748 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.748 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.748 19:01:36 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:17.748 19:01:36 -- setup/hugepages.sh@89 -- # local node 00:03:17.748 19:01:36 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.748 19:01:36 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.748 19:01:36 -- setup/hugepages.sh@92 -- # local surp 00:03:17.748 19:01:36 -- setup/hugepages.sh@93 -- # local resv 00:03:17.748 19:01:36 -- setup/hugepages.sh@94 -- # local anon 00:03:17.748 19:01:36 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.748 19:01:36 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.748 19:01:36 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.748 19:01:36 -- setup/common.sh@18 -- # local node= 00:03:17.748 19:01:36 -- setup/common.sh@19 -- # local var val 00:03:17.748 19:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.748 19:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.748 19:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.748 19:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.748 19:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.748 19:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45320672 kB' 'MemAvailable: 49067500 kB' 'Buffers: 2708 kB' 'Cached: 10649184 kB' 'SwapCached: 0 kB' 'Active: 7353428 kB' 'Inactive: 3753392 kB' 'Active(anon): 6956680 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458112 kB' 'Mapped: 164780 kB' 'Shmem: 6501752 kB' 'KReclaimable: 181020 kB' 'Slab: 687208 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506188 kB' 'KernelStack: 12768 kB' 'PageTables: 7364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8014480 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.748 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.748 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.749 19:01:36 -- setup/common.sh@33 -- # echo 0 00:03:17.749 19:01:36 -- setup/common.sh@33 -- # return 0 00:03:17.749 19:01:36 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.749 19:01:36 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.749 19:01:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.749 19:01:36 -- setup/common.sh@18 -- # local node= 00:03:17.749 19:01:36 -- setup/common.sh@19 -- # local var val 00:03:17.749 19:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.749 19:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.749 19:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.749 19:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.749 19:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.749 19:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45320560 kB' 'MemAvailable: 49067388 kB' 'Buffers: 2708 kB' 'Cached: 10649184 kB' 'SwapCached: 0 kB' 'Active: 7354128 kB' 'Inactive: 3753392 kB' 'Active(anon): 6957380 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458856 kB' 'Mapped: 164860 kB' 'Shmem: 6501752 kB' 'KReclaimable: 181020 kB' 'Slab: 687216 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506196 kB' 'KernelStack: 12848 kB' 'PageTables: 7564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8014492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.749 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.749 19:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.750 19:01:36 -- setup/common.sh@33 -- # echo 0 00:03:17.750 19:01:36 -- setup/common.sh@33 -- # return 0 00:03:17.750 19:01:36 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.750 19:01:36 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.750 19:01:36 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.750 19:01:36 -- setup/common.sh@18 -- # local node= 00:03:17.750 19:01:36 -- setup/common.sh@19 -- # local var val 00:03:17.750 19:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.750 19:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.750 19:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.750 19:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.750 19:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.750 19:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.750 19:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45321152 kB' 'MemAvailable: 49067980 kB' 'Buffers: 2708 kB' 'Cached: 10649204 kB' 'SwapCached: 0 kB' 'Active: 7353432 kB' 'Inactive: 3753392 kB' 'Active(anon): 6956684 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 458112 kB' 'Mapped: 164784 kB' 'Shmem: 6501772 kB' 'KReclaimable: 181020 kB' 'Slab: 687168 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506148 kB' 'KernelStack: 12784 kB' 'PageTables: 7400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8014512 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198200 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.750 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.750 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.751 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.751 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.752 19:01:36 -- setup/common.sh@33 -- # echo 0 00:03:17.752 19:01:36 -- setup/common.sh@33 -- # return 0 00:03:17.752 19:01:36 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.752 19:01:36 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.752 nr_hugepages=1024 00:03:17.752 19:01:36 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.752 resv_hugepages=0 00:03:17.752 19:01:36 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.752 surplus_hugepages=0 00:03:17.752 19:01:36 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.752 anon_hugepages=0 00:03:17.752 19:01:36 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.752 19:01:36 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.752 19:01:36 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.752 19:01:36 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.752 19:01:36 -- setup/common.sh@18 -- # local node= 00:03:17.752 19:01:36 -- setup/common.sh@19 -- # local var val 00:03:17.752 19:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.752 19:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.752 19:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.752 19:01:36 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.752 19:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.752 19:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45321068 kB' 'MemAvailable: 49067896 kB' 'Buffers: 2708 kB' 'Cached: 10649216 kB' 'SwapCached: 0 kB' 'Active: 7353220 kB' 'Inactive: 3753392 kB' 'Active(anon): 6956472 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457880 kB' 'Mapped: 164784 kB' 'Shmem: 6501784 kB' 'KReclaimable: 181020 kB' 'Slab: 687168 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506148 kB' 'KernelStack: 12768 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8014896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198216 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.752 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.752 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # continue 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.753 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.753 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.753 19:01:36 -- setup/common.sh@33 -- # echo 1024 00:03:17.753 19:01:36 -- setup/common.sh@33 -- # return 0 00:03:17.753 19:01:36 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.753 19:01:36 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.753 19:01:36 -- setup/hugepages.sh@27 -- # local node 00:03:17.753 19:01:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.753 19:01:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:17.753 19:01:36 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.753 19:01:36 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:17.753 19:01:36 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.753 19:01:36 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.753 19:01:36 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.753 19:01:36 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.012 19:01:36 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.012 19:01:36 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.012 19:01:36 -- setup/common.sh@18 -- # local node=0 00:03:18.012 19:01:36 -- setup/common.sh@19 -- # local var val 00:03:18.012 19:01:36 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.012 19:01:36 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.012 19:01:36 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.012 19:01:36 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.012 19:01:36 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.012 19:01:36 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20102952 kB' 'MemUsed: 12771972 kB' 'SwapCached: 0 kB' 'Active: 5787700 kB' 'Inactive: 3591304 kB' 'Active(anon): 5596768 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026844 kB' 'Mapped: 54912 kB' 'AnonPages: 355380 kB' 'Shmem: 5244608 kB' 'KernelStack: 8440 kB' 'PageTables: 5132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394240 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297264 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.012 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.012 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # continue 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.013 19:01:36 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.013 19:01:36 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.013 19:01:36 -- setup/common.sh@33 -- # echo 0 00:03:18.013 19:01:36 -- setup/common.sh@33 -- # return 0 00:03:18.013 19:01:36 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.013 19:01:36 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:18.013 19:01:36 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:18.013 19:01:36 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:18.013 19:01:36 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:18.013 node0=1024 expecting 1024 00:03:18.013 19:01:36 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:18.013 19:01:36 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:18.013 19:01:36 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:18.013 19:01:36 -- setup/hugepages.sh@202 -- # setup output 00:03:18.013 19:01:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:18.013 19:01:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.945 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.945 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.945 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.945 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.945 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.945 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.945 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.945 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.945 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.945 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.945 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.945 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.945 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.945 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.945 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.945 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.945 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.208 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:19.208 19:01:37 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:19.208 19:01:37 -- setup/hugepages.sh@89 -- # local node 00:03:19.208 19:01:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.208 19:01:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.208 19:01:37 -- setup/hugepages.sh@92 -- # local surp 00:03:19.208 19:01:37 -- setup/hugepages.sh@93 -- # local resv 00:03:19.208 19:01:37 -- setup/hugepages.sh@94 -- # local anon 00:03:19.208 19:01:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.208 19:01:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.208 19:01:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.208 19:01:37 -- setup/common.sh@18 -- # local node= 00:03:19.208 19:01:37 -- setup/common.sh@19 -- # local var val 00:03:19.208 19:01:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.208 19:01:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.208 19:01:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.208 19:01:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.208 19:01:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.208 19:01:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45307620 kB' 'MemAvailable: 49054448 kB' 'Buffers: 2708 kB' 'Cached: 10649260 kB' 'SwapCached: 0 kB' 'Active: 7359512 kB' 'Inactive: 3753392 kB' 'Active(anon): 6962764 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464232 kB' 'Mapped: 165612 kB' 'Shmem: 6501828 kB' 'KReclaimable: 181020 kB' 'Slab: 687228 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506208 kB' 'KernelStack: 12800 kB' 'PageTables: 7464 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8025228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.208 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.208 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.209 19:01:37 -- setup/common.sh@33 -- # echo 0 00:03:19.209 19:01:37 -- setup/common.sh@33 -- # return 0 00:03:19.209 19:01:37 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.209 19:01:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.209 19:01:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.209 19:01:37 -- setup/common.sh@18 -- # local node= 00:03:19.209 19:01:37 -- setup/common.sh@19 -- # local var val 00:03:19.209 19:01:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.209 19:01:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.209 19:01:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.209 19:01:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.209 19:01:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.209 19:01:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.209 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.209 19:01:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45312420 kB' 'MemAvailable: 49059248 kB' 'Buffers: 2708 kB' 'Cached: 10649264 kB' 'SwapCached: 0 kB' 'Active: 7354760 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958012 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 459444 kB' 'Mapped: 164668 kB' 'Shmem: 6501832 kB' 'KReclaimable: 181020 kB' 'Slab: 687228 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506208 kB' 'KernelStack: 12992 kB' 'PageTables: 8244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8018960 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.209 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.210 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.210 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.211 19:01:37 -- setup/common.sh@33 -- # echo 0 00:03:19.211 19:01:37 -- setup/common.sh@33 -- # return 0 00:03:19.211 19:01:37 -- setup/hugepages.sh@99 -- # surp=0 00:03:19.211 19:01:37 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:19.211 19:01:37 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:19.211 19:01:37 -- setup/common.sh@18 -- # local node= 00:03:19.211 19:01:37 -- setup/common.sh@19 -- # local var val 00:03:19.211 19:01:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.211 19:01:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.211 19:01:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.211 19:01:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.211 19:01:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.211 19:01:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45309448 kB' 'MemAvailable: 49056276 kB' 'Buffers: 2708 kB' 'Cached: 10649276 kB' 'SwapCached: 0 kB' 'Active: 7355460 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958712 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460152 kB' 'Mapped: 164736 kB' 'Shmem: 6501844 kB' 'KReclaimable: 181020 kB' 'Slab: 687228 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506208 kB' 'KernelStack: 13264 kB' 'PageTables: 9052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8019136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198680 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.211 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.211 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.212 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.212 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.213 19:01:37 -- setup/common.sh@33 -- # echo 0 00:03:19.213 19:01:37 -- setup/common.sh@33 -- # return 0 00:03:19.213 19:01:37 -- setup/hugepages.sh@100 -- # resv=0 00:03:19.213 19:01:37 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:19.213 nr_hugepages=1024 00:03:19.213 19:01:37 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:19.213 resv_hugepages=0 00:03:19.213 19:01:37 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:19.213 surplus_hugepages=0 00:03:19.213 19:01:37 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:19.213 anon_hugepages=0 00:03:19.213 19:01:37 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.213 19:01:37 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:19.213 19:01:37 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:19.213 19:01:37 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:19.213 19:01:37 -- setup/common.sh@18 -- # local node= 00:03:19.213 19:01:37 -- setup/common.sh@19 -- # local var val 00:03:19.213 19:01:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.213 19:01:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.213 19:01:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.213 19:01:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.213 19:01:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.213 19:01:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45316448 kB' 'MemAvailable: 49063276 kB' 'Buffers: 2708 kB' 'Cached: 10649288 kB' 'SwapCached: 0 kB' 'Active: 7355052 kB' 'Inactive: 3753392 kB' 'Active(anon): 6958304 kB' 'Inactive(anon): 0 kB' 'Active(file): 396748 kB' 'Inactive(file): 3753392 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460140 kB' 'Mapped: 164736 kB' 'Shmem: 6501856 kB' 'KReclaimable: 181020 kB' 'Slab: 687220 kB' 'SReclaimable: 181020 kB' 'SUnreclaim: 506200 kB' 'KernelStack: 13184 kB' 'PageTables: 8884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 8019152 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198568 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1881692 kB' 'DirectMap2M: 13766656 kB' 'DirectMap1G: 54525952 kB' 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.213 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.213 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.214 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.214 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.215 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.215 19:01:37 -- setup/common.sh@33 -- # echo 1024 00:03:19.215 19:01:37 -- setup/common.sh@33 -- # return 0 00:03:19.215 19:01:37 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.215 19:01:37 -- setup/hugepages.sh@112 -- # get_nodes 00:03:19.215 19:01:37 -- setup/hugepages.sh@27 -- # local node 00:03:19.215 19:01:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.215 19:01:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:19.215 19:01:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.215 19:01:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:19.215 19:01:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.215 19:01:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.215 19:01:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.215 19:01:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.215 19:01:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.215 19:01:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.215 19:01:37 -- setup/common.sh@18 -- # local node=0 00:03:19.215 19:01:37 -- setup/common.sh@19 -- # local var val 00:03:19.215 19:01:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.215 19:01:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.215 19:01:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.215 19:01:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.215 19:01:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.215 19:01:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.215 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20112056 kB' 'MemUsed: 12762868 kB' 'SwapCached: 0 kB' 'Active: 5787620 kB' 'Inactive: 3591304 kB' 'Active(anon): 5596688 kB' 'Inactive(anon): 0 kB' 'Active(file): 190932 kB' 'Inactive(file): 3591304 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9026888 kB' 'Mapped: 54860 kB' 'AnonPages: 355284 kB' 'Shmem: 5244652 kB' 'KernelStack: 8424 kB' 'PageTables: 5128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 96976 kB' 'Slab: 394220 kB' 'SReclaimable: 96976 kB' 'SUnreclaim: 297244 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.216 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.216 19:01:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # continue 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.217 19:01:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.217 19:01:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.217 19:01:37 -- setup/common.sh@33 -- # echo 0 00:03:19.217 19:01:37 -- setup/common.sh@33 -- # return 0 00:03:19.217 19:01:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.217 19:01:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.217 19:01:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.217 19:01:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.217 19:01:37 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:19.217 node0=1024 expecting 1024 00:03:19.217 19:01:37 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:19.217 00:03:19.217 real 0m2.887s 00:03:19.217 user 0m1.204s 00:03:19.217 sys 0m1.611s 00:03:19.217 19:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.217 19:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:19.217 ************************************ 00:03:19.217 END TEST no_shrink_alloc 00:03:19.217 ************************************ 00:03:19.217 19:01:37 -- setup/hugepages.sh@217 -- # clear_hp 00:03:19.217 19:01:37 -- setup/hugepages.sh@37 -- # local node hp 00:03:19.475 19:01:37 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.475 19:01:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.475 19:01:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.475 19:01:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.475 19:01:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.475 19:01:37 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.475 19:01:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.475 19:01:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.475 19:01:37 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.475 19:01:37 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.475 19:01:37 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:19.476 19:01:37 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:19.476 00:03:19.476 real 0m11.507s 00:03:19.476 user 0m4.352s 00:03:19.476 sys 0m6.101s 00:03:19.476 19:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.476 19:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:19.476 ************************************ 00:03:19.476 END TEST hugepages 00:03:19.476 ************************************ 00:03:19.476 19:01:37 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:19.476 19:01:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.476 19:01:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.476 19:01:37 -- common/autotest_common.sh@10 -- # set +x 00:03:19.476 ************************************ 00:03:19.476 START TEST driver 00:03:19.476 ************************************ 00:03:19.476 19:01:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:19.476 * Looking for test storage... 00:03:19.476 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:19.476 19:01:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:19.476 19:01:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:19.476 19:01:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:19.476 19:01:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:19.476 19:01:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:19.476 19:01:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:19.476 19:01:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:19.476 19:01:37 -- scripts/common.sh@335 -- # IFS=.-: 00:03:19.476 19:01:37 -- scripts/common.sh@335 -- # read -ra ver1 00:03:19.476 19:01:37 -- scripts/common.sh@336 -- # IFS=.-: 00:03:19.476 19:01:37 -- scripts/common.sh@336 -- # read -ra ver2 00:03:19.476 19:01:37 -- scripts/common.sh@337 -- # local 'op=<' 00:03:19.476 19:01:37 -- scripts/common.sh@339 -- # ver1_l=2 00:03:19.476 19:01:37 -- scripts/common.sh@340 -- # ver2_l=1 00:03:19.476 19:01:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:19.476 19:01:37 -- scripts/common.sh@343 -- # case "$op" in 00:03:19.476 19:01:37 -- scripts/common.sh@344 -- # : 1 00:03:19.476 19:01:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:19.476 19:01:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:19.476 19:01:37 -- scripts/common.sh@364 -- # decimal 1 00:03:19.476 19:01:37 -- scripts/common.sh@352 -- # local d=1 00:03:19.476 19:01:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:19.476 19:01:37 -- scripts/common.sh@354 -- # echo 1 00:03:19.476 19:01:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:19.476 19:01:37 -- scripts/common.sh@365 -- # decimal 2 00:03:19.476 19:01:37 -- scripts/common.sh@352 -- # local d=2 00:03:19.476 19:01:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:19.476 19:01:37 -- scripts/common.sh@354 -- # echo 2 00:03:19.476 19:01:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:19.476 19:01:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:19.476 19:01:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:19.476 19:01:37 -- scripts/common.sh@367 -- # return 0 00:03:19.476 19:01:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:19.476 19:01:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:19.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.476 --rc genhtml_branch_coverage=1 00:03:19.476 --rc genhtml_function_coverage=1 00:03:19.476 --rc genhtml_legend=1 00:03:19.476 --rc geninfo_all_blocks=1 00:03:19.476 --rc geninfo_unexecuted_blocks=1 00:03:19.476 00:03:19.476 ' 00:03:19.476 19:01:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:19.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.476 --rc genhtml_branch_coverage=1 00:03:19.476 --rc genhtml_function_coverage=1 00:03:19.476 --rc genhtml_legend=1 00:03:19.476 --rc geninfo_all_blocks=1 00:03:19.476 --rc geninfo_unexecuted_blocks=1 00:03:19.476 00:03:19.476 ' 00:03:19.476 19:01:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:19.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.476 --rc genhtml_branch_coverage=1 00:03:19.476 --rc genhtml_function_coverage=1 00:03:19.476 --rc genhtml_legend=1 00:03:19.476 --rc geninfo_all_blocks=1 00:03:19.476 --rc geninfo_unexecuted_blocks=1 00:03:19.476 00:03:19.476 ' 00:03:19.476 19:01:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:19.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:19.476 --rc genhtml_branch_coverage=1 00:03:19.476 --rc genhtml_function_coverage=1 00:03:19.476 --rc genhtml_legend=1 00:03:19.476 --rc geninfo_all_blocks=1 00:03:19.476 --rc geninfo_unexecuted_blocks=1 00:03:19.476 00:03:19.476 ' 00:03:19.476 19:01:37 -- setup/driver.sh@68 -- # setup reset 00:03:19.476 19:01:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:19.476 19:01:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:22.006 19:01:40 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:22.006 19:01:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.006 19:01:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.006 19:01:40 -- common/autotest_common.sh@10 -- # set +x 00:03:22.006 ************************************ 00:03:22.006 START TEST guess_driver 00:03:22.006 ************************************ 00:03:22.006 19:01:40 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:22.006 19:01:40 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:22.006 19:01:40 -- setup/driver.sh@47 -- # local fail=0 00:03:22.006 19:01:40 -- setup/driver.sh@49 -- # pick_driver 00:03:22.006 19:01:40 -- setup/driver.sh@36 -- # vfio 00:03:22.006 19:01:40 -- setup/driver.sh@21 -- # local iommu_grups 00:03:22.006 19:01:40 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:22.006 19:01:40 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:22.006 19:01:40 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:22.006 19:01:40 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:22.006 19:01:40 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:22.006 19:01:40 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:22.006 19:01:40 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:22.006 19:01:40 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:22.006 19:01:40 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:22.006 19:01:40 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:22.006 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:22.006 19:01:40 -- setup/driver.sh@30 -- # return 0 00:03:22.006 19:01:40 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:22.006 19:01:40 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:22.007 19:01:40 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:22.007 19:01:40 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:22.007 Looking for driver=vfio-pci 00:03:22.007 19:01:40 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.007 19:01:40 -- setup/driver.sh@45 -- # setup output config 00:03:22.007 19:01:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.007 19:01:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.381 19:01:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.381 19:01:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.381 19:01:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:24.315 19:01:42 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:24.315 19:01:42 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:24.315 19:01:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:24.315 19:01:42 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:24.315 19:01:42 -- setup/driver.sh@65 -- # setup reset 00:03:24.315 19:01:42 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:24.315 19:01:42 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:26.845 00:03:26.845 real 0m4.784s 00:03:26.845 user 0m1.079s 00:03:26.845 sys 0m1.884s 00:03:26.845 19:01:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.845 19:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:26.845 ************************************ 00:03:26.845 END TEST guess_driver 00:03:26.845 ************************************ 00:03:26.845 00:03:26.845 real 0m7.456s 00:03:26.845 user 0m1.725s 00:03:26.845 sys 0m2.962s 00:03:26.845 19:01:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.845 19:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:26.845 ************************************ 00:03:26.845 END TEST driver 00:03:26.845 ************************************ 00:03:26.845 19:01:45 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:26.845 19:01:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.845 19:01:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.845 19:01:45 -- common/autotest_common.sh@10 -- # set +x 00:03:26.845 ************************************ 00:03:26.845 START TEST devices 00:03:26.845 ************************************ 00:03:26.845 19:01:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:26.845 * Looking for test storage... 00:03:26.845 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:26.845 19:01:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:26.845 19:01:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:26.845 19:01:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:27.103 19:01:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:27.103 19:01:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:27.103 19:01:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:27.103 19:01:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:27.103 19:01:45 -- scripts/common.sh@335 -- # IFS=.-: 00:03:27.103 19:01:45 -- scripts/common.sh@335 -- # read -ra ver1 00:03:27.103 19:01:45 -- scripts/common.sh@336 -- # IFS=.-: 00:03:27.103 19:01:45 -- scripts/common.sh@336 -- # read -ra ver2 00:03:27.103 19:01:45 -- scripts/common.sh@337 -- # local 'op=<' 00:03:27.103 19:01:45 -- scripts/common.sh@339 -- # ver1_l=2 00:03:27.103 19:01:45 -- scripts/common.sh@340 -- # ver2_l=1 00:03:27.103 19:01:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:27.103 19:01:45 -- scripts/common.sh@343 -- # case "$op" in 00:03:27.103 19:01:45 -- scripts/common.sh@344 -- # : 1 00:03:27.103 19:01:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:27.103 19:01:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:27.103 19:01:45 -- scripts/common.sh@364 -- # decimal 1 00:03:27.103 19:01:45 -- scripts/common.sh@352 -- # local d=1 00:03:27.103 19:01:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:27.103 19:01:45 -- scripts/common.sh@354 -- # echo 1 00:03:27.103 19:01:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:27.103 19:01:45 -- scripts/common.sh@365 -- # decimal 2 00:03:27.103 19:01:45 -- scripts/common.sh@352 -- # local d=2 00:03:27.103 19:01:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:27.103 19:01:45 -- scripts/common.sh@354 -- # echo 2 00:03:27.103 19:01:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:27.103 19:01:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:27.103 19:01:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:27.103 19:01:45 -- scripts/common.sh@367 -- # return 0 00:03:27.103 19:01:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:27.103 19:01:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:27.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.103 --rc genhtml_branch_coverage=1 00:03:27.103 --rc genhtml_function_coverage=1 00:03:27.103 --rc genhtml_legend=1 00:03:27.103 --rc geninfo_all_blocks=1 00:03:27.103 --rc geninfo_unexecuted_blocks=1 00:03:27.103 00:03:27.103 ' 00:03:27.103 19:01:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:27.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.103 --rc genhtml_branch_coverage=1 00:03:27.103 --rc genhtml_function_coverage=1 00:03:27.103 --rc genhtml_legend=1 00:03:27.103 --rc geninfo_all_blocks=1 00:03:27.103 --rc geninfo_unexecuted_blocks=1 00:03:27.103 00:03:27.103 ' 00:03:27.103 19:01:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:27.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.103 --rc genhtml_branch_coverage=1 00:03:27.103 --rc genhtml_function_coverage=1 00:03:27.103 --rc genhtml_legend=1 00:03:27.103 --rc geninfo_all_blocks=1 00:03:27.103 --rc geninfo_unexecuted_blocks=1 00:03:27.103 00:03:27.103 ' 00:03:27.103 19:01:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:27.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:27.103 --rc genhtml_branch_coverage=1 00:03:27.103 --rc genhtml_function_coverage=1 00:03:27.103 --rc genhtml_legend=1 00:03:27.103 --rc geninfo_all_blocks=1 00:03:27.103 --rc geninfo_unexecuted_blocks=1 00:03:27.103 00:03:27.103 ' 00:03:27.103 19:01:45 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:27.103 19:01:45 -- setup/devices.sh@192 -- # setup reset 00:03:27.103 19:01:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:27.103 19:01:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:28.477 19:01:46 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:28.477 19:01:46 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:28.477 19:01:46 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:28.477 19:01:46 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:28.477 19:01:46 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:28.477 19:01:46 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:28.477 19:01:46 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:28.477 19:01:46 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:28.477 19:01:46 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:28.477 19:01:46 -- setup/devices.sh@196 -- # blocks=() 00:03:28.477 19:01:46 -- setup/devices.sh@196 -- # declare -a blocks 00:03:28.477 19:01:46 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:28.477 19:01:46 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:28.477 19:01:46 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:28.477 19:01:46 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:28.477 19:01:46 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:28.477 19:01:46 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:28.477 19:01:46 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:28.477 19:01:46 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:28.477 19:01:46 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:28.477 19:01:46 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:28.477 19:01:46 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:28.477 No valid GPT data, bailing 00:03:28.477 19:01:46 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:28.477 19:01:46 -- scripts/common.sh@393 -- # pt= 00:03:28.477 19:01:46 -- scripts/common.sh@394 -- # return 1 00:03:28.477 19:01:46 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:28.477 19:01:46 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:28.477 19:01:46 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:28.477 19:01:46 -- setup/common.sh@80 -- # echo 1000204886016 00:03:28.477 19:01:46 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:28.477 19:01:46 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:28.477 19:01:46 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:28.477 19:01:46 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:28.477 19:01:46 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:28.477 19:01:46 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:28.477 19:01:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.477 19:01:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.477 19:01:46 -- common/autotest_common.sh@10 -- # set +x 00:03:28.477 ************************************ 00:03:28.477 START TEST nvme_mount 00:03:28.477 ************************************ 00:03:28.477 19:01:46 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:28.477 19:01:46 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:28.477 19:01:46 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:28.477 19:01:46 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:28.477 19:01:46 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:28.477 19:01:46 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:28.477 19:01:46 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:28.477 19:01:46 -- setup/common.sh@40 -- # local part_no=1 00:03:28.477 19:01:46 -- setup/common.sh@41 -- # local size=1073741824 00:03:28.477 19:01:46 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:28.477 19:01:46 -- setup/common.sh@44 -- # parts=() 00:03:28.477 19:01:46 -- setup/common.sh@44 -- # local parts 00:03:28.477 19:01:46 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:28.477 19:01:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:28.477 19:01:46 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:28.477 19:01:46 -- setup/common.sh@46 -- # (( part++ )) 00:03:28.477 19:01:46 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:28.477 19:01:46 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:28.477 19:01:46 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:28.477 19:01:46 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:29.410 Creating new GPT entries in memory. 00:03:29.410 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:29.410 other utilities. 00:03:29.410 19:01:47 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:29.410 19:01:47 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:29.410 19:01:47 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:29.410 19:01:47 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:29.410 19:01:47 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:30.782 Creating new GPT entries in memory. 00:03:30.782 The operation has completed successfully. 00:03:30.782 19:01:48 -- setup/common.sh@57 -- # (( part++ )) 00:03:30.782 19:01:48 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:30.782 19:01:48 -- setup/common.sh@62 -- # wait 3306557 00:03:30.782 19:01:49 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.782 19:01:49 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:30.782 19:01:49 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.782 19:01:49 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:30.782 19:01:49 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:30.782 19:01:49 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.782 19:01:49 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:30.782 19:01:49 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:30.782 19:01:49 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:30.782 19:01:49 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.782 19:01:49 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:30.782 19:01:49 -- setup/devices.sh@53 -- # local found=0 00:03:30.782 19:01:49 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:30.782 19:01:49 -- setup/devices.sh@56 -- # : 00:03:30.782 19:01:49 -- setup/devices.sh@59 -- # local pci status 00:03:30.782 19:01:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:30.782 19:01:49 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:30.782 19:01:49 -- setup/devices.sh@47 -- # setup output config 00:03:30.782 19:01:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:30.782 19:01:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:31.716 19:01:50 -- setup/devices.sh@63 -- # found=1 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.716 19:01:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.716 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.974 19:01:50 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:31.974 19:01:50 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:31.974 19:01:50 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.974 19:01:50 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:31.974 19:01:50 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:31.974 19:01:50 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:31.974 19:01:50 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.974 19:01:50 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.974 19:01:50 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:31.974 19:01:50 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:31.974 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:31.974 19:01:50 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:31.974 19:01:50 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:32.233 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:32.233 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:32.233 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:32.233 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:32.233 19:01:50 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:32.233 19:01:50 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:32.233 19:01:50 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.233 19:01:50 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:32.233 19:01:50 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:32.233 19:01:50 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.233 19:01:50 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.233 19:01:50 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:32.233 19:01:50 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:32.233 19:01:50 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.233 19:01:50 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.233 19:01:50 -- setup/devices.sh@53 -- # local found=0 00:03:32.233 19:01:50 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:32.233 19:01:50 -- setup/devices.sh@56 -- # : 00:03:32.233 19:01:50 -- setup/devices.sh@59 -- # local pci status 00:03:32.233 19:01:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.233 19:01:50 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:32.233 19:01:50 -- setup/devices.sh@47 -- # setup output config 00:03:32.233 19:01:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.233 19:01:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:33.167 19:01:51 -- setup/devices.sh@63 -- # found=1 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.167 19:01:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.167 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.426 19:01:51 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:33.426 19:01:51 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:33.426 19:01:51 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.426 19:01:51 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:33.426 19:01:51 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:33.426 19:01:51 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.426 19:01:51 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:33.426 19:01:51 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:33.426 19:01:51 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:33.426 19:01:51 -- setup/devices.sh@50 -- # local mount_point= 00:03:33.426 19:01:51 -- setup/devices.sh@51 -- # local test_file= 00:03:33.426 19:01:51 -- setup/devices.sh@53 -- # local found=0 00:03:33.426 19:01:51 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:33.426 19:01:51 -- setup/devices.sh@59 -- # local pci status 00:03:33.426 19:01:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.426 19:01:51 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:33.426 19:01:51 -- setup/devices.sh@47 -- # setup output config 00:03:33.426 19:01:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.426 19:01:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:34.800 19:01:53 -- setup/devices.sh@63 -- # found=1 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.800 19:01:53 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:34.800 19:01:53 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:34.800 19:01:53 -- setup/devices.sh@68 -- # return 0 00:03:34.800 19:01:53 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:34.800 19:01:53 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.800 19:01:53 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:34.800 19:01:53 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:34.800 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:34.800 00:03:34.800 real 0m6.308s 00:03:34.800 user 0m1.432s 00:03:34.800 sys 0m2.466s 00:03:34.800 19:01:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:34.800 19:01:53 -- common/autotest_common.sh@10 -- # set +x 00:03:34.800 ************************************ 00:03:34.800 END TEST nvme_mount 00:03:34.800 ************************************ 00:03:34.800 19:01:53 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:34.800 19:01:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:34.800 19:01:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:34.800 19:01:53 -- common/autotest_common.sh@10 -- # set +x 00:03:34.800 ************************************ 00:03:34.800 START TEST dm_mount 00:03:34.800 ************************************ 00:03:34.800 19:01:53 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:34.800 19:01:53 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:34.800 19:01:53 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:34.800 19:01:53 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:34.800 19:01:53 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:34.800 19:01:53 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:34.800 19:01:53 -- setup/common.sh@40 -- # local part_no=2 00:03:34.800 19:01:53 -- setup/common.sh@41 -- # local size=1073741824 00:03:34.801 19:01:53 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:34.801 19:01:53 -- setup/common.sh@44 -- # parts=() 00:03:34.801 19:01:53 -- setup/common.sh@44 -- # local parts 00:03:34.801 19:01:53 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:34.801 19:01:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.801 19:01:53 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:34.801 19:01:53 -- setup/common.sh@46 -- # (( part++ )) 00:03:34.801 19:01:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.801 19:01:53 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:34.801 19:01:53 -- setup/common.sh@46 -- # (( part++ )) 00:03:34.801 19:01:53 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.801 19:01:53 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:34.801 19:01:53 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:34.801 19:01:53 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:35.734 Creating new GPT entries in memory. 00:03:35.734 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:35.734 other utilities. 00:03:35.734 19:01:54 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:35.734 19:01:54 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:35.734 19:01:54 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:35.734 19:01:54 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:35.734 19:01:54 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:37.106 Creating new GPT entries in memory. 00:03:37.106 The operation has completed successfully. 00:03:37.106 19:01:55 -- setup/common.sh@57 -- # (( part++ )) 00:03:37.106 19:01:55 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:37.106 19:01:55 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:37.106 19:01:55 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:37.106 19:01:55 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:38.040 The operation has completed successfully. 00:03:38.040 19:01:56 -- setup/common.sh@57 -- # (( part++ )) 00:03:38.040 19:01:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:38.040 19:01:56 -- setup/common.sh@62 -- # wait 3309012 00:03:38.040 19:01:56 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:38.040 19:01:56 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.040 19:01:56 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.040 19:01:56 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:38.040 19:01:56 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:38.040 19:01:56 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.040 19:01:56 -- setup/devices.sh@161 -- # break 00:03:38.040 19:01:56 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.040 19:01:56 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:38.040 19:01:56 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:38.040 19:01:56 -- setup/devices.sh@166 -- # dm=dm-0 00:03:38.040 19:01:56 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:38.040 19:01:56 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:38.040 19:01:56 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.040 19:01:56 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:38.040 19:01:56 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.040 19:01:56 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.040 19:01:56 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:38.040 19:01:56 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.040 19:01:56 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.040 19:01:56 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:38.040 19:01:56 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:38.040 19:01:56 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.040 19:01:56 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.040 19:01:56 -- setup/devices.sh@53 -- # local found=0 00:03:38.040 19:01:56 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:38.040 19:01:56 -- setup/devices.sh@56 -- # : 00:03:38.040 19:01:56 -- setup/devices.sh@59 -- # local pci status 00:03:38.040 19:01:56 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.040 19:01:56 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:38.040 19:01:56 -- setup/devices.sh@47 -- # setup output config 00:03:38.040 19:01:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.040 19:01:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.974 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.974 19:01:57 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:38.974 19:01:57 -- setup/devices.sh@63 -- # found=1 00:03:38.974 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.974 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.974 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:39.232 19:01:57 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:39.232 19:01:57 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:39.232 19:01:57 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:39.232 19:01:57 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:39.232 19:01:57 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:39.232 19:01:57 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:39.232 19:01:57 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:39.232 19:01:57 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:39.232 19:01:57 -- setup/devices.sh@50 -- # local mount_point= 00:03:39.232 19:01:57 -- setup/devices.sh@51 -- # local test_file= 00:03:39.232 19:01:57 -- setup/devices.sh@53 -- # local found=0 00:03:39.232 19:01:57 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:39.232 19:01:57 -- setup/devices.sh@59 -- # local pci status 00:03:39.232 19:01:57 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.232 19:01:57 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:39.232 19:01:57 -- setup/devices.sh@47 -- # setup output config 00:03:39.232 19:01:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.232 19:01:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:40.605 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:40.606 19:01:58 -- setup/devices.sh@63 -- # found=1 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:58 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.606 19:01:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.606 19:01:59 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:40.606 19:01:59 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:40.606 19:01:59 -- setup/devices.sh@68 -- # return 0 00:03:40.606 19:01:59 -- setup/devices.sh@187 -- # cleanup_dm 00:03:40.606 19:01:59 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:40.606 19:01:59 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:40.606 19:01:59 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:40.863 19:01:59 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:40.863 19:01:59 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:40.863 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:40.863 19:01:59 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:40.863 19:01:59 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:40.863 00:03:40.863 real 0m5.935s 00:03:40.863 user 0m1.083s 00:03:40.863 sys 0m1.728s 00:03:40.863 19:01:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:40.863 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:03:40.863 ************************************ 00:03:40.863 END TEST dm_mount 00:03:40.863 ************************************ 00:03:40.863 19:01:59 -- setup/devices.sh@1 -- # cleanup 00:03:40.863 19:01:59 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:40.863 19:01:59 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.863 19:01:59 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:40.863 19:01:59 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:40.863 19:01:59 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:40.863 19:01:59 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:41.121 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:41.122 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:41.122 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:41.122 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:41.122 19:01:59 -- setup/devices.sh@12 -- # cleanup_dm 00:03:41.122 19:01:59 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:41.122 19:01:59 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:41.122 19:01:59 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:41.122 19:01:59 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:41.122 19:01:59 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:41.122 19:01:59 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:41.122 00:03:41.122 real 0m14.208s 00:03:41.122 user 0m3.218s 00:03:41.122 sys 0m5.227s 00:03:41.122 19:01:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.122 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:03:41.122 ************************************ 00:03:41.122 END TEST devices 00:03:41.122 ************************************ 00:03:41.122 00:03:41.122 real 0m44.142s 00:03:41.122 user 0m12.711s 00:03:41.122 sys 0m19.919s 00:03:41.122 19:01:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:41.122 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:03:41.122 ************************************ 00:03:41.122 END TEST setup.sh 00:03:41.122 ************************************ 00:03:41.122 19:01:59 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:42.055 Hugepages 00:03:42.055 node hugesize free / total 00:03:42.055 node0 1048576kB 0 / 0 00:03:42.055 node0 2048kB 2048 / 2048 00:03:42.055 node1 1048576kB 0 / 0 00:03:42.055 node1 2048kB 0 / 0 00:03:42.055 00:03:42.055 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:42.055 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:42.055 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:42.055 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:42.055 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:42.313 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:42.313 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:42.313 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:42.313 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:42.313 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:42.313 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:42.313 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:42.313 19:02:00 -- spdk/autotest.sh@128 -- # uname -s 00:03:42.313 19:02:00 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:42.313 19:02:00 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:42.313 19:02:00 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:43.686 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:43.686 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:43.686 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:44.620 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:44.620 19:02:03 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:45.552 19:02:04 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:45.552 19:02:04 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:45.552 19:02:04 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:45.552 19:02:04 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:45.552 19:02:04 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:45.552 19:02:04 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:45.552 19:02:04 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:45.552 19:02:04 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:45.552 19:02:04 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:45.809 19:02:04 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:45.809 19:02:04 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:45.809 19:02:04 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:46.742 Waiting for block devices as requested 00:03:46.742 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:47.000 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:47.000 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:47.258 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:47.258 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:47.258 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:47.258 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:47.516 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:47.516 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:47.516 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:47.516 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:47.773 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:47.773 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:47.773 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:47.773 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:48.032 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:48.032 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:48.032 19:02:06 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:48.032 19:02:06 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:48.032 19:02:06 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:48.032 19:02:06 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:48.032 19:02:06 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:48.032 19:02:06 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:48.032 19:02:06 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:48.032 19:02:06 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:48.032 19:02:06 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:48.032 19:02:06 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:48.032 19:02:06 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:48.032 19:02:06 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:48.032 19:02:06 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:48.032 19:02:06 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:48.032 19:02:06 -- common/autotest_common.sh@1552 -- # continue 00:03:48.032 19:02:06 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:48.032 19:02:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:48.032 19:02:06 -- common/autotest_common.sh@10 -- # set +x 00:03:48.289 19:02:06 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:48.289 19:02:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:48.289 19:02:06 -- common/autotest_common.sh@10 -- # set +x 00:03:48.289 19:02:06 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:49.722 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:49.722 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:49.722 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:50.287 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:50.545 19:02:09 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:50.546 19:02:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:50.546 19:02:09 -- common/autotest_common.sh@10 -- # set +x 00:03:50.546 19:02:09 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:50.546 19:02:09 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:50.546 19:02:09 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:50.546 19:02:09 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:50.546 19:02:09 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:50.546 19:02:09 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:50.546 19:02:09 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:50.546 19:02:09 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:50.546 19:02:09 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:50.546 19:02:09 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:50.546 19:02:09 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:50.546 19:02:09 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:50.546 19:02:09 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:50.546 19:02:09 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:50.546 19:02:09 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:50.546 19:02:09 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:50.546 19:02:09 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:50.546 19:02:09 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:50.546 19:02:09 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:50.546 19:02:09 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:50.546 19:02:09 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=3314343 00:03:50.546 19:02:09 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:50.546 19:02:09 -- common/autotest_common.sh@1593 -- # waitforlisten 3314343 00:03:50.546 19:02:09 -- common/autotest_common.sh@829 -- # '[' -z 3314343 ']' 00:03:50.546 19:02:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:50.546 19:02:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:50.546 19:02:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:50.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:50.546 19:02:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:50.546 19:02:09 -- common/autotest_common.sh@10 -- # set +x 00:03:50.546 [2024-11-18 19:02:09.134897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:50.546 [2024-11-18 19:02:09.134999] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3314343 ] 00:03:50.807 EAL: No free 2048 kB hugepages reported on node 1 00:03:50.807 [2024-11-18 19:02:09.191863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:50.807 [2024-11-18 19:02:09.301107] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:50.807 [2024-11-18 19:02:09.301272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:51.742 19:02:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:51.742 19:02:10 -- common/autotest_common.sh@862 -- # return 0 00:03:51.742 19:02:10 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:51.742 19:02:10 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:51.742 19:02:10 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:55.025 nvme0n1 00:03:55.025 19:02:13 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:55.025 [2024-11-18 19:02:13.431286] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:55.025 [2024-11-18 19:02:13.431331] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:55.025 request: 00:03:55.025 { 00:03:55.025 "nvme_ctrlr_name": "nvme0", 00:03:55.025 "password": "test", 00:03:55.025 "method": "bdev_nvme_opal_revert", 00:03:55.025 "req_id": 1 00:03:55.025 } 00:03:55.025 Got JSON-RPC error response 00:03:55.025 response: 00:03:55.025 { 00:03:55.025 "code": -32603, 00:03:55.025 "message": "Internal error" 00:03:55.025 } 00:03:55.025 19:02:13 -- common/autotest_common.sh@1599 -- # true 00:03:55.025 19:02:13 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:03:55.025 19:02:13 -- common/autotest_common.sh@1603 -- # killprocess 3314343 00:03:55.025 19:02:13 -- common/autotest_common.sh@936 -- # '[' -z 3314343 ']' 00:03:55.025 19:02:13 -- common/autotest_common.sh@940 -- # kill -0 3314343 00:03:55.025 19:02:13 -- common/autotest_common.sh@941 -- # uname 00:03:55.025 19:02:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:03:55.025 19:02:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3314343 00:03:55.025 19:02:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:03:55.025 19:02:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:03:55.025 19:02:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3314343' 00:03:55.025 killing process with pid 3314343 00:03:55.025 19:02:13 -- common/autotest_common.sh@955 -- # kill 3314343 00:03:55.025 19:02:13 -- common/autotest_common.sh@960 -- # wait 3314343 00:03:56.924 19:02:15 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:03:56.924 19:02:15 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:03:56.924 19:02:15 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:56.924 19:02:15 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:03:56.924 19:02:15 -- spdk/autotest.sh@160 -- # timing_enter lib 00:03:56.924 19:02:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:56.924 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:03:56.924 19:02:15 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:56.924 19:02:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:56.924 19:02:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:56.924 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:03:56.924 ************************************ 00:03:56.924 START TEST env 00:03:56.924 ************************************ 00:03:56.924 19:02:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:56.924 * Looking for test storage... 00:03:56.924 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:56.924 19:02:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:56.924 19:02:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:56.924 19:02:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:56.924 19:02:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:56.924 19:02:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:56.924 19:02:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:56.924 19:02:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:56.924 19:02:15 -- scripts/common.sh@335 -- # IFS=.-: 00:03:56.924 19:02:15 -- scripts/common.sh@335 -- # read -ra ver1 00:03:56.924 19:02:15 -- scripts/common.sh@336 -- # IFS=.-: 00:03:56.924 19:02:15 -- scripts/common.sh@336 -- # read -ra ver2 00:03:56.924 19:02:15 -- scripts/common.sh@337 -- # local 'op=<' 00:03:56.924 19:02:15 -- scripts/common.sh@339 -- # ver1_l=2 00:03:56.924 19:02:15 -- scripts/common.sh@340 -- # ver2_l=1 00:03:56.924 19:02:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:56.924 19:02:15 -- scripts/common.sh@343 -- # case "$op" in 00:03:56.924 19:02:15 -- scripts/common.sh@344 -- # : 1 00:03:56.924 19:02:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:56.924 19:02:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:56.924 19:02:15 -- scripts/common.sh@364 -- # decimal 1 00:03:56.924 19:02:15 -- scripts/common.sh@352 -- # local d=1 00:03:56.924 19:02:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:56.925 19:02:15 -- scripts/common.sh@354 -- # echo 1 00:03:56.925 19:02:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:56.925 19:02:15 -- scripts/common.sh@365 -- # decimal 2 00:03:56.925 19:02:15 -- scripts/common.sh@352 -- # local d=2 00:03:56.925 19:02:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:56.925 19:02:15 -- scripts/common.sh@354 -- # echo 2 00:03:56.925 19:02:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:56.925 19:02:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:56.925 19:02:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:56.925 19:02:15 -- scripts/common.sh@367 -- # return 0 00:03:56.925 19:02:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:56.925 19:02:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:56.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.925 --rc genhtml_branch_coverage=1 00:03:56.925 --rc genhtml_function_coverage=1 00:03:56.925 --rc genhtml_legend=1 00:03:56.925 --rc geninfo_all_blocks=1 00:03:56.925 --rc geninfo_unexecuted_blocks=1 00:03:56.925 00:03:56.925 ' 00:03:56.925 19:02:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:56.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.925 --rc genhtml_branch_coverage=1 00:03:56.925 --rc genhtml_function_coverage=1 00:03:56.925 --rc genhtml_legend=1 00:03:56.925 --rc geninfo_all_blocks=1 00:03:56.925 --rc geninfo_unexecuted_blocks=1 00:03:56.925 00:03:56.925 ' 00:03:56.925 19:02:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:56.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.925 --rc genhtml_branch_coverage=1 00:03:56.925 --rc genhtml_function_coverage=1 00:03:56.925 --rc genhtml_legend=1 00:03:56.925 --rc geninfo_all_blocks=1 00:03:56.925 --rc geninfo_unexecuted_blocks=1 00:03:56.925 00:03:56.925 ' 00:03:56.925 19:02:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:56.925 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:56.925 --rc genhtml_branch_coverage=1 00:03:56.925 --rc genhtml_function_coverage=1 00:03:56.925 --rc genhtml_legend=1 00:03:56.925 --rc geninfo_all_blocks=1 00:03:56.925 --rc geninfo_unexecuted_blocks=1 00:03:56.925 00:03:56.925 ' 00:03:56.925 19:02:15 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:56.925 19:02:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:56.925 19:02:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:56.925 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:03:56.925 ************************************ 00:03:56.925 START TEST env_memory 00:03:56.925 ************************************ 00:03:56.925 19:02:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:56.925 00:03:56.925 00:03:56.925 CUnit - A unit testing framework for C - Version 2.1-3 00:03:56.925 http://cunit.sourceforge.net/ 00:03:56.925 00:03:56.925 00:03:56.925 Suite: memory 00:03:56.925 Test: alloc and free memory map ...[2024-11-18 19:02:15.461794] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:56.925 passed 00:03:56.925 Test: mem map translation ...[2024-11-18 19:02:15.482974] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:56.925 [2024-11-18 19:02:15.482997] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:56.925 [2024-11-18 19:02:15.483057] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:56.925 [2024-11-18 19:02:15.483071] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:56.925 passed 00:03:56.925 Test: mem map registration ...[2024-11-18 19:02:15.525662] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:56.925 [2024-11-18 19:02:15.525684] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:57.184 passed 00:03:57.184 Test: mem map adjacent registrations ...passed 00:03:57.184 00:03:57.184 Run Summary: Type Total Ran Passed Failed Inactive 00:03:57.184 suites 1 1 n/a 0 0 00:03:57.184 tests 4 4 4 0 0 00:03:57.184 asserts 152 152 152 0 n/a 00:03:57.184 00:03:57.184 Elapsed time = 0.147 seconds 00:03:57.184 00:03:57.184 real 0m0.155s 00:03:57.184 user 0m0.145s 00:03:57.184 sys 0m0.009s 00:03:57.184 19:02:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:57.184 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:03:57.184 ************************************ 00:03:57.184 END TEST env_memory 00:03:57.184 ************************************ 00:03:57.184 19:02:15 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:57.184 19:02:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:57.184 19:02:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:57.184 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:03:57.184 ************************************ 00:03:57.184 START TEST env_vtophys 00:03:57.184 ************************************ 00:03:57.184 19:02:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:57.184 EAL: lib.eal log level changed from notice to debug 00:03:57.184 EAL: Detected lcore 0 as core 0 on socket 0 00:03:57.184 EAL: Detected lcore 1 as core 1 on socket 0 00:03:57.184 EAL: Detected lcore 2 as core 2 on socket 0 00:03:57.184 EAL: Detected lcore 3 as core 3 on socket 0 00:03:57.184 EAL: Detected lcore 4 as core 4 on socket 0 00:03:57.184 EAL: Detected lcore 5 as core 5 on socket 0 00:03:57.184 EAL: Detected lcore 6 as core 8 on socket 0 00:03:57.184 EAL: Detected lcore 7 as core 9 on socket 0 00:03:57.184 EAL: Detected lcore 8 as core 10 on socket 0 00:03:57.184 EAL: Detected lcore 9 as core 11 on socket 0 00:03:57.184 EAL: Detected lcore 10 as core 12 on socket 0 00:03:57.184 EAL: Detected lcore 11 as core 13 on socket 0 00:03:57.184 EAL: Detected lcore 12 as core 0 on socket 1 00:03:57.184 EAL: Detected lcore 13 as core 1 on socket 1 00:03:57.184 EAL: Detected lcore 14 as core 2 on socket 1 00:03:57.184 EAL: Detected lcore 15 as core 3 on socket 1 00:03:57.184 EAL: Detected lcore 16 as core 4 on socket 1 00:03:57.184 EAL: Detected lcore 17 as core 5 on socket 1 00:03:57.184 EAL: Detected lcore 18 as core 8 on socket 1 00:03:57.184 EAL: Detected lcore 19 as core 9 on socket 1 00:03:57.184 EAL: Detected lcore 20 as core 10 on socket 1 00:03:57.184 EAL: Detected lcore 21 as core 11 on socket 1 00:03:57.184 EAL: Detected lcore 22 as core 12 on socket 1 00:03:57.184 EAL: Detected lcore 23 as core 13 on socket 1 00:03:57.184 EAL: Detected lcore 24 as core 0 on socket 0 00:03:57.185 EAL: Detected lcore 25 as core 1 on socket 0 00:03:57.185 EAL: Detected lcore 26 as core 2 on socket 0 00:03:57.185 EAL: Detected lcore 27 as core 3 on socket 0 00:03:57.185 EAL: Detected lcore 28 as core 4 on socket 0 00:03:57.185 EAL: Detected lcore 29 as core 5 on socket 0 00:03:57.185 EAL: Detected lcore 30 as core 8 on socket 0 00:03:57.185 EAL: Detected lcore 31 as core 9 on socket 0 00:03:57.185 EAL: Detected lcore 32 as core 10 on socket 0 00:03:57.185 EAL: Detected lcore 33 as core 11 on socket 0 00:03:57.185 EAL: Detected lcore 34 as core 12 on socket 0 00:03:57.185 EAL: Detected lcore 35 as core 13 on socket 0 00:03:57.185 EAL: Detected lcore 36 as core 0 on socket 1 00:03:57.185 EAL: Detected lcore 37 as core 1 on socket 1 00:03:57.185 EAL: Detected lcore 38 as core 2 on socket 1 00:03:57.185 EAL: Detected lcore 39 as core 3 on socket 1 00:03:57.185 EAL: Detected lcore 40 as core 4 on socket 1 00:03:57.185 EAL: Detected lcore 41 as core 5 on socket 1 00:03:57.185 EAL: Detected lcore 42 as core 8 on socket 1 00:03:57.185 EAL: Detected lcore 43 as core 9 on socket 1 00:03:57.185 EAL: Detected lcore 44 as core 10 on socket 1 00:03:57.185 EAL: Detected lcore 45 as core 11 on socket 1 00:03:57.185 EAL: Detected lcore 46 as core 12 on socket 1 00:03:57.185 EAL: Detected lcore 47 as core 13 on socket 1 00:03:57.185 EAL: Maximum logical cores by configuration: 128 00:03:57.185 EAL: Detected CPU lcores: 48 00:03:57.185 EAL: Detected NUMA nodes: 2 00:03:57.185 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:57.185 EAL: Detected shared linkage of DPDK 00:03:57.185 EAL: No shared files mode enabled, IPC will be disabled 00:03:57.185 EAL: Bus pci wants IOVA as 'DC' 00:03:57.185 EAL: Buses did not request a specific IOVA mode. 00:03:57.185 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:57.185 EAL: Selected IOVA mode 'VA' 00:03:57.185 EAL: No free 2048 kB hugepages reported on node 1 00:03:57.185 EAL: Probing VFIO support... 00:03:57.185 EAL: IOMMU type 1 (Type 1) is supported 00:03:57.185 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:57.185 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:57.185 EAL: VFIO support initialized 00:03:57.185 EAL: Ask a virtual area of 0x2e000 bytes 00:03:57.185 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:57.185 EAL: Setting up physically contiguous memory... 00:03:57.185 EAL: Setting maximum number of open files to 524288 00:03:57.185 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:57.185 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:57.185 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:57.185 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:57.185 EAL: Ask a virtual area of 0x61000 bytes 00:03:57.185 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:57.185 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:57.185 EAL: Ask a virtual area of 0x400000000 bytes 00:03:57.185 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:57.185 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:57.185 EAL: Hugepages will be freed exactly as allocated. 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: TSC frequency is ~2700000 KHz 00:03:57.185 EAL: Main lcore 0 is ready (tid=7f50c684fa00;cpuset=[0]) 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 0 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 2MB 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:57.185 EAL: Mem event callback 'spdk:(nil)' registered 00:03:57.185 00:03:57.185 00:03:57.185 CUnit - A unit testing framework for C - Version 2.1-3 00:03:57.185 http://cunit.sourceforge.net/ 00:03:57.185 00:03:57.185 00:03:57.185 Suite: components_suite 00:03:57.185 Test: vtophys_malloc_test ...passed 00:03:57.185 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 4 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 4MB 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was shrunk by 4MB 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 4 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 6MB 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was shrunk by 6MB 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 4 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 10MB 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was shrunk by 10MB 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 4 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 18MB 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was shrunk by 18MB 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 4 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 34MB 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was shrunk by 34MB 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.185 EAL: Restoring previous memory policy: 4 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was expanded by 66MB 00:03:57.185 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.185 EAL: request: mp_malloc_sync 00:03:57.185 EAL: No shared files mode enabled, IPC is disabled 00:03:57.185 EAL: Heap on socket 0 was shrunk by 66MB 00:03:57.185 EAL: Trying to obtain current memory policy. 00:03:57.185 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.444 EAL: Restoring previous memory policy: 4 00:03:57.444 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.444 EAL: request: mp_malloc_sync 00:03:57.444 EAL: No shared files mode enabled, IPC is disabled 00:03:57.444 EAL: Heap on socket 0 was expanded by 130MB 00:03:57.444 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.444 EAL: request: mp_malloc_sync 00:03:57.444 EAL: No shared files mode enabled, IPC is disabled 00:03:57.444 EAL: Heap on socket 0 was shrunk by 130MB 00:03:57.444 EAL: Trying to obtain current memory policy. 00:03:57.444 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.444 EAL: Restoring previous memory policy: 4 00:03:57.444 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.444 EAL: request: mp_malloc_sync 00:03:57.444 EAL: No shared files mode enabled, IPC is disabled 00:03:57.444 EAL: Heap on socket 0 was expanded by 258MB 00:03:57.444 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.444 EAL: request: mp_malloc_sync 00:03:57.444 EAL: No shared files mode enabled, IPC is disabled 00:03:57.444 EAL: Heap on socket 0 was shrunk by 258MB 00:03:57.444 EAL: Trying to obtain current memory policy. 00:03:57.444 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:57.702 EAL: Restoring previous memory policy: 4 00:03:57.702 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.702 EAL: request: mp_malloc_sync 00:03:57.702 EAL: No shared files mode enabled, IPC is disabled 00:03:57.702 EAL: Heap on socket 0 was expanded by 514MB 00:03:57.702 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.960 EAL: request: mp_malloc_sync 00:03:57.960 EAL: No shared files mode enabled, IPC is disabled 00:03:57.960 EAL: Heap on socket 0 was shrunk by 514MB 00:03:57.960 EAL: Trying to obtain current memory policy. 00:03:57.960 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:58.219 EAL: Restoring previous memory policy: 4 00:03:58.219 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.219 EAL: request: mp_malloc_sync 00:03:58.219 EAL: No shared files mode enabled, IPC is disabled 00:03:58.219 EAL: Heap on socket 0 was expanded by 1026MB 00:03:58.476 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.735 EAL: request: mp_malloc_sync 00:03:58.735 EAL: No shared files mode enabled, IPC is disabled 00:03:58.735 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:58.735 passed 00:03:58.735 00:03:58.735 Run Summary: Type Total Ran Passed Failed Inactive 00:03:58.735 suites 1 1 n/a 0 0 00:03:58.735 tests 2 2 2 0 0 00:03:58.735 asserts 497 497 497 0 n/a 00:03:58.735 00:03:58.735 Elapsed time = 1.380 seconds 00:03:58.735 EAL: Calling mem event callback 'spdk:(nil)' 00:03:58.735 EAL: request: mp_malloc_sync 00:03:58.735 EAL: No shared files mode enabled, IPC is disabled 00:03:58.735 EAL: Heap on socket 0 was shrunk by 2MB 00:03:58.735 EAL: No shared files mode enabled, IPC is disabled 00:03:58.735 EAL: No shared files mode enabled, IPC is disabled 00:03:58.735 EAL: No shared files mode enabled, IPC is disabled 00:03:58.735 00:03:58.735 real 0m1.518s 00:03:58.735 user 0m0.864s 00:03:58.735 sys 0m0.612s 00:03:58.735 19:02:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.735 19:02:17 -- common/autotest_common.sh@10 -- # set +x 00:03:58.735 ************************************ 00:03:58.735 END TEST env_vtophys 00:03:58.735 ************************************ 00:03:58.735 19:02:17 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:58.735 19:02:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:58.735 19:02:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.735 19:02:17 -- common/autotest_common.sh@10 -- # set +x 00:03:58.735 ************************************ 00:03:58.735 START TEST env_pci 00:03:58.735 ************************************ 00:03:58.735 19:02:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:58.735 00:03:58.735 00:03:58.735 CUnit - A unit testing framework for C - Version 2.1-3 00:03:58.735 http://cunit.sourceforge.net/ 00:03:58.735 00:03:58.735 00:03:58.735 Suite: pci 00:03:58.735 Test: pci_hook ...[2024-11-18 19:02:17.166722] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3315389 has claimed it 00:03:58.735 EAL: Cannot find device (10000:00:01.0) 00:03:58.735 EAL: Failed to attach device on primary process 00:03:58.735 passed 00:03:58.735 00:03:58.735 Run Summary: Type Total Ran Passed Failed Inactive 00:03:58.735 suites 1 1 n/a 0 0 00:03:58.735 tests 1 1 1 0 0 00:03:58.735 asserts 25 25 25 0 n/a 00:03:58.735 00:03:58.735 Elapsed time = 0.022 seconds 00:03:58.735 00:03:58.735 real 0m0.036s 00:03:58.735 user 0m0.016s 00:03:58.735 sys 0m0.019s 00:03:58.735 19:02:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:58.735 19:02:17 -- common/autotest_common.sh@10 -- # set +x 00:03:58.735 ************************************ 00:03:58.735 END TEST env_pci 00:03:58.735 ************************************ 00:03:58.735 19:02:17 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:58.735 19:02:17 -- env/env.sh@15 -- # uname 00:03:58.735 19:02:17 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:58.735 19:02:17 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:58.735 19:02:17 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:58.735 19:02:17 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:03:58.735 19:02:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:58.735 19:02:17 -- common/autotest_common.sh@10 -- # set +x 00:03:58.735 ************************************ 00:03:58.735 START TEST env_dpdk_post_init 00:03:58.735 ************************************ 00:03:58.735 19:02:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:58.735 EAL: Detected CPU lcores: 48 00:03:58.735 EAL: Detected NUMA nodes: 2 00:03:58.735 EAL: Detected shared linkage of DPDK 00:03:58.735 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:58.735 EAL: Selected IOVA mode 'VA' 00:03:58.735 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.735 EAL: VFIO support initialized 00:03:58.735 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:58.735 EAL: Using IOMMU type 1 (Type 1) 00:03:58.735 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:58.993 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:59.926 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:03.205 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:03.205 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:03.205 Starting DPDK initialization... 00:04:03.205 Starting SPDK post initialization... 00:04:03.205 SPDK NVMe probe 00:04:03.205 Attaching to 0000:88:00.0 00:04:03.205 Attached to 0000:88:00.0 00:04:03.205 Cleaning up... 00:04:03.205 00:04:03.205 real 0m4.435s 00:04:03.205 user 0m3.294s 00:04:03.205 sys 0m0.194s 00:04:03.205 19:02:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.205 19:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:03.205 ************************************ 00:04:03.205 END TEST env_dpdk_post_init 00:04:03.205 ************************************ 00:04:03.205 19:02:21 -- env/env.sh@26 -- # uname 00:04:03.205 19:02:21 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:03.205 19:02:21 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:03.205 19:02:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.205 19:02:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.205 19:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:03.205 ************************************ 00:04:03.205 START TEST env_mem_callbacks 00:04:03.205 ************************************ 00:04:03.205 19:02:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:03.205 EAL: Detected CPU lcores: 48 00:04:03.205 EAL: Detected NUMA nodes: 2 00:04:03.205 EAL: Detected shared linkage of DPDK 00:04:03.205 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:03.205 EAL: Selected IOVA mode 'VA' 00:04:03.205 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.205 EAL: VFIO support initialized 00:04:03.205 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:03.205 00:04:03.205 00:04:03.205 CUnit - A unit testing framework for C - Version 2.1-3 00:04:03.205 http://cunit.sourceforge.net/ 00:04:03.205 00:04:03.205 00:04:03.205 Suite: memory 00:04:03.205 Test: test ... 00:04:03.205 register 0x200000200000 2097152 00:04:03.205 malloc 3145728 00:04:03.205 register 0x200000400000 4194304 00:04:03.205 buf 0x200000500000 len 3145728 PASSED 00:04:03.206 malloc 64 00:04:03.206 buf 0x2000004fff40 len 64 PASSED 00:04:03.206 malloc 4194304 00:04:03.206 register 0x200000800000 6291456 00:04:03.206 buf 0x200000a00000 len 4194304 PASSED 00:04:03.206 free 0x200000500000 3145728 00:04:03.206 free 0x2000004fff40 64 00:04:03.206 unregister 0x200000400000 4194304 PASSED 00:04:03.206 free 0x200000a00000 4194304 00:04:03.206 unregister 0x200000800000 6291456 PASSED 00:04:03.206 malloc 8388608 00:04:03.206 register 0x200000400000 10485760 00:04:03.206 buf 0x200000600000 len 8388608 PASSED 00:04:03.206 free 0x200000600000 8388608 00:04:03.206 unregister 0x200000400000 10485760 PASSED 00:04:03.206 passed 00:04:03.206 00:04:03.206 Run Summary: Type Total Ran Passed Failed Inactive 00:04:03.206 suites 1 1 n/a 0 0 00:04:03.206 tests 1 1 1 0 0 00:04:03.206 asserts 15 15 15 0 n/a 00:04:03.206 00:04:03.206 Elapsed time = 0.005 seconds 00:04:03.206 00:04:03.206 real 0m0.048s 00:04:03.206 user 0m0.014s 00:04:03.206 sys 0m0.034s 00:04:03.206 19:02:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.206 19:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:03.206 ************************************ 00:04:03.206 END TEST env_mem_callbacks 00:04:03.206 ************************************ 00:04:03.206 00:04:03.206 real 0m6.468s 00:04:03.206 user 0m4.485s 00:04:03.206 sys 0m1.025s 00:04:03.206 19:02:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:03.206 19:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:03.206 ************************************ 00:04:03.206 END TEST env 00:04:03.206 ************************************ 00:04:03.206 19:02:21 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:03.206 19:02:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.206 19:02:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.206 19:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:03.206 ************************************ 00:04:03.206 START TEST rpc 00:04:03.206 ************************************ 00:04:03.206 19:02:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:03.464 * Looking for test storage... 00:04:03.464 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:03.464 19:02:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:03.464 19:02:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:03.464 19:02:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:03.464 19:02:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:03.464 19:02:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:03.464 19:02:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:03.464 19:02:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:03.464 19:02:21 -- scripts/common.sh@335 -- # IFS=.-: 00:04:03.464 19:02:21 -- scripts/common.sh@335 -- # read -ra ver1 00:04:03.464 19:02:21 -- scripts/common.sh@336 -- # IFS=.-: 00:04:03.464 19:02:21 -- scripts/common.sh@336 -- # read -ra ver2 00:04:03.464 19:02:21 -- scripts/common.sh@337 -- # local 'op=<' 00:04:03.464 19:02:21 -- scripts/common.sh@339 -- # ver1_l=2 00:04:03.464 19:02:21 -- scripts/common.sh@340 -- # ver2_l=1 00:04:03.464 19:02:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:03.464 19:02:21 -- scripts/common.sh@343 -- # case "$op" in 00:04:03.464 19:02:21 -- scripts/common.sh@344 -- # : 1 00:04:03.464 19:02:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:03.464 19:02:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:03.464 19:02:21 -- scripts/common.sh@364 -- # decimal 1 00:04:03.464 19:02:21 -- scripts/common.sh@352 -- # local d=1 00:04:03.464 19:02:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:03.464 19:02:21 -- scripts/common.sh@354 -- # echo 1 00:04:03.464 19:02:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:03.464 19:02:21 -- scripts/common.sh@365 -- # decimal 2 00:04:03.464 19:02:21 -- scripts/common.sh@352 -- # local d=2 00:04:03.464 19:02:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:03.464 19:02:21 -- scripts/common.sh@354 -- # echo 2 00:04:03.464 19:02:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:03.464 19:02:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:03.464 19:02:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:03.464 19:02:21 -- scripts/common.sh@367 -- # return 0 00:04:03.464 19:02:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:03.464 19:02:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:03.464 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.464 --rc genhtml_branch_coverage=1 00:04:03.464 --rc genhtml_function_coverage=1 00:04:03.464 --rc genhtml_legend=1 00:04:03.464 --rc geninfo_all_blocks=1 00:04:03.464 --rc geninfo_unexecuted_blocks=1 00:04:03.464 00:04:03.464 ' 00:04:03.464 19:02:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:03.464 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.464 --rc genhtml_branch_coverage=1 00:04:03.464 --rc genhtml_function_coverage=1 00:04:03.464 --rc genhtml_legend=1 00:04:03.464 --rc geninfo_all_blocks=1 00:04:03.464 --rc geninfo_unexecuted_blocks=1 00:04:03.464 00:04:03.464 ' 00:04:03.464 19:02:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:03.464 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.464 --rc genhtml_branch_coverage=1 00:04:03.464 --rc genhtml_function_coverage=1 00:04:03.464 --rc genhtml_legend=1 00:04:03.464 --rc geninfo_all_blocks=1 00:04:03.464 --rc geninfo_unexecuted_blocks=1 00:04:03.464 00:04:03.464 ' 00:04:03.464 19:02:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:03.464 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:03.464 --rc genhtml_branch_coverage=1 00:04:03.464 --rc genhtml_function_coverage=1 00:04:03.464 --rc genhtml_legend=1 00:04:03.464 --rc geninfo_all_blocks=1 00:04:03.464 --rc geninfo_unexecuted_blocks=1 00:04:03.464 00:04:03.464 ' 00:04:03.464 19:02:21 -- rpc/rpc.sh@65 -- # spdk_pid=3316061 00:04:03.464 19:02:21 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:03.464 19:02:21 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:03.464 19:02:21 -- rpc/rpc.sh@67 -- # waitforlisten 3316061 00:04:03.464 19:02:21 -- common/autotest_common.sh@829 -- # '[' -z 3316061 ']' 00:04:03.464 19:02:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:03.464 19:02:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:03.464 19:02:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:03.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:03.464 19:02:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:03.464 19:02:21 -- common/autotest_common.sh@10 -- # set +x 00:04:03.464 [2024-11-18 19:02:21.961551] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:03.465 [2024-11-18 19:02:21.961684] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3316061 ] 00:04:03.465 EAL: No free 2048 kB hugepages reported on node 1 00:04:03.465 [2024-11-18 19:02:22.017417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:03.723 [2024-11-18 19:02:22.126194] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:03.723 [2024-11-18 19:02:22.126360] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:03.723 [2024-11-18 19:02:22.126381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3316061' to capture a snapshot of events at runtime. 00:04:03.723 [2024-11-18 19:02:22.126394] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3316061 for offline analysis/debug. 00:04:03.723 [2024-11-18 19:02:22.126423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:04.657 19:02:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:04.657 19:02:22 -- common/autotest_common.sh@862 -- # return 0 00:04:04.657 19:02:22 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:04.657 19:02:22 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:04.657 19:02:22 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:04.657 19:02:22 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:04.657 19:02:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.657 19:02:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.657 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:04.657 ************************************ 00:04:04.657 START TEST rpc_integrity 00:04:04.657 ************************************ 00:04:04.657 19:02:22 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:04.657 19:02:22 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:04.657 19:02:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.657 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:04.657 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.657 19:02:22 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:04.657 19:02:22 -- rpc/rpc.sh@13 -- # jq length 00:04:04.657 19:02:22 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:04.657 19:02:22 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:04.657 19:02:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.657 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:04.657 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.657 19:02:22 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:04.657 19:02:22 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:04.657 19:02:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.657 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:04:04.657 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.657 19:02:22 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:04.657 { 00:04:04.657 "name": "Malloc0", 00:04:04.657 "aliases": [ 00:04:04.657 "bd697efd-bb52-4259-ba7a-916742311221" 00:04:04.657 ], 00:04:04.657 "product_name": "Malloc disk", 00:04:04.657 "block_size": 512, 00:04:04.657 "num_blocks": 16384, 00:04:04.657 "uuid": "bd697efd-bb52-4259-ba7a-916742311221", 00:04:04.657 "assigned_rate_limits": { 00:04:04.657 "rw_ios_per_sec": 0, 00:04:04.657 "rw_mbytes_per_sec": 0, 00:04:04.657 "r_mbytes_per_sec": 0, 00:04:04.658 "w_mbytes_per_sec": 0 00:04:04.658 }, 00:04:04.658 "claimed": false, 00:04:04.658 "zoned": false, 00:04:04.658 "supported_io_types": { 00:04:04.658 "read": true, 00:04:04.658 "write": true, 00:04:04.658 "unmap": true, 00:04:04.658 "write_zeroes": true, 00:04:04.658 "flush": true, 00:04:04.658 "reset": true, 00:04:04.658 "compare": false, 00:04:04.658 "compare_and_write": false, 00:04:04.658 "abort": true, 00:04:04.658 "nvme_admin": false, 00:04:04.658 "nvme_io": false 00:04:04.658 }, 00:04:04.658 "memory_domains": [ 00:04:04.658 { 00:04:04.658 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.658 "dma_device_type": 2 00:04:04.658 } 00:04:04.658 ], 00:04:04.658 "driver_specific": {} 00:04:04.658 } 00:04:04.658 ]' 00:04:04.658 19:02:22 -- rpc/rpc.sh@17 -- # jq length 00:04:04.658 19:02:23 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:04.658 19:02:23 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 [2024-11-18 19:02:23.024790] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:04.658 [2024-11-18 19:02:23.024833] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:04.658 [2024-11-18 19:02:23.024856] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x229fcb0 00:04:04.658 [2024-11-18 19:02:23.024870] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:04.658 [2024-11-18 19:02:23.026128] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:04.658 [2024-11-18 19:02:23.026150] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:04.658 Passthru0 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:04.658 { 00:04:04.658 "name": "Malloc0", 00:04:04.658 "aliases": [ 00:04:04.658 "bd697efd-bb52-4259-ba7a-916742311221" 00:04:04.658 ], 00:04:04.658 "product_name": "Malloc disk", 00:04:04.658 "block_size": 512, 00:04:04.658 "num_blocks": 16384, 00:04:04.658 "uuid": "bd697efd-bb52-4259-ba7a-916742311221", 00:04:04.658 "assigned_rate_limits": { 00:04:04.658 "rw_ios_per_sec": 0, 00:04:04.658 "rw_mbytes_per_sec": 0, 00:04:04.658 "r_mbytes_per_sec": 0, 00:04:04.658 "w_mbytes_per_sec": 0 00:04:04.658 }, 00:04:04.658 "claimed": true, 00:04:04.658 "claim_type": "exclusive_write", 00:04:04.658 "zoned": false, 00:04:04.658 "supported_io_types": { 00:04:04.658 "read": true, 00:04:04.658 "write": true, 00:04:04.658 "unmap": true, 00:04:04.658 "write_zeroes": true, 00:04:04.658 "flush": true, 00:04:04.658 "reset": true, 00:04:04.658 "compare": false, 00:04:04.658 "compare_and_write": false, 00:04:04.658 "abort": true, 00:04:04.658 "nvme_admin": false, 00:04:04.658 "nvme_io": false 00:04:04.658 }, 00:04:04.658 "memory_domains": [ 00:04:04.658 { 00:04:04.658 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.658 "dma_device_type": 2 00:04:04.658 } 00:04:04.658 ], 00:04:04.658 "driver_specific": {} 00:04:04.658 }, 00:04:04.658 { 00:04:04.658 "name": "Passthru0", 00:04:04.658 "aliases": [ 00:04:04.658 "d7ab7acd-73f4-5043-82ed-4efa8c2a41bc" 00:04:04.658 ], 00:04:04.658 "product_name": "passthru", 00:04:04.658 "block_size": 512, 00:04:04.658 "num_blocks": 16384, 00:04:04.658 "uuid": "d7ab7acd-73f4-5043-82ed-4efa8c2a41bc", 00:04:04.658 "assigned_rate_limits": { 00:04:04.658 "rw_ios_per_sec": 0, 00:04:04.658 "rw_mbytes_per_sec": 0, 00:04:04.658 "r_mbytes_per_sec": 0, 00:04:04.658 "w_mbytes_per_sec": 0 00:04:04.658 }, 00:04:04.658 "claimed": false, 00:04:04.658 "zoned": false, 00:04:04.658 "supported_io_types": { 00:04:04.658 "read": true, 00:04:04.658 "write": true, 00:04:04.658 "unmap": true, 00:04:04.658 "write_zeroes": true, 00:04:04.658 "flush": true, 00:04:04.658 "reset": true, 00:04:04.658 "compare": false, 00:04:04.658 "compare_and_write": false, 00:04:04.658 "abort": true, 00:04:04.658 "nvme_admin": false, 00:04:04.658 "nvme_io": false 00:04:04.658 }, 00:04:04.658 "memory_domains": [ 00:04:04.658 { 00:04:04.658 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.658 "dma_device_type": 2 00:04:04.658 } 00:04:04.658 ], 00:04:04.658 "driver_specific": { 00:04:04.658 "passthru": { 00:04:04.658 "name": "Passthru0", 00:04:04.658 "base_bdev_name": "Malloc0" 00:04:04.658 } 00:04:04.658 } 00:04:04.658 } 00:04:04.658 ]' 00:04:04.658 19:02:23 -- rpc/rpc.sh@21 -- # jq length 00:04:04.658 19:02:23 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:04.658 19:02:23 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:04.658 19:02:23 -- rpc/rpc.sh@26 -- # jq length 00:04:04.658 19:02:23 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:04.658 00:04:04.658 real 0m0.204s 00:04:04.658 user 0m0.138s 00:04:04.658 sys 0m0.012s 00:04:04.658 19:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 ************************************ 00:04:04.658 END TEST rpc_integrity 00:04:04.658 ************************************ 00:04:04.658 19:02:23 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:04.658 19:02:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.658 19:02:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 ************************************ 00:04:04.658 START TEST rpc_plugins 00:04:04.658 ************************************ 00:04:04.658 19:02:23 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:04.658 19:02:23 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:04.658 19:02:23 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:04.658 { 00:04:04.658 "name": "Malloc1", 00:04:04.658 "aliases": [ 00:04:04.658 "9ddeb390-3aa9-4870-a26b-611830e623f0" 00:04:04.658 ], 00:04:04.658 "product_name": "Malloc disk", 00:04:04.658 "block_size": 4096, 00:04:04.658 "num_blocks": 256, 00:04:04.658 "uuid": "9ddeb390-3aa9-4870-a26b-611830e623f0", 00:04:04.658 "assigned_rate_limits": { 00:04:04.658 "rw_ios_per_sec": 0, 00:04:04.658 "rw_mbytes_per_sec": 0, 00:04:04.658 "r_mbytes_per_sec": 0, 00:04:04.658 "w_mbytes_per_sec": 0 00:04:04.658 }, 00:04:04.658 "claimed": false, 00:04:04.658 "zoned": false, 00:04:04.658 "supported_io_types": { 00:04:04.658 "read": true, 00:04:04.658 "write": true, 00:04:04.658 "unmap": true, 00:04:04.658 "write_zeroes": true, 00:04:04.658 "flush": true, 00:04:04.658 "reset": true, 00:04:04.658 "compare": false, 00:04:04.658 "compare_and_write": false, 00:04:04.658 "abort": true, 00:04:04.658 "nvme_admin": false, 00:04:04.658 "nvme_io": false 00:04:04.658 }, 00:04:04.658 "memory_domains": [ 00:04:04.658 { 00:04:04.658 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:04.658 "dma_device_type": 2 00:04:04.658 } 00:04:04.658 ], 00:04:04.658 "driver_specific": {} 00:04:04.658 } 00:04:04.658 ]' 00:04:04.658 19:02:23 -- rpc/rpc.sh@32 -- # jq length 00:04:04.658 19:02:23 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:04.658 19:02:23 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:04.658 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.658 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.658 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.658 19:02:23 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:04.658 19:02:23 -- rpc/rpc.sh@36 -- # jq length 00:04:04.917 19:02:23 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:04.917 00:04:04.917 real 0m0.105s 00:04:04.917 user 0m0.068s 00:04:04.917 sys 0m0.008s 00:04:04.917 19:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.917 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.917 ************************************ 00:04:04.917 END TEST rpc_plugins 00:04:04.917 ************************************ 00:04:04.917 19:02:23 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:04.917 19:02:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.917 19:02:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.917 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.917 ************************************ 00:04:04.917 START TEST rpc_trace_cmd_test 00:04:04.917 ************************************ 00:04:04.917 19:02:23 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:04.917 19:02:23 -- rpc/rpc.sh@40 -- # local info 00:04:04.917 19:02:23 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:04.917 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.917 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.917 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.917 19:02:23 -- rpc/rpc.sh@42 -- # info='{ 00:04:04.917 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3316061", 00:04:04.917 "tpoint_group_mask": "0x8", 00:04:04.917 "iscsi_conn": { 00:04:04.917 "mask": "0x2", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "scsi": { 00:04:04.917 "mask": "0x4", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "bdev": { 00:04:04.917 "mask": "0x8", 00:04:04.917 "tpoint_mask": "0xffffffffffffffff" 00:04:04.917 }, 00:04:04.917 "nvmf_rdma": { 00:04:04.917 "mask": "0x10", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "nvmf_tcp": { 00:04:04.917 "mask": "0x20", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "ftl": { 00:04:04.917 "mask": "0x40", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "blobfs": { 00:04:04.917 "mask": "0x80", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "dsa": { 00:04:04.917 "mask": "0x200", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "thread": { 00:04:04.917 "mask": "0x400", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "nvme_pcie": { 00:04:04.917 "mask": "0x800", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "iaa": { 00:04:04.917 "mask": "0x1000", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "nvme_tcp": { 00:04:04.917 "mask": "0x2000", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 }, 00:04:04.917 "bdev_nvme": { 00:04:04.917 "mask": "0x4000", 00:04:04.917 "tpoint_mask": "0x0" 00:04:04.917 } 00:04:04.917 }' 00:04:04.917 19:02:23 -- rpc/rpc.sh@43 -- # jq length 00:04:04.917 19:02:23 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:04.917 19:02:23 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:04.917 19:02:23 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:04.917 19:02:23 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:04.917 19:02:23 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:04.917 19:02:23 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:04.917 19:02:23 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:04.917 19:02:23 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:04.917 19:02:23 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:04.917 00:04:04.917 real 0m0.193s 00:04:04.917 user 0m0.172s 00:04:04.917 sys 0m0.015s 00:04:04.918 19:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.918 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.918 ************************************ 00:04:04.918 END TEST rpc_trace_cmd_test 00:04:04.918 ************************************ 00:04:04.918 19:02:23 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:04.918 19:02:23 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:04.918 19:02:23 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:04.918 19:02:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.918 19:02:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.918 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.918 ************************************ 00:04:04.918 START TEST rpc_daemon_integrity 00:04:04.918 ************************************ 00:04:04.918 19:02:23 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:04.918 19:02:23 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:04.918 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:04.918 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:04.918 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:04.918 19:02:23 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:04.918 19:02:23 -- rpc/rpc.sh@13 -- # jq length 00:04:05.176 19:02:23 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:05.176 19:02:23 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:05.176 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.176 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.176 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.176 19:02:23 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:05.176 19:02:23 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:05.176 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.176 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.176 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.176 19:02:23 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:05.176 { 00:04:05.176 "name": "Malloc2", 00:04:05.176 "aliases": [ 00:04:05.176 "9cd2f0d4-0e92-4877-9b08-15a7ac74fe99" 00:04:05.176 ], 00:04:05.176 "product_name": "Malloc disk", 00:04:05.176 "block_size": 512, 00:04:05.176 "num_blocks": 16384, 00:04:05.176 "uuid": "9cd2f0d4-0e92-4877-9b08-15a7ac74fe99", 00:04:05.176 "assigned_rate_limits": { 00:04:05.176 "rw_ios_per_sec": 0, 00:04:05.176 "rw_mbytes_per_sec": 0, 00:04:05.176 "r_mbytes_per_sec": 0, 00:04:05.176 "w_mbytes_per_sec": 0 00:04:05.176 }, 00:04:05.176 "claimed": false, 00:04:05.176 "zoned": false, 00:04:05.176 "supported_io_types": { 00:04:05.176 "read": true, 00:04:05.176 "write": true, 00:04:05.176 "unmap": true, 00:04:05.176 "write_zeroes": true, 00:04:05.176 "flush": true, 00:04:05.176 "reset": true, 00:04:05.176 "compare": false, 00:04:05.176 "compare_and_write": false, 00:04:05.176 "abort": true, 00:04:05.176 "nvme_admin": false, 00:04:05.176 "nvme_io": false 00:04:05.176 }, 00:04:05.176 "memory_domains": [ 00:04:05.176 { 00:04:05.176 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.176 "dma_device_type": 2 00:04:05.176 } 00:04:05.176 ], 00:04:05.176 "driver_specific": {} 00:04:05.176 } 00:04:05.176 ]' 00:04:05.176 19:02:23 -- rpc/rpc.sh@17 -- # jq length 00:04:05.176 19:02:23 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:05.176 19:02:23 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:05.176 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.176 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.176 [2024-11-18 19:02:23.614797] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:05.176 [2024-11-18 19:02:23.614839] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:05.176 [2024-11-18 19:02:23.614862] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x22a1590 00:04:05.176 [2024-11-18 19:02:23.614876] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:05.176 [2024-11-18 19:02:23.616246] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:05.176 [2024-11-18 19:02:23.616273] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:05.176 Passthru0 00:04:05.176 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.176 19:02:23 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:05.176 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.176 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.176 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.176 19:02:23 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:05.176 { 00:04:05.176 "name": "Malloc2", 00:04:05.176 "aliases": [ 00:04:05.176 "9cd2f0d4-0e92-4877-9b08-15a7ac74fe99" 00:04:05.176 ], 00:04:05.176 "product_name": "Malloc disk", 00:04:05.176 "block_size": 512, 00:04:05.176 "num_blocks": 16384, 00:04:05.176 "uuid": "9cd2f0d4-0e92-4877-9b08-15a7ac74fe99", 00:04:05.176 "assigned_rate_limits": { 00:04:05.176 "rw_ios_per_sec": 0, 00:04:05.176 "rw_mbytes_per_sec": 0, 00:04:05.176 "r_mbytes_per_sec": 0, 00:04:05.176 "w_mbytes_per_sec": 0 00:04:05.176 }, 00:04:05.176 "claimed": true, 00:04:05.176 "claim_type": "exclusive_write", 00:04:05.176 "zoned": false, 00:04:05.176 "supported_io_types": { 00:04:05.176 "read": true, 00:04:05.176 "write": true, 00:04:05.176 "unmap": true, 00:04:05.176 "write_zeroes": true, 00:04:05.176 "flush": true, 00:04:05.176 "reset": true, 00:04:05.176 "compare": false, 00:04:05.176 "compare_and_write": false, 00:04:05.176 "abort": true, 00:04:05.176 "nvme_admin": false, 00:04:05.177 "nvme_io": false 00:04:05.177 }, 00:04:05.177 "memory_domains": [ 00:04:05.177 { 00:04:05.177 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.177 "dma_device_type": 2 00:04:05.177 } 00:04:05.177 ], 00:04:05.177 "driver_specific": {} 00:04:05.177 }, 00:04:05.177 { 00:04:05.177 "name": "Passthru0", 00:04:05.177 "aliases": [ 00:04:05.177 "77c1cbcb-9cca-5306-b958-c590846bdfc5" 00:04:05.177 ], 00:04:05.177 "product_name": "passthru", 00:04:05.177 "block_size": 512, 00:04:05.177 "num_blocks": 16384, 00:04:05.177 "uuid": "77c1cbcb-9cca-5306-b958-c590846bdfc5", 00:04:05.177 "assigned_rate_limits": { 00:04:05.177 "rw_ios_per_sec": 0, 00:04:05.177 "rw_mbytes_per_sec": 0, 00:04:05.177 "r_mbytes_per_sec": 0, 00:04:05.177 "w_mbytes_per_sec": 0 00:04:05.177 }, 00:04:05.177 "claimed": false, 00:04:05.177 "zoned": false, 00:04:05.177 "supported_io_types": { 00:04:05.177 "read": true, 00:04:05.177 "write": true, 00:04:05.177 "unmap": true, 00:04:05.177 "write_zeroes": true, 00:04:05.177 "flush": true, 00:04:05.177 "reset": true, 00:04:05.177 "compare": false, 00:04:05.177 "compare_and_write": false, 00:04:05.177 "abort": true, 00:04:05.177 "nvme_admin": false, 00:04:05.177 "nvme_io": false 00:04:05.177 }, 00:04:05.177 "memory_domains": [ 00:04:05.177 { 00:04:05.177 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:05.177 "dma_device_type": 2 00:04:05.177 } 00:04:05.177 ], 00:04:05.177 "driver_specific": { 00:04:05.177 "passthru": { 00:04:05.177 "name": "Passthru0", 00:04:05.177 "base_bdev_name": "Malloc2" 00:04:05.177 } 00:04:05.177 } 00:04:05.177 } 00:04:05.177 ]' 00:04:05.177 19:02:23 -- rpc/rpc.sh@21 -- # jq length 00:04:05.177 19:02:23 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:05.177 19:02:23 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:05.177 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.177 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.177 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.177 19:02:23 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:05.177 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.177 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.177 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.177 19:02:23 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:05.177 19:02:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:05.177 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.177 19:02:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:05.177 19:02:23 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:05.177 19:02:23 -- rpc/rpc.sh@26 -- # jq length 00:04:05.177 19:02:23 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:05.177 00:04:05.177 real 0m0.221s 00:04:05.177 user 0m0.147s 00:04:05.177 sys 0m0.016s 00:04:05.177 19:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.177 19:02:23 -- common/autotest_common.sh@10 -- # set +x 00:04:05.177 ************************************ 00:04:05.177 END TEST rpc_daemon_integrity 00:04:05.177 ************************************ 00:04:05.177 19:02:23 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:05.177 19:02:23 -- rpc/rpc.sh@84 -- # killprocess 3316061 00:04:05.177 19:02:23 -- common/autotest_common.sh@936 -- # '[' -z 3316061 ']' 00:04:05.177 19:02:23 -- common/autotest_common.sh@940 -- # kill -0 3316061 00:04:05.177 19:02:23 -- common/autotest_common.sh@941 -- # uname 00:04:05.177 19:02:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:05.177 19:02:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3316061 00:04:05.436 19:02:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:05.436 19:02:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:05.436 19:02:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3316061' 00:04:05.436 killing process with pid 3316061 00:04:05.436 19:02:23 -- common/autotest_common.sh@955 -- # kill 3316061 00:04:05.436 19:02:23 -- common/autotest_common.sh@960 -- # wait 3316061 00:04:05.694 00:04:05.694 real 0m2.484s 00:04:05.694 user 0m3.126s 00:04:05.694 sys 0m0.585s 00:04:05.694 19:02:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.694 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:05.694 ************************************ 00:04:05.694 END TEST rpc 00:04:05.694 ************************************ 00:04:05.694 19:02:24 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:05.694 19:02:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.694 19:02:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.694 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:05.694 ************************************ 00:04:05.694 START TEST rpc_client 00:04:05.694 ************************************ 00:04:05.694 19:02:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:05.953 * Looking for test storage... 00:04:05.953 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:05.953 19:02:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:05.953 19:02:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:05.953 19:02:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:05.953 19:02:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:05.953 19:02:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:05.953 19:02:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:05.953 19:02:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:05.953 19:02:24 -- scripts/common.sh@335 -- # IFS=.-: 00:04:05.953 19:02:24 -- scripts/common.sh@335 -- # read -ra ver1 00:04:05.953 19:02:24 -- scripts/common.sh@336 -- # IFS=.-: 00:04:05.953 19:02:24 -- scripts/common.sh@336 -- # read -ra ver2 00:04:05.953 19:02:24 -- scripts/common.sh@337 -- # local 'op=<' 00:04:05.953 19:02:24 -- scripts/common.sh@339 -- # ver1_l=2 00:04:05.953 19:02:24 -- scripts/common.sh@340 -- # ver2_l=1 00:04:05.953 19:02:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:05.953 19:02:24 -- scripts/common.sh@343 -- # case "$op" in 00:04:05.953 19:02:24 -- scripts/common.sh@344 -- # : 1 00:04:05.953 19:02:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:05.953 19:02:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:05.953 19:02:24 -- scripts/common.sh@364 -- # decimal 1 00:04:05.953 19:02:24 -- scripts/common.sh@352 -- # local d=1 00:04:05.953 19:02:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:05.953 19:02:24 -- scripts/common.sh@354 -- # echo 1 00:04:05.953 19:02:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:05.953 19:02:24 -- scripts/common.sh@365 -- # decimal 2 00:04:05.953 19:02:24 -- scripts/common.sh@352 -- # local d=2 00:04:05.953 19:02:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:05.953 19:02:24 -- scripts/common.sh@354 -- # echo 2 00:04:05.953 19:02:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:05.953 19:02:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:05.953 19:02:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:05.953 19:02:24 -- scripts/common.sh@367 -- # return 0 00:04:05.953 19:02:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:05.953 19:02:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.953 --rc genhtml_branch_coverage=1 00:04:05.953 --rc genhtml_function_coverage=1 00:04:05.953 --rc genhtml_legend=1 00:04:05.953 --rc geninfo_all_blocks=1 00:04:05.953 --rc geninfo_unexecuted_blocks=1 00:04:05.953 00:04:05.953 ' 00:04:05.953 19:02:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.953 --rc genhtml_branch_coverage=1 00:04:05.953 --rc genhtml_function_coverage=1 00:04:05.953 --rc genhtml_legend=1 00:04:05.953 --rc geninfo_all_blocks=1 00:04:05.953 --rc geninfo_unexecuted_blocks=1 00:04:05.953 00:04:05.953 ' 00:04:05.953 19:02:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.953 --rc genhtml_branch_coverage=1 00:04:05.953 --rc genhtml_function_coverage=1 00:04:05.953 --rc genhtml_legend=1 00:04:05.953 --rc geninfo_all_blocks=1 00:04:05.953 --rc geninfo_unexecuted_blocks=1 00:04:05.953 00:04:05.953 ' 00:04:05.953 19:02:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:05.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:05.953 --rc genhtml_branch_coverage=1 00:04:05.953 --rc genhtml_function_coverage=1 00:04:05.953 --rc genhtml_legend=1 00:04:05.953 --rc geninfo_all_blocks=1 00:04:05.953 --rc geninfo_unexecuted_blocks=1 00:04:05.953 00:04:05.953 ' 00:04:05.953 19:02:24 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:05.953 OK 00:04:05.953 19:02:24 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:05.953 00:04:05.953 real 0m0.156s 00:04:05.953 user 0m0.101s 00:04:05.953 sys 0m0.063s 00:04:05.953 19:02:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.953 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:05.953 ************************************ 00:04:05.953 END TEST rpc_client 00:04:05.953 ************************************ 00:04:05.953 19:02:24 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:05.953 19:02:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.953 19:02:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.953 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:05.953 ************************************ 00:04:05.953 START TEST json_config 00:04:05.953 ************************************ 00:04:05.953 19:02:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:05.953 19:02:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:05.953 19:02:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:05.953 19:02:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:06.212 19:02:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:06.212 19:02:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:06.212 19:02:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:06.212 19:02:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:06.212 19:02:24 -- scripts/common.sh@335 -- # IFS=.-: 00:04:06.212 19:02:24 -- scripts/common.sh@335 -- # read -ra ver1 00:04:06.212 19:02:24 -- scripts/common.sh@336 -- # IFS=.-: 00:04:06.212 19:02:24 -- scripts/common.sh@336 -- # read -ra ver2 00:04:06.212 19:02:24 -- scripts/common.sh@337 -- # local 'op=<' 00:04:06.212 19:02:24 -- scripts/common.sh@339 -- # ver1_l=2 00:04:06.212 19:02:24 -- scripts/common.sh@340 -- # ver2_l=1 00:04:06.212 19:02:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:06.212 19:02:24 -- scripts/common.sh@343 -- # case "$op" in 00:04:06.212 19:02:24 -- scripts/common.sh@344 -- # : 1 00:04:06.212 19:02:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:06.212 19:02:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:06.212 19:02:24 -- scripts/common.sh@364 -- # decimal 1 00:04:06.212 19:02:24 -- scripts/common.sh@352 -- # local d=1 00:04:06.212 19:02:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:06.212 19:02:24 -- scripts/common.sh@354 -- # echo 1 00:04:06.212 19:02:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:06.212 19:02:24 -- scripts/common.sh@365 -- # decimal 2 00:04:06.212 19:02:24 -- scripts/common.sh@352 -- # local d=2 00:04:06.212 19:02:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:06.212 19:02:24 -- scripts/common.sh@354 -- # echo 2 00:04:06.212 19:02:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:06.212 19:02:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:06.212 19:02:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:06.212 19:02:24 -- scripts/common.sh@367 -- # return 0 00:04:06.212 19:02:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:06.212 19:02:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:06.212 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.212 --rc genhtml_branch_coverage=1 00:04:06.212 --rc genhtml_function_coverage=1 00:04:06.212 --rc genhtml_legend=1 00:04:06.212 --rc geninfo_all_blocks=1 00:04:06.212 --rc geninfo_unexecuted_blocks=1 00:04:06.212 00:04:06.212 ' 00:04:06.212 19:02:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:06.212 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.212 --rc genhtml_branch_coverage=1 00:04:06.212 --rc genhtml_function_coverage=1 00:04:06.212 --rc genhtml_legend=1 00:04:06.212 --rc geninfo_all_blocks=1 00:04:06.212 --rc geninfo_unexecuted_blocks=1 00:04:06.212 00:04:06.212 ' 00:04:06.212 19:02:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:06.212 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.212 --rc genhtml_branch_coverage=1 00:04:06.212 --rc genhtml_function_coverage=1 00:04:06.212 --rc genhtml_legend=1 00:04:06.212 --rc geninfo_all_blocks=1 00:04:06.212 --rc geninfo_unexecuted_blocks=1 00:04:06.212 00:04:06.212 ' 00:04:06.212 19:02:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:06.212 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:06.212 --rc genhtml_branch_coverage=1 00:04:06.212 --rc genhtml_function_coverage=1 00:04:06.212 --rc genhtml_legend=1 00:04:06.212 --rc geninfo_all_blocks=1 00:04:06.212 --rc geninfo_unexecuted_blocks=1 00:04:06.212 00:04:06.212 ' 00:04:06.212 19:02:24 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:06.212 19:02:24 -- nvmf/common.sh@7 -- # uname -s 00:04:06.212 19:02:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:06.212 19:02:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:06.212 19:02:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:06.212 19:02:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:06.212 19:02:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:06.212 19:02:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:06.212 19:02:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:06.212 19:02:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:06.212 19:02:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:06.212 19:02:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:06.212 19:02:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:06.212 19:02:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:06.212 19:02:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:06.212 19:02:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:06.212 19:02:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:06.212 19:02:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:06.212 19:02:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:06.212 19:02:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:06.212 19:02:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:06.212 19:02:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.212 19:02:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.213 19:02:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.213 19:02:24 -- paths/export.sh@5 -- # export PATH 00:04:06.213 19:02:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:06.213 19:02:24 -- nvmf/common.sh@46 -- # : 0 00:04:06.213 19:02:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:06.213 19:02:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:06.213 19:02:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:06.213 19:02:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:06.213 19:02:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:06.213 19:02:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:06.213 19:02:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:06.213 19:02:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:06.213 19:02:24 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:06.213 19:02:24 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:06.213 19:02:24 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:06.213 19:02:24 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:06.213 19:02:24 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:06.213 19:02:24 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:06.213 19:02:24 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:06.213 19:02:24 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:06.213 19:02:24 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:06.213 19:02:24 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:06.213 19:02:24 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:06.213 19:02:24 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:06.213 INFO: JSON configuration test init 00:04:06.213 19:02:24 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:06.213 19:02:24 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:06.213 19:02:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:06.213 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:06.213 19:02:24 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:06.213 19:02:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:06.213 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:06.213 19:02:24 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:06.213 19:02:24 -- json_config/json_config.sh@98 -- # local app=target 00:04:06.213 19:02:24 -- json_config/json_config.sh@99 -- # shift 00:04:06.213 19:02:24 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:06.213 19:02:24 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:06.213 19:02:24 -- json_config/json_config.sh@111 -- # app_pid[$app]=3316624 00:04:06.213 19:02:24 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:06.213 19:02:24 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:06.213 Waiting for target to run... 00:04:06.213 19:02:24 -- json_config/json_config.sh@114 -- # waitforlisten 3316624 /var/tmp/spdk_tgt.sock 00:04:06.213 19:02:24 -- common/autotest_common.sh@829 -- # '[' -z 3316624 ']' 00:04:06.213 19:02:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:06.213 19:02:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:06.213 19:02:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:06.213 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:06.213 19:02:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:06.213 19:02:24 -- common/autotest_common.sh@10 -- # set +x 00:04:06.213 [2024-11-18 19:02:24.670744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:06.213 [2024-11-18 19:02:24.670836] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3316624 ] 00:04:06.213 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.471 [2024-11-18 19:02:25.027584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:06.729 [2024-11-18 19:02:25.114739] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:06.729 [2024-11-18 19:02:25.114919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:07.304 19:02:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:07.304 19:02:25 -- common/autotest_common.sh@862 -- # return 0 00:04:07.304 19:02:25 -- json_config/json_config.sh@115 -- # echo '' 00:04:07.304 00:04:07.304 19:02:25 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:07.304 19:02:25 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:07.304 19:02:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:07.304 19:02:25 -- common/autotest_common.sh@10 -- # set +x 00:04:07.304 19:02:25 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:07.304 19:02:25 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:07.304 19:02:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:07.304 19:02:25 -- common/autotest_common.sh@10 -- # set +x 00:04:07.304 19:02:25 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:07.304 19:02:25 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:07.304 19:02:25 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:10.585 19:02:28 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:10.585 19:02:28 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:10.586 19:02:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.586 19:02:28 -- common/autotest_common.sh@10 -- # set +x 00:04:10.586 19:02:28 -- json_config/json_config.sh@48 -- # local ret=0 00:04:10.586 19:02:28 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:10.586 19:02:28 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:10.586 19:02:28 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:10.586 19:02:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:10.586 19:02:28 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:10.586 19:02:29 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:10.586 19:02:29 -- json_config/json_config.sh@51 -- # local get_types 00:04:10.586 19:02:29 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:10.586 19:02:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:10.586 19:02:29 -- common/autotest_common.sh@10 -- # set +x 00:04:10.586 19:02:29 -- json_config/json_config.sh@58 -- # return 0 00:04:10.586 19:02:29 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:10.586 19:02:29 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:10.586 19:02:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:10.586 19:02:29 -- common/autotest_common.sh@10 -- # set +x 00:04:10.586 19:02:29 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:10.586 19:02:29 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:10.586 19:02:29 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:10.586 19:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:10.843 MallocForNvmf0 00:04:10.843 19:02:29 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:10.843 19:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:11.100 MallocForNvmf1 00:04:11.100 19:02:29 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:11.100 19:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:11.357 [2024-11-18 19:02:29.884030] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:11.357 19:02:29 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:11.358 19:02:29 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:11.616 19:02:30 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:11.616 19:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:11.875 19:02:30 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:11.875 19:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:12.133 19:02:30 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:12.133 19:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:12.390 [2024-11-18 19:02:30.931514] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:12.390 19:02:30 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:12.390 19:02:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.390 19:02:30 -- common/autotest_common.sh@10 -- # set +x 00:04:12.390 19:02:30 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:12.390 19:02:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.390 19:02:30 -- common/autotest_common.sh@10 -- # set +x 00:04:12.648 19:02:30 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:12.648 19:02:30 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:12.648 19:02:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:12.648 MallocBdevForConfigChangeCheck 00:04:12.648 19:02:31 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:12.648 19:02:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.648 19:02:31 -- common/autotest_common.sh@10 -- # set +x 00:04:12.906 19:02:31 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:12.906 19:02:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:13.164 19:02:31 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:13.164 INFO: shutting down applications... 00:04:13.164 19:02:31 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:13.164 19:02:31 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:13.164 19:02:31 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:13.164 19:02:31 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:15.063 Calling clear_iscsi_subsystem 00:04:15.063 Calling clear_nvmf_subsystem 00:04:15.063 Calling clear_nbd_subsystem 00:04:15.063 Calling clear_ublk_subsystem 00:04:15.063 Calling clear_vhost_blk_subsystem 00:04:15.063 Calling clear_vhost_scsi_subsystem 00:04:15.063 Calling clear_scheduler_subsystem 00:04:15.063 Calling clear_bdev_subsystem 00:04:15.063 Calling clear_accel_subsystem 00:04:15.063 Calling clear_vmd_subsystem 00:04:15.063 Calling clear_sock_subsystem 00:04:15.063 Calling clear_iobuf_subsystem 00:04:15.063 19:02:33 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:15.063 19:02:33 -- json_config/json_config.sh@396 -- # count=100 00:04:15.063 19:02:33 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:15.063 19:02:33 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:15.063 19:02:33 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:15.063 19:02:33 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:15.063 19:02:33 -- json_config/json_config.sh@398 -- # break 00:04:15.063 19:02:33 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:15.063 19:02:33 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:15.063 19:02:33 -- json_config/json_config.sh@120 -- # local app=target 00:04:15.063 19:02:33 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:15.063 19:02:33 -- json_config/json_config.sh@124 -- # [[ -n 3316624 ]] 00:04:15.063 19:02:33 -- json_config/json_config.sh@127 -- # kill -SIGINT 3316624 00:04:15.063 19:02:33 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:15.063 19:02:33 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:15.063 19:02:33 -- json_config/json_config.sh@130 -- # kill -0 3316624 00:04:15.063 19:02:33 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:15.628 19:02:34 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:15.628 19:02:34 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:15.628 19:02:34 -- json_config/json_config.sh@130 -- # kill -0 3316624 00:04:15.628 19:02:34 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:15.628 19:02:34 -- json_config/json_config.sh@132 -- # break 00:04:15.628 19:02:34 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:15.629 19:02:34 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:15.629 SPDK target shutdown done 00:04:15.629 19:02:34 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:15.629 INFO: relaunching applications... 00:04:15.629 19:02:34 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:15.629 19:02:34 -- json_config/json_config.sh@98 -- # local app=target 00:04:15.629 19:02:34 -- json_config/json_config.sh@99 -- # shift 00:04:15.629 19:02:34 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:15.629 19:02:34 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:15.629 19:02:34 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:15.629 19:02:34 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:15.629 19:02:34 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:15.629 19:02:34 -- json_config/json_config.sh@111 -- # app_pid[$app]=3317907 00:04:15.629 19:02:34 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:15.629 19:02:34 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:15.629 Waiting for target to run... 00:04:15.629 19:02:34 -- json_config/json_config.sh@114 -- # waitforlisten 3317907 /var/tmp/spdk_tgt.sock 00:04:15.629 19:02:34 -- common/autotest_common.sh@829 -- # '[' -z 3317907 ']' 00:04:15.629 19:02:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:15.629 19:02:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:15.629 19:02:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:15.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:15.629 19:02:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:15.629 19:02:34 -- common/autotest_common.sh@10 -- # set +x 00:04:15.629 [2024-11-18 19:02:34.212683] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:15.629 [2024-11-18 19:02:34.212764] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3317907 ] 00:04:15.886 EAL: No free 2048 kB hugepages reported on node 1 00:04:16.144 [2024-11-18 19:02:34.742775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:16.402 [2024-11-18 19:02:34.847678] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:16.402 [2024-11-18 19:02:34.847888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:19.682 [2024-11-18 19:02:37.876576] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:19.682 [2024-11-18 19:02:37.909079] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:19.682 19:02:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:19.682 19:02:38 -- common/autotest_common.sh@862 -- # return 0 00:04:19.682 19:02:38 -- json_config/json_config.sh@115 -- # echo '' 00:04:19.682 00:04:19.682 19:02:38 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:19.682 19:02:38 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:19.682 INFO: Checking if target configuration is the same... 00:04:19.682 19:02:38 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.682 19:02:38 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:19.682 19:02:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:19.682 + '[' 2 -ne 2 ']' 00:04:19.682 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:19.682 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:19.682 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:19.682 +++ basename /dev/fd/62 00:04:19.682 ++ mktemp /tmp/62.XXX 00:04:19.682 + tmp_file_1=/tmp/62.yrp 00:04:19.682 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:19.682 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:19.682 + tmp_file_2=/tmp/spdk_tgt_config.json.4IX 00:04:19.682 + ret=0 00:04:19.682 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:19.940 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.197 + diff -u /tmp/62.yrp /tmp/spdk_tgt_config.json.4IX 00:04:20.197 + echo 'INFO: JSON config files are the same' 00:04:20.197 INFO: JSON config files are the same 00:04:20.197 + rm /tmp/62.yrp /tmp/spdk_tgt_config.json.4IX 00:04:20.197 + exit 0 00:04:20.197 19:02:38 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:20.197 19:02:38 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:20.197 INFO: changing configuration and checking if this can be detected... 00:04:20.197 19:02:38 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:20.197 19:02:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:20.455 19:02:38 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:20.455 19:02:38 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:20.455 19:02:38 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:20.455 + '[' 2 -ne 2 ']' 00:04:20.455 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:20.455 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:20.455 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:20.455 +++ basename /dev/fd/62 00:04:20.455 ++ mktemp /tmp/62.XXX 00:04:20.455 + tmp_file_1=/tmp/62.373 00:04:20.455 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:20.455 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:20.455 + tmp_file_2=/tmp/spdk_tgt_config.json.w6q 00:04:20.455 + ret=0 00:04:20.455 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.713 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:20.713 + diff -u /tmp/62.373 /tmp/spdk_tgt_config.json.w6q 00:04:20.713 + ret=1 00:04:20.713 + echo '=== Start of file: /tmp/62.373 ===' 00:04:20.713 + cat /tmp/62.373 00:04:20.713 + echo '=== End of file: /tmp/62.373 ===' 00:04:20.713 + echo '' 00:04:20.713 + echo '=== Start of file: /tmp/spdk_tgt_config.json.w6q ===' 00:04:20.713 + cat /tmp/spdk_tgt_config.json.w6q 00:04:20.713 + echo '=== End of file: /tmp/spdk_tgt_config.json.w6q ===' 00:04:20.713 + echo '' 00:04:20.713 + rm /tmp/62.373 /tmp/spdk_tgt_config.json.w6q 00:04:20.713 + exit 1 00:04:20.713 19:02:39 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:20.713 INFO: configuration change detected. 00:04:20.713 19:02:39 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:20.713 19:02:39 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:20.713 19:02:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.713 19:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:20.713 19:02:39 -- json_config/json_config.sh@360 -- # local ret=0 00:04:20.713 19:02:39 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:20.713 19:02:39 -- json_config/json_config.sh@370 -- # [[ -n 3317907 ]] 00:04:20.713 19:02:39 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:20.713 19:02:39 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:20.713 19:02:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.713 19:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:20.713 19:02:39 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:20.713 19:02:39 -- json_config/json_config.sh@246 -- # uname -s 00:04:20.714 19:02:39 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:20.714 19:02:39 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:20.714 19:02:39 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:20.714 19:02:39 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:20.714 19:02:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:20.714 19:02:39 -- common/autotest_common.sh@10 -- # set +x 00:04:20.714 19:02:39 -- json_config/json_config.sh@376 -- # killprocess 3317907 00:04:20.714 19:02:39 -- common/autotest_common.sh@936 -- # '[' -z 3317907 ']' 00:04:20.714 19:02:39 -- common/autotest_common.sh@940 -- # kill -0 3317907 00:04:20.714 19:02:39 -- common/autotest_common.sh@941 -- # uname 00:04:20.714 19:02:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:20.714 19:02:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3317907 00:04:20.714 19:02:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:20.714 19:02:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:20.714 19:02:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3317907' 00:04:20.714 killing process with pid 3317907 00:04:20.714 19:02:39 -- common/autotest_common.sh@955 -- # kill 3317907 00:04:20.714 19:02:39 -- common/autotest_common.sh@960 -- # wait 3317907 00:04:22.613 19:02:40 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:22.613 19:02:40 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:22.613 19:02:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:22.613 19:02:40 -- common/autotest_common.sh@10 -- # set +x 00:04:22.613 19:02:40 -- json_config/json_config.sh@381 -- # return 0 00:04:22.613 19:02:40 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:22.613 INFO: Success 00:04:22.613 00:04:22.613 real 0m16.530s 00:04:22.613 user 0m19.105s 00:04:22.613 sys 0m2.189s 00:04:22.613 19:02:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.613 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:04:22.613 ************************************ 00:04:22.613 END TEST json_config 00:04:22.613 ************************************ 00:04:22.613 19:02:41 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:22.613 19:02:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.613 19:02:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.613 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:04:22.613 ************************************ 00:04:22.613 START TEST json_config_extra_key 00:04:22.613 ************************************ 00:04:22.613 19:02:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:22.613 19:02:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:22.613 19:02:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:22.613 19:02:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:22.613 19:02:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:22.613 19:02:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:22.613 19:02:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:22.613 19:02:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:22.613 19:02:41 -- scripts/common.sh@335 -- # IFS=.-: 00:04:22.613 19:02:41 -- scripts/common.sh@335 -- # read -ra ver1 00:04:22.613 19:02:41 -- scripts/common.sh@336 -- # IFS=.-: 00:04:22.613 19:02:41 -- scripts/common.sh@336 -- # read -ra ver2 00:04:22.613 19:02:41 -- scripts/common.sh@337 -- # local 'op=<' 00:04:22.613 19:02:41 -- scripts/common.sh@339 -- # ver1_l=2 00:04:22.613 19:02:41 -- scripts/common.sh@340 -- # ver2_l=1 00:04:22.613 19:02:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:22.613 19:02:41 -- scripts/common.sh@343 -- # case "$op" in 00:04:22.613 19:02:41 -- scripts/common.sh@344 -- # : 1 00:04:22.613 19:02:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:22.613 19:02:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:22.613 19:02:41 -- scripts/common.sh@364 -- # decimal 1 00:04:22.613 19:02:41 -- scripts/common.sh@352 -- # local d=1 00:04:22.613 19:02:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:22.613 19:02:41 -- scripts/common.sh@354 -- # echo 1 00:04:22.613 19:02:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:22.613 19:02:41 -- scripts/common.sh@365 -- # decimal 2 00:04:22.613 19:02:41 -- scripts/common.sh@352 -- # local d=2 00:04:22.613 19:02:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:22.613 19:02:41 -- scripts/common.sh@354 -- # echo 2 00:04:22.613 19:02:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:22.613 19:02:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:22.613 19:02:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:22.613 19:02:41 -- scripts/common.sh@367 -- # return 0 00:04:22.613 19:02:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:22.613 19:02:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:22.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.613 --rc genhtml_branch_coverage=1 00:04:22.613 --rc genhtml_function_coverage=1 00:04:22.613 --rc genhtml_legend=1 00:04:22.613 --rc geninfo_all_blocks=1 00:04:22.613 --rc geninfo_unexecuted_blocks=1 00:04:22.613 00:04:22.613 ' 00:04:22.613 19:02:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:22.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.613 --rc genhtml_branch_coverage=1 00:04:22.613 --rc genhtml_function_coverage=1 00:04:22.613 --rc genhtml_legend=1 00:04:22.613 --rc geninfo_all_blocks=1 00:04:22.613 --rc geninfo_unexecuted_blocks=1 00:04:22.613 00:04:22.613 ' 00:04:22.613 19:02:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:22.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.613 --rc genhtml_branch_coverage=1 00:04:22.613 --rc genhtml_function_coverage=1 00:04:22.613 --rc genhtml_legend=1 00:04:22.613 --rc geninfo_all_blocks=1 00:04:22.613 --rc geninfo_unexecuted_blocks=1 00:04:22.613 00:04:22.613 ' 00:04:22.613 19:02:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:22.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.613 --rc genhtml_branch_coverage=1 00:04:22.613 --rc genhtml_function_coverage=1 00:04:22.613 --rc genhtml_legend=1 00:04:22.613 --rc geninfo_all_blocks=1 00:04:22.613 --rc geninfo_unexecuted_blocks=1 00:04:22.613 00:04:22.613 ' 00:04:22.613 19:02:41 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:22.613 19:02:41 -- nvmf/common.sh@7 -- # uname -s 00:04:22.613 19:02:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:22.613 19:02:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:22.613 19:02:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:22.613 19:02:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:22.613 19:02:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:22.613 19:02:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:22.613 19:02:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:22.613 19:02:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:22.613 19:02:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:22.613 19:02:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:22.613 19:02:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:22.613 19:02:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:22.613 19:02:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:22.613 19:02:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:22.613 19:02:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:22.613 19:02:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:22.613 19:02:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:22.613 19:02:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:22.613 19:02:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:22.613 19:02:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:22.613 19:02:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:22.613 19:02:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:22.613 19:02:41 -- paths/export.sh@5 -- # export PATH 00:04:22.613 19:02:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:22.613 19:02:41 -- nvmf/common.sh@46 -- # : 0 00:04:22.613 19:02:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:22.613 19:02:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:22.613 19:02:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:22.614 19:02:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:22.614 19:02:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:22.614 19:02:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:22.614 19:02:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:22.614 19:02:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:22.614 INFO: launching applications... 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=3318857 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:22.614 Waiting for target to run... 00:04:22.614 19:02:41 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 3318857 /var/tmp/spdk_tgt.sock 00:04:22.614 19:02:41 -- common/autotest_common.sh@829 -- # '[' -z 3318857 ']' 00:04:22.614 19:02:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:22.614 19:02:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:22.614 19:02:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:22.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:22.614 19:02:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:22.614 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:04:22.614 [2024-11-18 19:02:41.210437] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:22.614 [2024-11-18 19:02:41.210534] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3318857 ] 00:04:22.872 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.131 [2024-11-18 19:02:41.564690] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.131 [2024-11-18 19:02:41.650590] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:23.131 [2024-11-18 19:02:41.650797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.696 19:02:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:23.696 19:02:42 -- common/autotest_common.sh@862 -- # return 0 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:23.696 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:23.696 INFO: shutting down applications... 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 3318857 ]] 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 3318857 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3318857 00:04:23.696 19:02:42 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@50 -- # kill -0 3318857 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:24.261 SPDK target shutdown done 00:04:24.261 19:02:42 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:24.261 Success 00:04:24.261 00:04:24.261 real 0m1.655s 00:04:24.261 user 0m1.677s 00:04:24.261 sys 0m0.435s 00:04:24.261 19:02:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.261 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:04:24.261 ************************************ 00:04:24.261 END TEST json_config_extra_key 00:04:24.261 ************************************ 00:04:24.261 19:02:42 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:24.261 19:02:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.261 19:02:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.261 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:04:24.261 ************************************ 00:04:24.261 START TEST alias_rpc 00:04:24.261 ************************************ 00:04:24.261 19:02:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:24.261 * Looking for test storage... 00:04:24.261 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:24.261 19:02:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:24.261 19:02:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:24.261 19:02:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:24.261 19:02:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:24.261 19:02:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:24.261 19:02:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:24.261 19:02:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:24.262 19:02:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:24.262 19:02:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:24.262 19:02:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:24.262 19:02:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:24.262 19:02:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:24.262 19:02:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:24.262 19:02:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:24.262 19:02:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:24.262 19:02:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:24.262 19:02:42 -- scripts/common.sh@344 -- # : 1 00:04:24.262 19:02:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:24.262 19:02:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:24.262 19:02:42 -- scripts/common.sh@364 -- # decimal 1 00:04:24.262 19:02:42 -- scripts/common.sh@352 -- # local d=1 00:04:24.262 19:02:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:24.262 19:02:42 -- scripts/common.sh@354 -- # echo 1 00:04:24.262 19:02:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:24.262 19:02:42 -- scripts/common.sh@365 -- # decimal 2 00:04:24.262 19:02:42 -- scripts/common.sh@352 -- # local d=2 00:04:24.262 19:02:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:24.262 19:02:42 -- scripts/common.sh@354 -- # echo 2 00:04:24.262 19:02:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:24.262 19:02:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:24.262 19:02:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:24.262 19:02:42 -- scripts/common.sh@367 -- # return 0 00:04:24.262 19:02:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:24.262 19:02:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.262 --rc genhtml_branch_coverage=1 00:04:24.262 --rc genhtml_function_coverage=1 00:04:24.262 --rc genhtml_legend=1 00:04:24.262 --rc geninfo_all_blocks=1 00:04:24.262 --rc geninfo_unexecuted_blocks=1 00:04:24.262 00:04:24.262 ' 00:04:24.262 19:02:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.262 --rc genhtml_branch_coverage=1 00:04:24.262 --rc genhtml_function_coverage=1 00:04:24.262 --rc genhtml_legend=1 00:04:24.262 --rc geninfo_all_blocks=1 00:04:24.262 --rc geninfo_unexecuted_blocks=1 00:04:24.262 00:04:24.262 ' 00:04:24.262 19:02:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.262 --rc genhtml_branch_coverage=1 00:04:24.262 --rc genhtml_function_coverage=1 00:04:24.262 --rc genhtml_legend=1 00:04:24.262 --rc geninfo_all_blocks=1 00:04:24.262 --rc geninfo_unexecuted_blocks=1 00:04:24.262 00:04:24.262 ' 00:04:24.262 19:02:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:24.262 --rc genhtml_branch_coverage=1 00:04:24.262 --rc genhtml_function_coverage=1 00:04:24.262 --rc genhtml_legend=1 00:04:24.262 --rc geninfo_all_blocks=1 00:04:24.262 --rc geninfo_unexecuted_blocks=1 00:04:24.262 00:04:24.262 ' 00:04:24.262 19:02:42 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:24.262 19:02:42 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3319171 00:04:24.262 19:02:42 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:24.262 19:02:42 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3319171 00:04:24.262 19:02:42 -- common/autotest_common.sh@829 -- # '[' -z 3319171 ']' 00:04:24.262 19:02:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.262 19:02:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:24.262 19:02:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.262 19:02:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:24.262 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:04:24.521 [2024-11-18 19:02:42.887358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:24.521 [2024-11-18 19:02:42.887454] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3319171 ] 00:04:24.521 EAL: No free 2048 kB hugepages reported on node 1 00:04:24.521 [2024-11-18 19:02:42.945886] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:24.521 [2024-11-18 19:02:43.052916] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:24.521 [2024-11-18 19:02:43.053090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.570 19:02:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:25.570 19:02:43 -- common/autotest_common.sh@862 -- # return 0 00:04:25.570 19:02:43 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:25.827 19:02:44 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3319171 00:04:25.827 19:02:44 -- common/autotest_common.sh@936 -- # '[' -z 3319171 ']' 00:04:25.827 19:02:44 -- common/autotest_common.sh@940 -- # kill -0 3319171 00:04:25.827 19:02:44 -- common/autotest_common.sh@941 -- # uname 00:04:25.827 19:02:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:25.827 19:02:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3319171 00:04:25.827 19:02:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:25.827 19:02:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:25.827 19:02:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3319171' 00:04:25.827 killing process with pid 3319171 00:04:25.827 19:02:44 -- common/autotest_common.sh@955 -- # kill 3319171 00:04:25.827 19:02:44 -- common/autotest_common.sh@960 -- # wait 3319171 00:04:26.086 00:04:26.086 real 0m1.962s 00:04:26.086 user 0m2.298s 00:04:26.086 sys 0m0.483s 00:04:26.086 19:02:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:26.086 19:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:26.086 ************************************ 00:04:26.086 END TEST alias_rpc 00:04:26.086 ************************************ 00:04:26.344 19:02:44 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:26.344 19:02:44 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:26.344 19:02:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:26.344 19:02:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:26.344 19:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:26.344 ************************************ 00:04:26.344 START TEST spdkcli_tcp 00:04:26.344 ************************************ 00:04:26.344 19:02:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:26.344 * Looking for test storage... 00:04:26.344 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:26.344 19:02:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:26.344 19:02:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:26.344 19:02:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:26.344 19:02:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:26.344 19:02:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:26.344 19:02:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:26.344 19:02:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:26.344 19:02:44 -- scripts/common.sh@335 -- # IFS=.-: 00:04:26.344 19:02:44 -- scripts/common.sh@335 -- # read -ra ver1 00:04:26.344 19:02:44 -- scripts/common.sh@336 -- # IFS=.-: 00:04:26.344 19:02:44 -- scripts/common.sh@336 -- # read -ra ver2 00:04:26.344 19:02:44 -- scripts/common.sh@337 -- # local 'op=<' 00:04:26.344 19:02:44 -- scripts/common.sh@339 -- # ver1_l=2 00:04:26.344 19:02:44 -- scripts/common.sh@340 -- # ver2_l=1 00:04:26.345 19:02:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:26.345 19:02:44 -- scripts/common.sh@343 -- # case "$op" in 00:04:26.345 19:02:44 -- scripts/common.sh@344 -- # : 1 00:04:26.345 19:02:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:26.345 19:02:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:26.345 19:02:44 -- scripts/common.sh@364 -- # decimal 1 00:04:26.345 19:02:44 -- scripts/common.sh@352 -- # local d=1 00:04:26.345 19:02:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:26.345 19:02:44 -- scripts/common.sh@354 -- # echo 1 00:04:26.345 19:02:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:26.345 19:02:44 -- scripts/common.sh@365 -- # decimal 2 00:04:26.345 19:02:44 -- scripts/common.sh@352 -- # local d=2 00:04:26.345 19:02:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:26.345 19:02:44 -- scripts/common.sh@354 -- # echo 2 00:04:26.345 19:02:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:26.345 19:02:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:26.345 19:02:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:26.345 19:02:44 -- scripts/common.sh@367 -- # return 0 00:04:26.345 19:02:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:26.345 19:02:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:26.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.345 --rc genhtml_branch_coverage=1 00:04:26.345 --rc genhtml_function_coverage=1 00:04:26.345 --rc genhtml_legend=1 00:04:26.345 --rc geninfo_all_blocks=1 00:04:26.345 --rc geninfo_unexecuted_blocks=1 00:04:26.345 00:04:26.345 ' 00:04:26.345 19:02:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:26.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.345 --rc genhtml_branch_coverage=1 00:04:26.345 --rc genhtml_function_coverage=1 00:04:26.345 --rc genhtml_legend=1 00:04:26.345 --rc geninfo_all_blocks=1 00:04:26.345 --rc geninfo_unexecuted_blocks=1 00:04:26.345 00:04:26.345 ' 00:04:26.345 19:02:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:26.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.345 --rc genhtml_branch_coverage=1 00:04:26.345 --rc genhtml_function_coverage=1 00:04:26.345 --rc genhtml_legend=1 00:04:26.345 --rc geninfo_all_blocks=1 00:04:26.345 --rc geninfo_unexecuted_blocks=1 00:04:26.345 00:04:26.345 ' 00:04:26.345 19:02:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:26.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:26.345 --rc genhtml_branch_coverage=1 00:04:26.345 --rc genhtml_function_coverage=1 00:04:26.345 --rc genhtml_legend=1 00:04:26.345 --rc geninfo_all_blocks=1 00:04:26.345 --rc geninfo_unexecuted_blocks=1 00:04:26.345 00:04:26.345 ' 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:26.345 19:02:44 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:26.345 19:02:44 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:26.345 19:02:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.345 19:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3319508 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:26.345 19:02:44 -- spdkcli/tcp.sh@27 -- # waitforlisten 3319508 00:04:26.345 19:02:44 -- common/autotest_common.sh@829 -- # '[' -z 3319508 ']' 00:04:26.345 19:02:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:26.345 19:02:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:26.345 19:02:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:26.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:26.345 19:02:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:26.345 19:02:44 -- common/autotest_common.sh@10 -- # set +x 00:04:26.345 [2024-11-18 19:02:44.876223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:26.345 [2024-11-18 19:02:44.876323] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3319508 ] 00:04:26.345 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.345 [2024-11-18 19:02:44.931310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:26.604 [2024-11-18 19:02:45.042239] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.604 [2024-11-18 19:02:45.042554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:26.604 [2024-11-18 19:02:45.042561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.538 19:02:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:27.538 19:02:45 -- common/autotest_common.sh@862 -- # return 0 00:04:27.538 19:02:45 -- spdkcli/tcp.sh@31 -- # socat_pid=3319586 00:04:27.538 19:02:45 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:27.538 19:02:45 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:27.538 [ 00:04:27.538 "bdev_malloc_delete", 00:04:27.538 "bdev_malloc_create", 00:04:27.538 "bdev_null_resize", 00:04:27.538 "bdev_null_delete", 00:04:27.538 "bdev_null_create", 00:04:27.538 "bdev_nvme_cuse_unregister", 00:04:27.538 "bdev_nvme_cuse_register", 00:04:27.538 "bdev_opal_new_user", 00:04:27.538 "bdev_opal_set_lock_state", 00:04:27.538 "bdev_opal_delete", 00:04:27.538 "bdev_opal_get_info", 00:04:27.538 "bdev_opal_create", 00:04:27.538 "bdev_nvme_opal_revert", 00:04:27.538 "bdev_nvme_opal_init", 00:04:27.538 "bdev_nvme_send_cmd", 00:04:27.538 "bdev_nvme_get_path_iostat", 00:04:27.538 "bdev_nvme_get_mdns_discovery_info", 00:04:27.538 "bdev_nvme_stop_mdns_discovery", 00:04:27.538 "bdev_nvme_start_mdns_discovery", 00:04:27.538 "bdev_nvme_set_multipath_policy", 00:04:27.538 "bdev_nvme_set_preferred_path", 00:04:27.538 "bdev_nvme_get_io_paths", 00:04:27.538 "bdev_nvme_remove_error_injection", 00:04:27.538 "bdev_nvme_add_error_injection", 00:04:27.538 "bdev_nvme_get_discovery_info", 00:04:27.538 "bdev_nvme_stop_discovery", 00:04:27.538 "bdev_nvme_start_discovery", 00:04:27.538 "bdev_nvme_get_controller_health_info", 00:04:27.538 "bdev_nvme_disable_controller", 00:04:27.538 "bdev_nvme_enable_controller", 00:04:27.538 "bdev_nvme_reset_controller", 00:04:27.538 "bdev_nvme_get_transport_statistics", 00:04:27.538 "bdev_nvme_apply_firmware", 00:04:27.538 "bdev_nvme_detach_controller", 00:04:27.538 "bdev_nvme_get_controllers", 00:04:27.538 "bdev_nvme_attach_controller", 00:04:27.538 "bdev_nvme_set_hotplug", 00:04:27.538 "bdev_nvme_set_options", 00:04:27.538 "bdev_passthru_delete", 00:04:27.538 "bdev_passthru_create", 00:04:27.538 "bdev_lvol_grow_lvstore", 00:04:27.538 "bdev_lvol_get_lvols", 00:04:27.538 "bdev_lvol_get_lvstores", 00:04:27.538 "bdev_lvol_delete", 00:04:27.538 "bdev_lvol_set_read_only", 00:04:27.538 "bdev_lvol_resize", 00:04:27.538 "bdev_lvol_decouple_parent", 00:04:27.538 "bdev_lvol_inflate", 00:04:27.538 "bdev_lvol_rename", 00:04:27.538 "bdev_lvol_clone_bdev", 00:04:27.538 "bdev_lvol_clone", 00:04:27.538 "bdev_lvol_snapshot", 00:04:27.538 "bdev_lvol_create", 00:04:27.538 "bdev_lvol_delete_lvstore", 00:04:27.538 "bdev_lvol_rename_lvstore", 00:04:27.538 "bdev_lvol_create_lvstore", 00:04:27.538 "bdev_raid_set_options", 00:04:27.538 "bdev_raid_remove_base_bdev", 00:04:27.538 "bdev_raid_add_base_bdev", 00:04:27.538 "bdev_raid_delete", 00:04:27.538 "bdev_raid_create", 00:04:27.538 "bdev_raid_get_bdevs", 00:04:27.538 "bdev_error_inject_error", 00:04:27.538 "bdev_error_delete", 00:04:27.538 "bdev_error_create", 00:04:27.538 "bdev_split_delete", 00:04:27.538 "bdev_split_create", 00:04:27.538 "bdev_delay_delete", 00:04:27.538 "bdev_delay_create", 00:04:27.538 "bdev_delay_update_latency", 00:04:27.538 "bdev_zone_block_delete", 00:04:27.538 "bdev_zone_block_create", 00:04:27.538 "blobfs_create", 00:04:27.538 "blobfs_detect", 00:04:27.538 "blobfs_set_cache_size", 00:04:27.538 "bdev_aio_delete", 00:04:27.538 "bdev_aio_rescan", 00:04:27.538 "bdev_aio_create", 00:04:27.538 "bdev_ftl_set_property", 00:04:27.538 "bdev_ftl_get_properties", 00:04:27.538 "bdev_ftl_get_stats", 00:04:27.538 "bdev_ftl_unmap", 00:04:27.538 "bdev_ftl_unload", 00:04:27.538 "bdev_ftl_delete", 00:04:27.538 "bdev_ftl_load", 00:04:27.538 "bdev_ftl_create", 00:04:27.538 "bdev_virtio_attach_controller", 00:04:27.538 "bdev_virtio_scsi_get_devices", 00:04:27.538 "bdev_virtio_detach_controller", 00:04:27.538 "bdev_virtio_blk_set_hotplug", 00:04:27.538 "bdev_iscsi_delete", 00:04:27.538 "bdev_iscsi_create", 00:04:27.538 "bdev_iscsi_set_options", 00:04:27.538 "accel_error_inject_error", 00:04:27.538 "ioat_scan_accel_module", 00:04:27.538 "dsa_scan_accel_module", 00:04:27.538 "iaa_scan_accel_module", 00:04:27.538 "iscsi_set_options", 00:04:27.538 "iscsi_get_auth_groups", 00:04:27.538 "iscsi_auth_group_remove_secret", 00:04:27.538 "iscsi_auth_group_add_secret", 00:04:27.539 "iscsi_delete_auth_group", 00:04:27.539 "iscsi_create_auth_group", 00:04:27.539 "iscsi_set_discovery_auth", 00:04:27.539 "iscsi_get_options", 00:04:27.539 "iscsi_target_node_request_logout", 00:04:27.539 "iscsi_target_node_set_redirect", 00:04:27.539 "iscsi_target_node_set_auth", 00:04:27.539 "iscsi_target_node_add_lun", 00:04:27.539 "iscsi_get_connections", 00:04:27.539 "iscsi_portal_group_set_auth", 00:04:27.539 "iscsi_start_portal_group", 00:04:27.539 "iscsi_delete_portal_group", 00:04:27.539 "iscsi_create_portal_group", 00:04:27.539 "iscsi_get_portal_groups", 00:04:27.539 "iscsi_delete_target_node", 00:04:27.539 "iscsi_target_node_remove_pg_ig_maps", 00:04:27.539 "iscsi_target_node_add_pg_ig_maps", 00:04:27.539 "iscsi_create_target_node", 00:04:27.539 "iscsi_get_target_nodes", 00:04:27.539 "iscsi_delete_initiator_group", 00:04:27.539 "iscsi_initiator_group_remove_initiators", 00:04:27.539 "iscsi_initiator_group_add_initiators", 00:04:27.539 "iscsi_create_initiator_group", 00:04:27.539 "iscsi_get_initiator_groups", 00:04:27.539 "nvmf_set_crdt", 00:04:27.539 "nvmf_set_config", 00:04:27.539 "nvmf_set_max_subsystems", 00:04:27.539 "nvmf_subsystem_get_listeners", 00:04:27.539 "nvmf_subsystem_get_qpairs", 00:04:27.539 "nvmf_subsystem_get_controllers", 00:04:27.539 "nvmf_get_stats", 00:04:27.539 "nvmf_get_transports", 00:04:27.539 "nvmf_create_transport", 00:04:27.539 "nvmf_get_targets", 00:04:27.539 "nvmf_delete_target", 00:04:27.539 "nvmf_create_target", 00:04:27.539 "nvmf_subsystem_allow_any_host", 00:04:27.539 "nvmf_subsystem_remove_host", 00:04:27.539 "nvmf_subsystem_add_host", 00:04:27.539 "nvmf_subsystem_remove_ns", 00:04:27.539 "nvmf_subsystem_add_ns", 00:04:27.539 "nvmf_subsystem_listener_set_ana_state", 00:04:27.539 "nvmf_discovery_get_referrals", 00:04:27.539 "nvmf_discovery_remove_referral", 00:04:27.539 "nvmf_discovery_add_referral", 00:04:27.539 "nvmf_subsystem_remove_listener", 00:04:27.539 "nvmf_subsystem_add_listener", 00:04:27.539 "nvmf_delete_subsystem", 00:04:27.539 "nvmf_create_subsystem", 00:04:27.539 "nvmf_get_subsystems", 00:04:27.539 "env_dpdk_get_mem_stats", 00:04:27.539 "nbd_get_disks", 00:04:27.539 "nbd_stop_disk", 00:04:27.539 "nbd_start_disk", 00:04:27.539 "ublk_recover_disk", 00:04:27.539 "ublk_get_disks", 00:04:27.539 "ublk_stop_disk", 00:04:27.539 "ublk_start_disk", 00:04:27.539 "ublk_destroy_target", 00:04:27.539 "ublk_create_target", 00:04:27.539 "virtio_blk_create_transport", 00:04:27.539 "virtio_blk_get_transports", 00:04:27.539 "vhost_controller_set_coalescing", 00:04:27.539 "vhost_get_controllers", 00:04:27.539 "vhost_delete_controller", 00:04:27.539 "vhost_create_blk_controller", 00:04:27.539 "vhost_scsi_controller_remove_target", 00:04:27.539 "vhost_scsi_controller_add_target", 00:04:27.539 "vhost_start_scsi_controller", 00:04:27.539 "vhost_create_scsi_controller", 00:04:27.539 "thread_set_cpumask", 00:04:27.539 "framework_get_scheduler", 00:04:27.539 "framework_set_scheduler", 00:04:27.539 "framework_get_reactors", 00:04:27.539 "thread_get_io_channels", 00:04:27.539 "thread_get_pollers", 00:04:27.539 "thread_get_stats", 00:04:27.539 "framework_monitor_context_switch", 00:04:27.539 "spdk_kill_instance", 00:04:27.539 "log_enable_timestamps", 00:04:27.539 "log_get_flags", 00:04:27.539 "log_clear_flag", 00:04:27.539 "log_set_flag", 00:04:27.539 "log_get_level", 00:04:27.539 "log_set_level", 00:04:27.539 "log_get_print_level", 00:04:27.539 "log_set_print_level", 00:04:27.539 "framework_enable_cpumask_locks", 00:04:27.539 "framework_disable_cpumask_locks", 00:04:27.539 "framework_wait_init", 00:04:27.539 "framework_start_init", 00:04:27.539 "scsi_get_devices", 00:04:27.539 "bdev_get_histogram", 00:04:27.539 "bdev_enable_histogram", 00:04:27.539 "bdev_set_qos_limit", 00:04:27.539 "bdev_set_qd_sampling_period", 00:04:27.539 "bdev_get_bdevs", 00:04:27.539 "bdev_reset_iostat", 00:04:27.539 "bdev_get_iostat", 00:04:27.539 "bdev_examine", 00:04:27.539 "bdev_wait_for_examine", 00:04:27.539 "bdev_set_options", 00:04:27.539 "notify_get_notifications", 00:04:27.539 "notify_get_types", 00:04:27.539 "accel_get_stats", 00:04:27.539 "accel_set_options", 00:04:27.539 "accel_set_driver", 00:04:27.539 "accel_crypto_key_destroy", 00:04:27.539 "accel_crypto_keys_get", 00:04:27.539 "accel_crypto_key_create", 00:04:27.539 "accel_assign_opc", 00:04:27.539 "accel_get_module_info", 00:04:27.539 "accel_get_opc_assignments", 00:04:27.539 "vmd_rescan", 00:04:27.539 "vmd_remove_device", 00:04:27.539 "vmd_enable", 00:04:27.539 "sock_set_default_impl", 00:04:27.539 "sock_impl_set_options", 00:04:27.539 "sock_impl_get_options", 00:04:27.539 "iobuf_get_stats", 00:04:27.539 "iobuf_set_options", 00:04:27.539 "framework_get_pci_devices", 00:04:27.539 "framework_get_config", 00:04:27.539 "framework_get_subsystems", 00:04:27.539 "trace_get_info", 00:04:27.539 "trace_get_tpoint_group_mask", 00:04:27.539 "trace_disable_tpoint_group", 00:04:27.539 "trace_enable_tpoint_group", 00:04:27.539 "trace_clear_tpoint_mask", 00:04:27.539 "trace_set_tpoint_mask", 00:04:27.539 "spdk_get_version", 00:04:27.539 "rpc_get_methods" 00:04:27.539 ] 00:04:27.539 19:02:46 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:27.539 19:02:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:27.539 19:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:27.539 19:02:46 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:27.539 19:02:46 -- spdkcli/tcp.sh@38 -- # killprocess 3319508 00:04:27.539 19:02:46 -- common/autotest_common.sh@936 -- # '[' -z 3319508 ']' 00:04:27.539 19:02:46 -- common/autotest_common.sh@940 -- # kill -0 3319508 00:04:27.539 19:02:46 -- common/autotest_common.sh@941 -- # uname 00:04:27.539 19:02:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:27.539 19:02:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3319508 00:04:27.797 19:02:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:27.797 19:02:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:27.797 19:02:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3319508' 00:04:27.797 killing process with pid 3319508 00:04:27.797 19:02:46 -- common/autotest_common.sh@955 -- # kill 3319508 00:04:27.797 19:02:46 -- common/autotest_common.sh@960 -- # wait 3319508 00:04:28.055 00:04:28.055 real 0m1.893s 00:04:28.055 user 0m3.597s 00:04:28.055 sys 0m0.483s 00:04:28.055 19:02:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.055 19:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.055 ************************************ 00:04:28.055 END TEST spdkcli_tcp 00:04:28.055 ************************************ 00:04:28.055 19:02:46 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:28.055 19:02:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.055 19:02:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.055 19:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.055 ************************************ 00:04:28.055 START TEST dpdk_mem_utility 00:04:28.055 ************************************ 00:04:28.055 19:02:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:28.314 * Looking for test storage... 00:04:28.314 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:28.314 19:02:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:28.314 19:02:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:28.314 19:02:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:28.314 19:02:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:28.314 19:02:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:28.314 19:02:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:28.314 19:02:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:28.314 19:02:46 -- scripts/common.sh@335 -- # IFS=.-: 00:04:28.314 19:02:46 -- scripts/common.sh@335 -- # read -ra ver1 00:04:28.314 19:02:46 -- scripts/common.sh@336 -- # IFS=.-: 00:04:28.314 19:02:46 -- scripts/common.sh@336 -- # read -ra ver2 00:04:28.314 19:02:46 -- scripts/common.sh@337 -- # local 'op=<' 00:04:28.314 19:02:46 -- scripts/common.sh@339 -- # ver1_l=2 00:04:28.314 19:02:46 -- scripts/common.sh@340 -- # ver2_l=1 00:04:28.314 19:02:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:28.314 19:02:46 -- scripts/common.sh@343 -- # case "$op" in 00:04:28.314 19:02:46 -- scripts/common.sh@344 -- # : 1 00:04:28.314 19:02:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:28.314 19:02:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:28.314 19:02:46 -- scripts/common.sh@364 -- # decimal 1 00:04:28.314 19:02:46 -- scripts/common.sh@352 -- # local d=1 00:04:28.314 19:02:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:28.314 19:02:46 -- scripts/common.sh@354 -- # echo 1 00:04:28.314 19:02:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:28.314 19:02:46 -- scripts/common.sh@365 -- # decimal 2 00:04:28.314 19:02:46 -- scripts/common.sh@352 -- # local d=2 00:04:28.314 19:02:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:28.314 19:02:46 -- scripts/common.sh@354 -- # echo 2 00:04:28.314 19:02:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:28.314 19:02:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:28.314 19:02:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:28.314 19:02:46 -- scripts/common.sh@367 -- # return 0 00:04:28.314 19:02:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:28.314 19:02:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:28.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.314 --rc genhtml_branch_coverage=1 00:04:28.314 --rc genhtml_function_coverage=1 00:04:28.314 --rc genhtml_legend=1 00:04:28.314 --rc geninfo_all_blocks=1 00:04:28.314 --rc geninfo_unexecuted_blocks=1 00:04:28.314 00:04:28.314 ' 00:04:28.314 19:02:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:28.314 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.314 --rc genhtml_branch_coverage=1 00:04:28.314 --rc genhtml_function_coverage=1 00:04:28.314 --rc genhtml_legend=1 00:04:28.314 --rc geninfo_all_blocks=1 00:04:28.314 --rc geninfo_unexecuted_blocks=1 00:04:28.315 00:04:28.315 ' 00:04:28.315 19:02:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:28.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.315 --rc genhtml_branch_coverage=1 00:04:28.315 --rc genhtml_function_coverage=1 00:04:28.315 --rc genhtml_legend=1 00:04:28.315 --rc geninfo_all_blocks=1 00:04:28.315 --rc geninfo_unexecuted_blocks=1 00:04:28.315 00:04:28.315 ' 00:04:28.315 19:02:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:28.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.315 --rc genhtml_branch_coverage=1 00:04:28.315 --rc genhtml_function_coverage=1 00:04:28.315 --rc genhtml_legend=1 00:04:28.315 --rc geninfo_all_blocks=1 00:04:28.315 --rc geninfo_unexecuted_blocks=1 00:04:28.315 00:04:28.315 ' 00:04:28.315 19:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:28.315 19:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3319732 00:04:28.315 19:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:28.315 19:02:46 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3319732 00:04:28.315 19:02:46 -- common/autotest_common.sh@829 -- # '[' -z 3319732 ']' 00:04:28.315 19:02:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:28.315 19:02:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:28.315 19:02:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:28.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:28.315 19:02:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:28.315 19:02:46 -- common/autotest_common.sh@10 -- # set +x 00:04:28.315 [2024-11-18 19:02:46.798069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:28.315 [2024-11-18 19:02:46.798169] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3319732 ] 00:04:28.315 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.315 [2024-11-18 19:02:46.853845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.573 [2024-11-18 19:02:46.969974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.574 [2024-11-18 19:02:46.970130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.508 19:02:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.508 19:02:47 -- common/autotest_common.sh@862 -- # return 0 00:04:29.508 19:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:29.508 19:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:29.508 19:02:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.508 19:02:47 -- common/autotest_common.sh@10 -- # set +x 00:04:29.508 { 00:04:29.508 "filename": "/tmp/spdk_mem_dump.txt" 00:04:29.508 } 00:04:29.508 19:02:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.508 19:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:29.508 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:29.508 1 heaps totaling size 814.000000 MiB 00:04:29.508 size: 814.000000 MiB heap id: 0 00:04:29.508 end heaps---------- 00:04:29.508 8 mempools totaling size 598.116089 MiB 00:04:29.508 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:29.508 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:29.508 size: 84.521057 MiB name: bdev_io_3319732 00:04:29.508 size: 51.011292 MiB name: evtpool_3319732 00:04:29.508 size: 50.003479 MiB name: msgpool_3319732 00:04:29.508 size: 21.763794 MiB name: PDU_Pool 00:04:29.508 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:29.508 size: 0.026123 MiB name: Session_Pool 00:04:29.508 end mempools------- 00:04:29.508 6 memzones totaling size 4.142822 MiB 00:04:29.508 size: 1.000366 MiB name: RG_ring_0_3319732 00:04:29.508 size: 1.000366 MiB name: RG_ring_1_3319732 00:04:29.508 size: 1.000366 MiB name: RG_ring_4_3319732 00:04:29.508 size: 1.000366 MiB name: RG_ring_5_3319732 00:04:29.508 size: 0.125366 MiB name: RG_ring_2_3319732 00:04:29.508 size: 0.015991 MiB name: RG_ring_3_3319732 00:04:29.508 end memzones------- 00:04:29.508 19:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:29.508 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:29.508 list of free elements. size: 12.519348 MiB 00:04:29.508 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:29.508 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:29.508 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:29.508 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:29.508 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:29.508 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:29.508 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:29.508 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:29.508 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:29.508 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:29.508 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:29.508 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:29.508 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:29.508 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:29.508 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:29.508 list of standard malloc elements. size: 199.218079 MiB 00:04:29.508 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:29.508 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:29.508 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:29.508 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:29.508 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:29.508 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:29.508 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:29.508 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:29.508 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:29.508 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:29.508 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:29.508 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:29.508 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:29.508 list of memzone associated elements. size: 602.262573 MiB 00:04:29.508 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:29.508 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:29.508 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:29.508 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:29.508 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:29.508 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3319732_0 00:04:29.508 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:29.508 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3319732_0 00:04:29.508 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:29.508 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3319732_0 00:04:29.508 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:29.508 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:29.508 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:29.508 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:29.508 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:29.508 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3319732 00:04:29.508 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:29.508 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3319732 00:04:29.508 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:29.508 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3319732 00:04:29.508 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:29.508 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:29.508 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:29.509 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:29.509 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:29.509 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:29.509 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:29.509 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:29.509 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:29.509 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3319732 00:04:29.509 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:29.509 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3319732 00:04:29.509 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:29.509 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3319732 00:04:29.509 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:29.509 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3319732 00:04:29.509 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:29.509 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3319732 00:04:29.509 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:29.509 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:29.509 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:29.509 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:29.509 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:29.509 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:29.509 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:29.509 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3319732 00:04:29.509 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:29.509 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:29.509 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:29.509 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:29.509 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:29.509 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3319732 00:04:29.509 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:29.509 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:29.509 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:29.509 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3319732 00:04:29.509 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:29.509 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3319732 00:04:29.509 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:29.509 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:29.509 19:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:29.509 19:02:47 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3319732 00:04:29.509 19:02:47 -- common/autotest_common.sh@936 -- # '[' -z 3319732 ']' 00:04:29.509 19:02:47 -- common/autotest_common.sh@940 -- # kill -0 3319732 00:04:29.509 19:02:47 -- common/autotest_common.sh@941 -- # uname 00:04:29.509 19:02:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:29.509 19:02:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3319732 00:04:29.509 19:02:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:29.509 19:02:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:29.509 19:02:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3319732' 00:04:29.509 killing process with pid 3319732 00:04:29.509 19:02:47 -- common/autotest_common.sh@955 -- # kill 3319732 00:04:29.509 19:02:47 -- common/autotest_common.sh@960 -- # wait 3319732 00:04:29.768 00:04:29.768 real 0m1.750s 00:04:29.768 user 0m1.930s 00:04:29.768 sys 0m0.454s 00:04:29.768 19:02:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:29.768 19:02:48 -- common/autotest_common.sh@10 -- # set +x 00:04:29.768 ************************************ 00:04:29.768 END TEST dpdk_mem_utility 00:04:29.768 ************************************ 00:04:30.026 19:02:48 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:30.026 19:02:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.026 19:02:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.026 19:02:48 -- common/autotest_common.sh@10 -- # set +x 00:04:30.026 ************************************ 00:04:30.026 START TEST event 00:04:30.026 ************************************ 00:04:30.027 19:02:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:30.027 * Looking for test storage... 00:04:30.027 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:30.027 19:02:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.027 19:02:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.027 19:02:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.027 19:02:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.027 19:02:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.027 19:02:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.027 19:02:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.027 19:02:48 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.027 19:02:48 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.027 19:02:48 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.027 19:02:48 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.027 19:02:48 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.027 19:02:48 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.027 19:02:48 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.027 19:02:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.027 19:02:48 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.027 19:02:48 -- scripts/common.sh@344 -- # : 1 00:04:30.027 19:02:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.027 19:02:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.027 19:02:48 -- scripts/common.sh@364 -- # decimal 1 00:04:30.027 19:02:48 -- scripts/common.sh@352 -- # local d=1 00:04:30.027 19:02:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.027 19:02:48 -- scripts/common.sh@354 -- # echo 1 00:04:30.027 19:02:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.027 19:02:48 -- scripts/common.sh@365 -- # decimal 2 00:04:30.027 19:02:48 -- scripts/common.sh@352 -- # local d=2 00:04:30.027 19:02:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.027 19:02:48 -- scripts/common.sh@354 -- # echo 2 00:04:30.027 19:02:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.027 19:02:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.027 19:02:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.027 19:02:48 -- scripts/common.sh@367 -- # return 0 00:04:30.027 19:02:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.027 19:02:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.027 --rc genhtml_branch_coverage=1 00:04:30.027 --rc genhtml_function_coverage=1 00:04:30.027 --rc genhtml_legend=1 00:04:30.027 --rc geninfo_all_blocks=1 00:04:30.027 --rc geninfo_unexecuted_blocks=1 00:04:30.027 00:04:30.027 ' 00:04:30.027 19:02:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.027 --rc genhtml_branch_coverage=1 00:04:30.027 --rc genhtml_function_coverage=1 00:04:30.027 --rc genhtml_legend=1 00:04:30.027 --rc geninfo_all_blocks=1 00:04:30.027 --rc geninfo_unexecuted_blocks=1 00:04:30.027 00:04:30.027 ' 00:04:30.027 19:02:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.027 --rc genhtml_branch_coverage=1 00:04:30.027 --rc genhtml_function_coverage=1 00:04:30.027 --rc genhtml_legend=1 00:04:30.027 --rc geninfo_all_blocks=1 00:04:30.027 --rc geninfo_unexecuted_blocks=1 00:04:30.027 00:04:30.027 ' 00:04:30.027 19:02:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.027 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.027 --rc genhtml_branch_coverage=1 00:04:30.027 --rc genhtml_function_coverage=1 00:04:30.027 --rc genhtml_legend=1 00:04:30.027 --rc geninfo_all_blocks=1 00:04:30.027 --rc geninfo_unexecuted_blocks=1 00:04:30.027 00:04:30.027 ' 00:04:30.027 19:02:48 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:30.027 19:02:48 -- bdev/nbd_common.sh@6 -- # set -e 00:04:30.027 19:02:48 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:30.027 19:02:48 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:30.027 19:02:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.027 19:02:48 -- common/autotest_common.sh@10 -- # set +x 00:04:30.027 ************************************ 00:04:30.027 START TEST event_perf 00:04:30.027 ************************************ 00:04:30.027 19:02:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:30.027 Running I/O for 1 seconds...[2024-11-18 19:02:48.553492] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.027 [2024-11-18 19:02:48.553573] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3320059 ] 00:04:30.027 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.027 [2024-11-18 19:02:48.617319] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:30.285 [2024-11-18 19:02:48.735141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:30.285 [2024-11-18 19:02:48.735196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:30.285 [2024-11-18 19:02:48.735316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:30.285 [2024-11-18 19:02:48.735319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.657 Running I/O for 1 seconds... 00:04:31.657 lcore 0: 226234 00:04:31.657 lcore 1: 226233 00:04:31.657 lcore 2: 226233 00:04:31.657 lcore 3: 226234 00:04:31.657 done. 00:04:31.657 00:04:31.657 real 0m1.320s 00:04:31.657 user 0m4.226s 00:04:31.657 sys 0m0.089s 00:04:31.657 19:02:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:31.657 19:02:49 -- common/autotest_common.sh@10 -- # set +x 00:04:31.657 ************************************ 00:04:31.657 END TEST event_perf 00:04:31.657 ************************************ 00:04:31.657 19:02:49 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:31.657 19:02:49 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:31.657 19:02:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.657 19:02:49 -- common/autotest_common.sh@10 -- # set +x 00:04:31.657 ************************************ 00:04:31.657 START TEST event_reactor 00:04:31.657 ************************************ 00:04:31.657 19:02:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:31.657 [2024-11-18 19:02:49.899413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:31.657 [2024-11-18 19:02:49.899500] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3320223 ] 00:04:31.657 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.657 [2024-11-18 19:02:49.960509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.657 [2024-11-18 19:02:50.080392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.031 test_start 00:04:33.031 oneshot 00:04:33.031 tick 100 00:04:33.031 tick 100 00:04:33.031 tick 250 00:04:33.031 tick 100 00:04:33.031 tick 100 00:04:33.031 tick 100 00:04:33.031 tick 250 00:04:33.031 tick 500 00:04:33.031 tick 100 00:04:33.031 tick 100 00:04:33.031 tick 250 00:04:33.031 tick 100 00:04:33.031 tick 100 00:04:33.031 test_end 00:04:33.031 00:04:33.031 real 0m1.316s 00:04:33.031 user 0m1.226s 00:04:33.031 sys 0m0.084s 00:04:33.031 19:02:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.031 19:02:51 -- common/autotest_common.sh@10 -- # set +x 00:04:33.031 ************************************ 00:04:33.031 END TEST event_reactor 00:04:33.031 ************************************ 00:04:33.031 19:02:51 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:33.031 19:02:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:33.031 19:02:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.031 19:02:51 -- common/autotest_common.sh@10 -- # set +x 00:04:33.031 ************************************ 00:04:33.031 START TEST event_reactor_perf 00:04:33.031 ************************************ 00:04:33.031 19:02:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:33.031 [2024-11-18 19:02:51.239153] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:33.031 [2024-11-18 19:02:51.239240] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3320383 ] 00:04:33.031 EAL: No free 2048 kB hugepages reported on node 1 00:04:33.031 [2024-11-18 19:02:51.300537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.031 [2024-11-18 19:02:51.417999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.965 test_start 00:04:33.965 test_end 00:04:33.965 Performance: 352434 events per second 00:04:33.965 00:04:33.965 real 0m1.313s 00:04:33.965 user 0m1.234s 00:04:33.965 sys 0m0.073s 00:04:33.965 19:02:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.965 19:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:33.965 ************************************ 00:04:33.965 END TEST event_reactor_perf 00:04:33.965 ************************************ 00:04:33.965 19:02:52 -- event/event.sh@49 -- # uname -s 00:04:33.965 19:02:52 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:33.965 19:02:52 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:33.965 19:02:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.965 19:02:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.965 19:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:33.965 ************************************ 00:04:33.965 START TEST event_scheduler 00:04:33.965 ************************************ 00:04:33.965 19:02:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:34.223 * Looking for test storage... 00:04:34.223 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:34.223 19:02:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.223 19:02:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.223 19:02:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.223 19:02:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.223 19:02:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.223 19:02:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.223 19:02:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.223 19:02:52 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.223 19:02:52 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.223 19:02:52 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.223 19:02:52 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.223 19:02:52 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.223 19:02:52 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.223 19:02:52 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.223 19:02:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.223 19:02:52 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.223 19:02:52 -- scripts/common.sh@344 -- # : 1 00:04:34.223 19:02:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.223 19:02:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.223 19:02:52 -- scripts/common.sh@364 -- # decimal 1 00:04:34.223 19:02:52 -- scripts/common.sh@352 -- # local d=1 00:04:34.223 19:02:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.223 19:02:52 -- scripts/common.sh@354 -- # echo 1 00:04:34.223 19:02:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.223 19:02:52 -- scripts/common.sh@365 -- # decimal 2 00:04:34.223 19:02:52 -- scripts/common.sh@352 -- # local d=2 00:04:34.223 19:02:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.223 19:02:52 -- scripts/common.sh@354 -- # echo 2 00:04:34.223 19:02:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.223 19:02:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.223 19:02:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.223 19:02:52 -- scripts/common.sh@367 -- # return 0 00:04:34.223 19:02:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.223 19:02:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.223 --rc genhtml_branch_coverage=1 00:04:34.223 --rc genhtml_function_coverage=1 00:04:34.223 --rc genhtml_legend=1 00:04:34.223 --rc geninfo_all_blocks=1 00:04:34.223 --rc geninfo_unexecuted_blocks=1 00:04:34.223 00:04:34.223 ' 00:04:34.223 19:02:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.223 --rc genhtml_branch_coverage=1 00:04:34.223 --rc genhtml_function_coverage=1 00:04:34.223 --rc genhtml_legend=1 00:04:34.223 --rc geninfo_all_blocks=1 00:04:34.223 --rc geninfo_unexecuted_blocks=1 00:04:34.223 00:04:34.223 ' 00:04:34.223 19:02:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.223 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.224 --rc genhtml_branch_coverage=1 00:04:34.224 --rc genhtml_function_coverage=1 00:04:34.224 --rc genhtml_legend=1 00:04:34.224 --rc geninfo_all_blocks=1 00:04:34.224 --rc geninfo_unexecuted_blocks=1 00:04:34.224 00:04:34.224 ' 00:04:34.224 19:02:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.224 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.224 --rc genhtml_branch_coverage=1 00:04:34.224 --rc genhtml_function_coverage=1 00:04:34.224 --rc genhtml_legend=1 00:04:34.224 --rc geninfo_all_blocks=1 00:04:34.224 --rc geninfo_unexecuted_blocks=1 00:04:34.224 00:04:34.224 ' 00:04:34.224 19:02:52 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:34.224 19:02:52 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3320696 00:04:34.224 19:02:52 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:34.224 19:02:52 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:34.224 19:02:52 -- scheduler/scheduler.sh@37 -- # waitforlisten 3320696 00:04:34.224 19:02:52 -- common/autotest_common.sh@829 -- # '[' -z 3320696 ']' 00:04:34.224 19:02:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.224 19:02:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.224 19:02:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.224 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.224 19:02:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.224 19:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:34.224 [2024-11-18 19:02:52.739291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.224 [2024-11-18 19:02:52.739374] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3320696 ] 00:04:34.224 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.224 [2024-11-18 19:02:52.798083] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:34.482 [2024-11-18 19:02:52.909480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.482 [2024-11-18 19:02:52.909551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:34.482 [2024-11-18 19:02:52.909576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:34.482 [2024-11-18 19:02:52.909597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:34.482 19:02:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:34.482 19:02:52 -- common/autotest_common.sh@862 -- # return 0 00:04:34.482 19:02:52 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:34.482 19:02:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.482 19:02:52 -- common/autotest_common.sh@10 -- # set +x 00:04:34.482 POWER: Env isn't set yet! 00:04:34.482 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:34.482 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:34.482 POWER: Cannot get available frequencies of lcore 0 00:04:34.482 POWER: Attempting to initialise PSTAT power management... 00:04:34.482 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:34.482 POWER: Initialized successfully for lcore 0 power management 00:04:34.482 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:34.482 POWER: Initialized successfully for lcore 1 power management 00:04:34.482 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:34.483 POWER: Initialized successfully for lcore 2 power management 00:04:34.483 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:34.483 POWER: Initialized successfully for lcore 3 power management 00:04:34.483 [2024-11-18 19:02:53.018810] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:34.483 [2024-11-18 19:02:53.018829] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:34.483 [2024-11-18 19:02:53.018840] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:34.483 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.483 19:02:53 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:34.483 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.483 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.741 [2024-11-18 19:02:53.123461] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:34.741 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.741 19:02:53 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:34.741 19:02:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.741 19:02:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.741 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.741 ************************************ 00:04:34.741 START TEST scheduler_create_thread 00:04:34.741 ************************************ 00:04:34.741 19:02:53 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:34.741 19:02:53 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:34.741 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.741 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.741 2 00:04:34.741 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.741 19:02:53 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:34.741 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.741 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.741 3 00:04:34.741 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 4 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 5 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 6 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 7 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 8 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 9 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 10 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:34.742 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:34.742 19:02:53 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:34.742 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:34.742 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:35.308 19:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.308 19:02:53 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:35.308 19:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.308 19:02:53 -- common/autotest_common.sh@10 -- # set +x 00:04:36.682 19:02:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:36.682 19:02:55 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:36.682 19:02:55 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:36.682 19:02:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:36.682 19:02:55 -- common/autotest_common.sh@10 -- # set +x 00:04:38.054 19:02:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:38.054 00:04:38.054 real 0m3.102s 00:04:38.054 user 0m0.012s 00:04:38.054 sys 0m0.002s 00:04:38.054 19:02:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.054 19:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:38.054 ************************************ 00:04:38.054 END TEST scheduler_create_thread 00:04:38.054 ************************************ 00:04:38.054 19:02:56 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:38.054 19:02:56 -- scheduler/scheduler.sh@46 -- # killprocess 3320696 00:04:38.054 19:02:56 -- common/autotest_common.sh@936 -- # '[' -z 3320696 ']' 00:04:38.054 19:02:56 -- common/autotest_common.sh@940 -- # kill -0 3320696 00:04:38.054 19:02:56 -- common/autotest_common.sh@941 -- # uname 00:04:38.054 19:02:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:38.054 19:02:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3320696 00:04:38.054 19:02:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:38.054 19:02:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:38.054 19:02:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3320696' 00:04:38.054 killing process with pid 3320696 00:04:38.054 19:02:56 -- common/autotest_common.sh@955 -- # kill 3320696 00:04:38.054 19:02:56 -- common/autotest_common.sh@960 -- # wait 3320696 00:04:38.054 [2024-11-18 19:02:56.611885] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:38.312 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:38.312 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:38.312 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:38.312 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:38.312 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:38.312 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:38.312 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:38.312 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:38.312 00:04:38.312 real 0m4.334s 00:04:38.312 user 0m7.027s 00:04:38.312 sys 0m0.340s 00:04:38.312 19:02:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.312 19:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:38.312 ************************************ 00:04:38.312 END TEST event_scheduler 00:04:38.312 ************************************ 00:04:38.570 19:02:56 -- event/event.sh@51 -- # modprobe -n nbd 00:04:38.570 19:02:56 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:38.570 19:02:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.570 19:02:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.570 19:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:38.570 ************************************ 00:04:38.570 START TEST app_repeat 00:04:38.570 ************************************ 00:04:38.570 19:02:56 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:38.570 19:02:56 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:38.570 19:02:56 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.570 19:02:56 -- event/event.sh@13 -- # local nbd_list 00:04:38.570 19:02:56 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:38.570 19:02:56 -- event/event.sh@14 -- # local bdev_list 00:04:38.570 19:02:56 -- event/event.sh@15 -- # local repeat_times=4 00:04:38.570 19:02:56 -- event/event.sh@17 -- # modprobe nbd 00:04:38.570 19:02:56 -- event/event.sh@19 -- # repeat_pid=3321168 00:04:38.570 19:02:56 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:38.570 19:02:56 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:38.570 19:02:56 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3321168' 00:04:38.570 Process app_repeat pid: 3321168 00:04:38.570 19:02:56 -- event/event.sh@23 -- # for i in {0..2} 00:04:38.570 19:02:56 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:38.570 spdk_app_start Round 0 00:04:38.570 19:02:56 -- event/event.sh@25 -- # waitforlisten 3321168 /var/tmp/spdk-nbd.sock 00:04:38.570 19:02:56 -- common/autotest_common.sh@829 -- # '[' -z 3321168 ']' 00:04:38.570 19:02:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:38.570 19:02:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.570 19:02:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:38.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:38.570 19:02:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.570 19:02:56 -- common/autotest_common.sh@10 -- # set +x 00:04:38.570 [2024-11-18 19:02:56.960557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.570 [2024-11-18 19:02:56.960683] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3321168 ] 00:04:38.570 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.570 [2024-11-18 19:02:57.025952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:38.570 [2024-11-18 19:02:57.140848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.570 [2024-11-18 19:02:57.140848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:39.504 19:02:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.504 19:02:57 -- common/autotest_common.sh@862 -- # return 0 00:04:39.504 19:02:57 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:39.761 Malloc0 00:04:39.761 19:02:58 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:40.020 Malloc1 00:04:40.020 19:02:58 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@12 -- # local i 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:40.020 19:02:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:40.278 /dev/nbd0 00:04:40.278 19:02:58 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:40.278 19:02:58 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:40.278 19:02:58 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:40.278 19:02:58 -- common/autotest_common.sh@867 -- # local i 00:04:40.278 19:02:58 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:40.278 19:02:58 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:40.278 19:02:58 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:40.278 19:02:58 -- common/autotest_common.sh@871 -- # break 00:04:40.278 19:02:58 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:40.278 19:02:58 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:40.278 19:02:58 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:40.278 1+0 records in 00:04:40.278 1+0 records out 00:04:40.278 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00017864 s, 22.9 MB/s 00:04:40.278 19:02:58 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:40.278 19:02:58 -- common/autotest_common.sh@884 -- # size=4096 00:04:40.278 19:02:58 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:40.278 19:02:58 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:40.278 19:02:58 -- common/autotest_common.sh@887 -- # return 0 00:04:40.278 19:02:58 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:40.278 19:02:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:40.278 19:02:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:40.536 /dev/nbd1 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:40.536 19:02:59 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:40.536 19:02:59 -- common/autotest_common.sh@867 -- # local i 00:04:40.536 19:02:59 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:40.536 19:02:59 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:40.536 19:02:59 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:40.536 19:02:59 -- common/autotest_common.sh@871 -- # break 00:04:40.536 19:02:59 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:40.536 19:02:59 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:40.536 19:02:59 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:40.536 1+0 records in 00:04:40.536 1+0 records out 00:04:40.536 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000192405 s, 21.3 MB/s 00:04:40.536 19:02:59 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:40.536 19:02:59 -- common/autotest_common.sh@884 -- # size=4096 00:04:40.536 19:02:59 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:40.536 19:02:59 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:40.536 19:02:59 -- common/autotest_common.sh@887 -- # return 0 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:40.536 19:02:59 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:40.793 { 00:04:40.793 "nbd_device": "/dev/nbd0", 00:04:40.793 "bdev_name": "Malloc0" 00:04:40.793 }, 00:04:40.793 { 00:04:40.793 "nbd_device": "/dev/nbd1", 00:04:40.793 "bdev_name": "Malloc1" 00:04:40.793 } 00:04:40.793 ]' 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:40.793 { 00:04:40.793 "nbd_device": "/dev/nbd0", 00:04:40.793 "bdev_name": "Malloc0" 00:04:40.793 }, 00:04:40.793 { 00:04:40.793 "nbd_device": "/dev/nbd1", 00:04:40.793 "bdev_name": "Malloc1" 00:04:40.793 } 00:04:40.793 ]' 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:40.793 /dev/nbd1' 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:40.793 /dev/nbd1' 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@65 -- # count=2 00:04:40.793 19:02:59 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@95 -- # count=2 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:41.051 256+0 records in 00:04:41.051 256+0 records out 00:04:41.051 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00390179 s, 269 MB/s 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:41.051 256+0 records in 00:04:41.051 256+0 records out 00:04:41.051 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195869 s, 53.5 MB/s 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:41.051 256+0 records in 00:04:41.051 256+0 records out 00:04:41.051 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235164 s, 44.6 MB/s 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@51 -- # local i 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:41.051 19:02:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@41 -- # break 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@45 -- # return 0 00:04:41.309 19:02:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:41.310 19:02:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:41.568 19:02:59 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@41 -- # break 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@45 -- # return 0 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:41.568 19:03:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:41.825 19:03:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:41.825 19:03:00 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@65 -- # true 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@65 -- # count=0 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@104 -- # count=0 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:41.826 19:03:00 -- bdev/nbd_common.sh@109 -- # return 0 00:04:41.826 19:03:00 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:42.083 19:03:00 -- event/event.sh@35 -- # sleep 3 00:04:42.342 [2024-11-18 19:03:00.877198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:42.601 [2024-11-18 19:03:00.989419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.601 [2024-11-18 19:03:00.989419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.601 [2024-11-18 19:03:01.047541] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:42.601 [2024-11-18 19:03:01.047636] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:45.143 19:03:03 -- event/event.sh@23 -- # for i in {0..2} 00:04:45.143 19:03:03 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:45.143 spdk_app_start Round 1 00:04:45.143 19:03:03 -- event/event.sh@25 -- # waitforlisten 3321168 /var/tmp/spdk-nbd.sock 00:04:45.143 19:03:03 -- common/autotest_common.sh@829 -- # '[' -z 3321168 ']' 00:04:45.143 19:03:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:45.143 19:03:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:45.143 19:03:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:45.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:45.143 19:03:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:45.143 19:03:03 -- common/autotest_common.sh@10 -- # set +x 00:04:45.401 19:03:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:45.401 19:03:03 -- common/autotest_common.sh@862 -- # return 0 00:04:45.401 19:03:03 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:45.659 Malloc0 00:04:45.659 19:03:04 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:45.918 Malloc1 00:04:45.919 19:03:04 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@12 -- # local i 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:45.919 19:03:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:46.177 /dev/nbd0 00:04:46.177 19:03:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:46.177 19:03:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:46.177 19:03:04 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:46.177 19:03:04 -- common/autotest_common.sh@867 -- # local i 00:04:46.177 19:03:04 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:46.177 19:03:04 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:46.177 19:03:04 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:46.177 19:03:04 -- common/autotest_common.sh@871 -- # break 00:04:46.177 19:03:04 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:46.177 19:03:04 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:46.177 19:03:04 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:46.177 1+0 records in 00:04:46.177 1+0 records out 00:04:46.177 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000185679 s, 22.1 MB/s 00:04:46.177 19:03:04 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.177 19:03:04 -- common/autotest_common.sh@884 -- # size=4096 00:04:46.177 19:03:04 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.177 19:03:04 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:46.177 19:03:04 -- common/autotest_common.sh@887 -- # return 0 00:04:46.177 19:03:04 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:46.177 19:03:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.177 19:03:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:46.435 /dev/nbd1 00:04:46.435 19:03:04 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:46.435 19:03:04 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:46.435 19:03:04 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:46.435 19:03:04 -- common/autotest_common.sh@867 -- # local i 00:04:46.435 19:03:04 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:46.435 19:03:05 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:46.435 19:03:05 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:46.435 19:03:05 -- common/autotest_common.sh@871 -- # break 00:04:46.435 19:03:05 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:46.435 19:03:05 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:46.436 19:03:05 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:46.436 1+0 records in 00:04:46.436 1+0 records out 00:04:46.436 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000172145 s, 23.8 MB/s 00:04:46.436 19:03:05 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.436 19:03:05 -- common/autotest_common.sh@884 -- # size=4096 00:04:46.436 19:03:05 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.436 19:03:05 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:46.436 19:03:05 -- common/autotest_common.sh@887 -- # return 0 00:04:46.436 19:03:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:46.436 19:03:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.436 19:03:05 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:46.436 19:03:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.436 19:03:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:46.693 19:03:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:46.693 { 00:04:46.693 "nbd_device": "/dev/nbd0", 00:04:46.693 "bdev_name": "Malloc0" 00:04:46.693 }, 00:04:46.693 { 00:04:46.693 "nbd_device": "/dev/nbd1", 00:04:46.693 "bdev_name": "Malloc1" 00:04:46.693 } 00:04:46.693 ]' 00:04:46.693 19:03:05 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:46.693 { 00:04:46.693 "nbd_device": "/dev/nbd0", 00:04:46.693 "bdev_name": "Malloc0" 00:04:46.693 }, 00:04:46.693 { 00:04:46.693 "nbd_device": "/dev/nbd1", 00:04:46.693 "bdev_name": "Malloc1" 00:04:46.693 } 00:04:46.693 ]' 00:04:46.693 19:03:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:46.952 /dev/nbd1' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:46.952 /dev/nbd1' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@65 -- # count=2 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@95 -- # count=2 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:46.952 256+0 records in 00:04:46.952 256+0 records out 00:04:46.952 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00518906 s, 202 MB/s 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:46.952 256+0 records in 00:04:46.952 256+0 records out 00:04:46.952 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230333 s, 45.5 MB/s 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:46.952 256+0 records in 00:04:46.952 256+0 records out 00:04:46.952 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215686 s, 48.6 MB/s 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@51 -- # local i 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:46.952 19:03:05 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@41 -- # break 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@45 -- # return 0 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:47.210 19:03:05 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@41 -- # break 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@45 -- # return 0 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.469 19:03:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@65 -- # true 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@65 -- # count=0 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@104 -- # count=0 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:47.727 19:03:06 -- bdev/nbd_common.sh@109 -- # return 0 00:04:47.727 19:03:06 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:47.984 19:03:06 -- event/event.sh@35 -- # sleep 3 00:04:48.242 [2024-11-18 19:03:06.813921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:48.499 [2024-11-18 19:03:06.928316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:48.499 [2024-11-18 19:03:06.928321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.499 [2024-11-18 19:03:06.989380] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:48.499 [2024-11-18 19:03:06.989435] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:51.025 19:03:09 -- event/event.sh@23 -- # for i in {0..2} 00:04:51.025 19:03:09 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:51.025 spdk_app_start Round 2 00:04:51.026 19:03:09 -- event/event.sh@25 -- # waitforlisten 3321168 /var/tmp/spdk-nbd.sock 00:04:51.026 19:03:09 -- common/autotest_common.sh@829 -- # '[' -z 3321168 ']' 00:04:51.026 19:03:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:51.026 19:03:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.026 19:03:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:51.026 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:51.026 19:03:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.026 19:03:09 -- common/autotest_common.sh@10 -- # set +x 00:04:51.283 19:03:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:51.283 19:03:09 -- common/autotest_common.sh@862 -- # return 0 00:04:51.283 19:03:09 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.542 Malloc0 00:04:51.542 19:03:10 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.801 Malloc1 00:04:51.801 19:03:10 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@12 -- # local i 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.801 19:03:10 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:52.059 /dev/nbd0 00:04:52.059 19:03:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:52.059 19:03:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:52.059 19:03:10 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:52.059 19:03:10 -- common/autotest_common.sh@867 -- # local i 00:04:52.059 19:03:10 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:52.059 19:03:10 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:52.059 19:03:10 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:52.059 19:03:10 -- common/autotest_common.sh@871 -- # break 00:04:52.059 19:03:10 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:52.059 19:03:10 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:52.059 19:03:10 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.059 1+0 records in 00:04:52.059 1+0 records out 00:04:52.059 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000144994 s, 28.2 MB/s 00:04:52.059 19:03:10 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.059 19:03:10 -- common/autotest_common.sh@884 -- # size=4096 00:04:52.059 19:03:10 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.318 19:03:10 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:52.318 19:03:10 -- common/autotest_common.sh@887 -- # return 0 00:04:52.318 19:03:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.318 19:03:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.318 19:03:10 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:52.318 /dev/nbd1 00:04:52.318 19:03:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:52.318 19:03:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:52.318 19:03:10 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:52.318 19:03:10 -- common/autotest_common.sh@867 -- # local i 00:04:52.318 19:03:10 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:52.318 19:03:10 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:52.318 19:03:10 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:52.318 19:03:10 -- common/autotest_common.sh@871 -- # break 00:04:52.318 19:03:10 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:52.318 19:03:10 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:52.318 19:03:10 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.576 1+0 records in 00:04:52.576 1+0 records out 00:04:52.576 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000192095 s, 21.3 MB/s 00:04:52.576 19:03:10 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.576 19:03:10 -- common/autotest_common.sh@884 -- # size=4096 00:04:52.576 19:03:10 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.576 19:03:10 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:52.576 19:03:10 -- common/autotest_common.sh@887 -- # return 0 00:04:52.576 19:03:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.576 19:03:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.576 19:03:10 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:52.576 19:03:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.576 19:03:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:52.834 { 00:04:52.834 "nbd_device": "/dev/nbd0", 00:04:52.834 "bdev_name": "Malloc0" 00:04:52.834 }, 00:04:52.834 { 00:04:52.834 "nbd_device": "/dev/nbd1", 00:04:52.834 "bdev_name": "Malloc1" 00:04:52.834 } 00:04:52.834 ]' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:52.834 { 00:04:52.834 "nbd_device": "/dev/nbd0", 00:04:52.834 "bdev_name": "Malloc0" 00:04:52.834 }, 00:04:52.834 { 00:04:52.834 "nbd_device": "/dev/nbd1", 00:04:52.834 "bdev_name": "Malloc1" 00:04:52.834 } 00:04:52.834 ]' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:52.834 /dev/nbd1' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:52.834 /dev/nbd1' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@65 -- # count=2 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@95 -- # count=2 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:52.834 256+0 records in 00:04:52.834 256+0 records out 00:04:52.834 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00518035 s, 202 MB/s 00:04:52.834 19:03:11 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:52.835 256+0 records in 00:04:52.835 256+0 records out 00:04:52.835 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193587 s, 54.2 MB/s 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:52.835 256+0 records in 00:04:52.835 256+0 records out 00:04:52.835 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235381 s, 44.5 MB/s 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@51 -- # local i 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:52.835 19:03:11 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@41 -- # break 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:53.093 19:03:11 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@41 -- # break 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.350 19:03:11 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@65 -- # true 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@65 -- # count=0 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@104 -- # count=0 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:53.608 19:03:12 -- bdev/nbd_common.sh@109 -- # return 0 00:04:53.608 19:03:12 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:53.866 19:03:12 -- event/event.sh@35 -- # sleep 3 00:04:54.124 [2024-11-18 19:03:12.707449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:54.383 [2024-11-18 19:03:12.820618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.383 [2024-11-18 19:03:12.820623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.383 [2024-11-18 19:03:12.878088] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:54.383 [2024-11-18 19:03:12.878177] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:56.911 19:03:15 -- event/event.sh@38 -- # waitforlisten 3321168 /var/tmp/spdk-nbd.sock 00:04:56.911 19:03:15 -- common/autotest_common.sh@829 -- # '[' -z 3321168 ']' 00:04:56.911 19:03:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:56.911 19:03:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.911 19:03:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:56.911 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:56.911 19:03:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.911 19:03:15 -- common/autotest_common.sh@10 -- # set +x 00:04:57.199 19:03:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:57.199 19:03:15 -- common/autotest_common.sh@862 -- # return 0 00:04:57.199 19:03:15 -- event/event.sh@39 -- # killprocess 3321168 00:04:57.199 19:03:15 -- common/autotest_common.sh@936 -- # '[' -z 3321168 ']' 00:04:57.199 19:03:15 -- common/autotest_common.sh@940 -- # kill -0 3321168 00:04:57.199 19:03:15 -- common/autotest_common.sh@941 -- # uname 00:04:57.199 19:03:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:57.199 19:03:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3321168 00:04:57.199 19:03:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:57.199 19:03:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:57.199 19:03:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3321168' 00:04:57.199 killing process with pid 3321168 00:04:57.199 19:03:15 -- common/autotest_common.sh@955 -- # kill 3321168 00:04:57.199 19:03:15 -- common/autotest_common.sh@960 -- # wait 3321168 00:04:57.485 spdk_app_start is called in Round 0. 00:04:57.485 Shutdown signal received, stop current app iteration 00:04:57.485 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:57.485 spdk_app_start is called in Round 1. 00:04:57.485 Shutdown signal received, stop current app iteration 00:04:57.485 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:57.485 spdk_app_start is called in Round 2. 00:04:57.485 Shutdown signal received, stop current app iteration 00:04:57.485 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:04:57.485 spdk_app_start is called in Round 3. 00:04:57.485 Shutdown signal received, stop current app iteration 00:04:57.485 19:03:15 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:57.485 19:03:15 -- event/event.sh@42 -- # return 0 00:04:57.485 00:04:57.485 real 0m19.040s 00:04:57.485 user 0m41.564s 00:04:57.485 sys 0m3.229s 00:04:57.485 19:03:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:57.485 19:03:15 -- common/autotest_common.sh@10 -- # set +x 00:04:57.485 ************************************ 00:04:57.485 END TEST app_repeat 00:04:57.485 ************************************ 00:04:57.485 19:03:15 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:57.485 19:03:15 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:57.485 19:03:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.485 19:03:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.485 19:03:15 -- common/autotest_common.sh@10 -- # set +x 00:04:57.485 ************************************ 00:04:57.485 START TEST cpu_locks 00:04:57.485 ************************************ 00:04:57.485 19:03:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:57.485 * Looking for test storage... 00:04:57.485 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:57.485 19:03:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:57.485 19:03:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:57.485 19:03:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:57.744 19:03:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:57.744 19:03:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:57.744 19:03:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:57.744 19:03:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:57.744 19:03:16 -- scripts/common.sh@335 -- # IFS=.-: 00:04:57.744 19:03:16 -- scripts/common.sh@335 -- # read -ra ver1 00:04:57.744 19:03:16 -- scripts/common.sh@336 -- # IFS=.-: 00:04:57.744 19:03:16 -- scripts/common.sh@336 -- # read -ra ver2 00:04:57.744 19:03:16 -- scripts/common.sh@337 -- # local 'op=<' 00:04:57.744 19:03:16 -- scripts/common.sh@339 -- # ver1_l=2 00:04:57.744 19:03:16 -- scripts/common.sh@340 -- # ver2_l=1 00:04:57.744 19:03:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:57.744 19:03:16 -- scripts/common.sh@343 -- # case "$op" in 00:04:57.744 19:03:16 -- scripts/common.sh@344 -- # : 1 00:04:57.744 19:03:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:57.744 19:03:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:57.744 19:03:16 -- scripts/common.sh@364 -- # decimal 1 00:04:57.744 19:03:16 -- scripts/common.sh@352 -- # local d=1 00:04:57.744 19:03:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:57.744 19:03:16 -- scripts/common.sh@354 -- # echo 1 00:04:57.744 19:03:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:57.744 19:03:16 -- scripts/common.sh@365 -- # decimal 2 00:04:57.744 19:03:16 -- scripts/common.sh@352 -- # local d=2 00:04:57.744 19:03:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:57.744 19:03:16 -- scripts/common.sh@354 -- # echo 2 00:04:57.744 19:03:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:57.744 19:03:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:57.744 19:03:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:57.744 19:03:16 -- scripts/common.sh@367 -- # return 0 00:04:57.744 19:03:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:57.744 19:03:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:57.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.744 --rc genhtml_branch_coverage=1 00:04:57.744 --rc genhtml_function_coverage=1 00:04:57.744 --rc genhtml_legend=1 00:04:57.744 --rc geninfo_all_blocks=1 00:04:57.744 --rc geninfo_unexecuted_blocks=1 00:04:57.744 00:04:57.744 ' 00:04:57.744 19:03:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:57.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.744 --rc genhtml_branch_coverage=1 00:04:57.744 --rc genhtml_function_coverage=1 00:04:57.744 --rc genhtml_legend=1 00:04:57.744 --rc geninfo_all_blocks=1 00:04:57.744 --rc geninfo_unexecuted_blocks=1 00:04:57.744 00:04:57.744 ' 00:04:57.744 19:03:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:57.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.744 --rc genhtml_branch_coverage=1 00:04:57.744 --rc genhtml_function_coverage=1 00:04:57.744 --rc genhtml_legend=1 00:04:57.744 --rc geninfo_all_blocks=1 00:04:57.744 --rc geninfo_unexecuted_blocks=1 00:04:57.744 00:04:57.744 ' 00:04:57.744 19:03:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:57.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.744 --rc genhtml_branch_coverage=1 00:04:57.744 --rc genhtml_function_coverage=1 00:04:57.744 --rc genhtml_legend=1 00:04:57.744 --rc geninfo_all_blocks=1 00:04:57.744 --rc geninfo_unexecuted_blocks=1 00:04:57.744 00:04:57.744 ' 00:04:57.744 19:03:16 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:57.744 19:03:16 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:57.744 19:03:16 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:57.744 19:03:16 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:57.744 19:03:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.744 19:03:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.744 19:03:16 -- common/autotest_common.sh@10 -- # set +x 00:04:57.744 ************************************ 00:04:57.744 START TEST default_locks 00:04:57.744 ************************************ 00:04:57.744 19:03:16 -- common/autotest_common.sh@1114 -- # default_locks 00:04:57.744 19:03:16 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3324459 00:04:57.744 19:03:16 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:57.744 19:03:16 -- event/cpu_locks.sh@47 -- # waitforlisten 3324459 00:04:57.744 19:03:16 -- common/autotest_common.sh@829 -- # '[' -z 3324459 ']' 00:04:57.744 19:03:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:57.744 19:03:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:57.744 19:03:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:57.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:57.744 19:03:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:57.744 19:03:16 -- common/autotest_common.sh@10 -- # set +x 00:04:57.744 [2024-11-18 19:03:16.193327] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:57.744 [2024-11-18 19:03:16.193441] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3324459 ] 00:04:57.744 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.744 [2024-11-18 19:03:16.249673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.003 [2024-11-18 19:03:16.356899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:58.003 [2024-11-18 19:03:16.357057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:58.568 19:03:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.568 19:03:17 -- common/autotest_common.sh@862 -- # return 0 00:04:58.568 19:03:17 -- event/cpu_locks.sh@49 -- # locks_exist 3324459 00:04:58.568 19:03:17 -- event/cpu_locks.sh@22 -- # lslocks -p 3324459 00:04:58.568 19:03:17 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:59.133 lslocks: write error 00:04:59.133 19:03:17 -- event/cpu_locks.sh@50 -- # killprocess 3324459 00:04:59.133 19:03:17 -- common/autotest_common.sh@936 -- # '[' -z 3324459 ']' 00:04:59.133 19:03:17 -- common/autotest_common.sh@940 -- # kill -0 3324459 00:04:59.133 19:03:17 -- common/autotest_common.sh@941 -- # uname 00:04:59.133 19:03:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:59.133 19:03:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3324459 00:04:59.133 19:03:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:59.133 19:03:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:59.133 19:03:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3324459' 00:04:59.133 killing process with pid 3324459 00:04:59.133 19:03:17 -- common/autotest_common.sh@955 -- # kill 3324459 00:04:59.133 19:03:17 -- common/autotest_common.sh@960 -- # wait 3324459 00:04:59.391 19:03:17 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3324459 00:04:59.391 19:03:17 -- common/autotest_common.sh@650 -- # local es=0 00:04:59.391 19:03:17 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3324459 00:04:59.391 19:03:17 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:04:59.391 19:03:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:59.391 19:03:17 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:04:59.391 19:03:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:59.391 19:03:17 -- common/autotest_common.sh@653 -- # waitforlisten 3324459 00:04:59.391 19:03:17 -- common/autotest_common.sh@829 -- # '[' -z 3324459 ']' 00:04:59.391 19:03:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.391 19:03:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:59.391 19:03:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.391 19:03:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:59.391 19:03:17 -- common/autotest_common.sh@10 -- # set +x 00:04:59.391 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3324459) - No such process 00:04:59.391 ERROR: process (pid: 3324459) is no longer running 00:04:59.391 19:03:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:59.391 19:03:17 -- common/autotest_common.sh@862 -- # return 1 00:04:59.391 19:03:17 -- common/autotest_common.sh@653 -- # es=1 00:04:59.391 19:03:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:59.391 19:03:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:59.391 19:03:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:59.391 19:03:17 -- event/cpu_locks.sh@54 -- # no_locks 00:04:59.391 19:03:17 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:59.391 19:03:17 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:59.391 19:03:17 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:59.391 00:04:59.391 real 0m1.799s 00:04:59.391 user 0m1.948s 00:04:59.391 sys 0m0.551s 00:04:59.391 19:03:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:59.391 19:03:17 -- common/autotest_common.sh@10 -- # set +x 00:04:59.391 ************************************ 00:04:59.391 END TEST default_locks 00:04:59.391 ************************************ 00:04:59.391 19:03:17 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:59.391 19:03:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.391 19:03:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.391 19:03:17 -- common/autotest_common.sh@10 -- # set +x 00:04:59.391 ************************************ 00:04:59.391 START TEST default_locks_via_rpc 00:04:59.391 ************************************ 00:04:59.391 19:03:17 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:04:59.391 19:03:17 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3324638 00:04:59.391 19:03:17 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:59.391 19:03:17 -- event/cpu_locks.sh@63 -- # waitforlisten 3324638 00:04:59.391 19:03:17 -- common/autotest_common.sh@829 -- # '[' -z 3324638 ']' 00:04:59.391 19:03:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.391 19:03:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:59.391 19:03:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.391 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.391 19:03:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:59.391 19:03:17 -- common/autotest_common.sh@10 -- # set +x 00:04:59.649 [2024-11-18 19:03:18.018043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:59.649 [2024-11-18 19:03:18.018144] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3324638 ] 00:04:59.649 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.649 [2024-11-18 19:03:18.074042] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.649 [2024-11-18 19:03:18.183070] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:59.649 [2024-11-18 19:03:18.183248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.583 19:03:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:00.583 19:03:18 -- common/autotest_common.sh@862 -- # return 0 00:05:00.583 19:03:18 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:00.583 19:03:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:00.583 19:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:00.583 19:03:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:00.583 19:03:18 -- event/cpu_locks.sh@67 -- # no_locks 00:05:00.583 19:03:18 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:00.583 19:03:18 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:00.583 19:03:18 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:00.583 19:03:18 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:00.583 19:03:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:00.583 19:03:18 -- common/autotest_common.sh@10 -- # set +x 00:05:00.583 19:03:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:00.583 19:03:18 -- event/cpu_locks.sh@71 -- # locks_exist 3324638 00:05:00.583 19:03:18 -- event/cpu_locks.sh@22 -- # lslocks -p 3324638 00:05:00.583 19:03:18 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:00.840 19:03:19 -- event/cpu_locks.sh@73 -- # killprocess 3324638 00:05:00.840 19:03:19 -- common/autotest_common.sh@936 -- # '[' -z 3324638 ']' 00:05:00.840 19:03:19 -- common/autotest_common.sh@940 -- # kill -0 3324638 00:05:00.840 19:03:19 -- common/autotest_common.sh@941 -- # uname 00:05:00.840 19:03:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:00.840 19:03:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3324638 00:05:00.840 19:03:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:00.840 19:03:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:00.840 19:03:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3324638' 00:05:00.840 killing process with pid 3324638 00:05:00.840 19:03:19 -- common/autotest_common.sh@955 -- # kill 3324638 00:05:00.840 19:03:19 -- common/autotest_common.sh@960 -- # wait 3324638 00:05:01.406 00:05:01.406 real 0m1.782s 00:05:01.406 user 0m1.948s 00:05:01.406 sys 0m0.548s 00:05:01.406 19:03:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.406 19:03:19 -- common/autotest_common.sh@10 -- # set +x 00:05:01.406 ************************************ 00:05:01.406 END TEST default_locks_via_rpc 00:05:01.406 ************************************ 00:05:01.406 19:03:19 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:01.406 19:03:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:01.406 19:03:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.406 19:03:19 -- common/autotest_common.sh@10 -- # set +x 00:05:01.406 ************************************ 00:05:01.406 START TEST non_locking_app_on_locked_coremask 00:05:01.406 ************************************ 00:05:01.406 19:03:19 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:01.406 19:03:19 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3324936 00:05:01.406 19:03:19 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:01.406 19:03:19 -- event/cpu_locks.sh@81 -- # waitforlisten 3324936 /var/tmp/spdk.sock 00:05:01.406 19:03:19 -- common/autotest_common.sh@829 -- # '[' -z 3324936 ']' 00:05:01.406 19:03:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:01.406 19:03:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:01.406 19:03:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:01.406 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:01.406 19:03:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:01.406 19:03:19 -- common/autotest_common.sh@10 -- # set +x 00:05:01.406 [2024-11-18 19:03:19.821659] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.406 [2024-11-18 19:03:19.821753] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3324936 ] 00:05:01.406 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.406 [2024-11-18 19:03:19.880326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.406 [2024-11-18 19:03:19.993910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:01.406 [2024-11-18 19:03:19.994104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.341 19:03:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:02.341 19:03:20 -- common/autotest_common.sh@862 -- # return 0 00:05:02.341 19:03:20 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3325074 00:05:02.341 19:03:20 -- event/cpu_locks.sh@85 -- # waitforlisten 3325074 /var/tmp/spdk2.sock 00:05:02.341 19:03:20 -- common/autotest_common.sh@829 -- # '[' -z 3325074 ']' 00:05:02.341 19:03:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:02.341 19:03:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.341 19:03:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:02.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:02.341 19:03:20 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:02.341 19:03:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.341 19:03:20 -- common/autotest_common.sh@10 -- # set +x 00:05:02.341 [2024-11-18 19:03:20.821899] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:02.341 [2024-11-18 19:03:20.821978] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325074 ] 00:05:02.341 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.341 [2024-11-18 19:03:20.917532] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:02.341 [2024-11-18 19:03:20.917570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:02.599 [2024-11-18 19:03:21.149559] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:02.599 [2024-11-18 19:03:21.149800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.535 19:03:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.535 19:03:21 -- common/autotest_common.sh@862 -- # return 0 00:05:03.535 19:03:21 -- event/cpu_locks.sh@87 -- # locks_exist 3324936 00:05:03.535 19:03:21 -- event/cpu_locks.sh@22 -- # lslocks -p 3324936 00:05:03.535 19:03:21 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:03.793 lslocks: write error 00:05:03.793 19:03:22 -- event/cpu_locks.sh@89 -- # killprocess 3324936 00:05:03.793 19:03:22 -- common/autotest_common.sh@936 -- # '[' -z 3324936 ']' 00:05:03.793 19:03:22 -- common/autotest_common.sh@940 -- # kill -0 3324936 00:05:03.793 19:03:22 -- common/autotest_common.sh@941 -- # uname 00:05:03.793 19:03:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.793 19:03:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3324936 00:05:03.793 19:03:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.793 19:03:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.793 19:03:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3324936' 00:05:03.793 killing process with pid 3324936 00:05:03.793 19:03:22 -- common/autotest_common.sh@955 -- # kill 3324936 00:05:03.793 19:03:22 -- common/autotest_common.sh@960 -- # wait 3324936 00:05:04.728 19:03:23 -- event/cpu_locks.sh@90 -- # killprocess 3325074 00:05:04.728 19:03:23 -- common/autotest_common.sh@936 -- # '[' -z 3325074 ']' 00:05:04.728 19:03:23 -- common/autotest_common.sh@940 -- # kill -0 3325074 00:05:04.728 19:03:23 -- common/autotest_common.sh@941 -- # uname 00:05:04.728 19:03:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.728 19:03:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3325074 00:05:04.728 19:03:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.728 19:03:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.728 19:03:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3325074' 00:05:04.728 killing process with pid 3325074 00:05:04.728 19:03:23 -- common/autotest_common.sh@955 -- # kill 3325074 00:05:04.728 19:03:23 -- common/autotest_common.sh@960 -- # wait 3325074 00:05:05.295 00:05:05.295 real 0m3.904s 00:05:05.295 user 0m4.278s 00:05:05.295 sys 0m1.087s 00:05:05.295 19:03:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.295 19:03:23 -- common/autotest_common.sh@10 -- # set +x 00:05:05.295 ************************************ 00:05:05.295 END TEST non_locking_app_on_locked_coremask 00:05:05.295 ************************************ 00:05:05.295 19:03:23 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:05.295 19:03:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.295 19:03:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.295 19:03:23 -- common/autotest_common.sh@10 -- # set +x 00:05:05.295 ************************************ 00:05:05.295 START TEST locking_app_on_unlocked_coremask 00:05:05.295 ************************************ 00:05:05.295 19:03:23 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:05.295 19:03:23 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3325391 00:05:05.295 19:03:23 -- event/cpu_locks.sh@99 -- # waitforlisten 3325391 /var/tmp/spdk.sock 00:05:05.295 19:03:23 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:05.295 19:03:23 -- common/autotest_common.sh@829 -- # '[' -z 3325391 ']' 00:05:05.295 19:03:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.295 19:03:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.295 19:03:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.295 19:03:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.295 19:03:23 -- common/autotest_common.sh@10 -- # set +x 00:05:05.295 [2024-11-18 19:03:23.754679] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.295 [2024-11-18 19:03:23.754786] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325391 ] 00:05:05.295 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.295 [2024-11-18 19:03:23.810660] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:05.295 [2024-11-18 19:03:23.810701] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.553 [2024-11-18 19:03:23.920928] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.553 [2024-11-18 19:03:23.921096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.488 19:03:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.488 19:03:24 -- common/autotest_common.sh@862 -- # return 0 00:05:06.488 19:03:24 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3325534 00:05:06.488 19:03:24 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:06.488 19:03:24 -- event/cpu_locks.sh@103 -- # waitforlisten 3325534 /var/tmp/spdk2.sock 00:05:06.488 19:03:24 -- common/autotest_common.sh@829 -- # '[' -z 3325534 ']' 00:05:06.488 19:03:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:06.488 19:03:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:06.488 19:03:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:06.488 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:06.488 19:03:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:06.488 19:03:24 -- common/autotest_common.sh@10 -- # set +x 00:05:06.488 [2024-11-18 19:03:24.772162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:06.488 [2024-11-18 19:03:24.772237] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325534 ] 00:05:06.488 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.488 [2024-11-18 19:03:24.854038] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:06.488 [2024-11-18 19:03:25.078485] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:06.488 [2024-11-18 19:03:25.082681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.422 19:03:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:07.422 19:03:25 -- common/autotest_common.sh@862 -- # return 0 00:05:07.422 19:03:25 -- event/cpu_locks.sh@105 -- # locks_exist 3325534 00:05:07.422 19:03:25 -- event/cpu_locks.sh@22 -- # lslocks -p 3325534 00:05:07.422 19:03:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:07.680 lslocks: write error 00:05:07.680 19:03:26 -- event/cpu_locks.sh@107 -- # killprocess 3325391 00:05:07.680 19:03:26 -- common/autotest_common.sh@936 -- # '[' -z 3325391 ']' 00:05:07.680 19:03:26 -- common/autotest_common.sh@940 -- # kill -0 3325391 00:05:07.680 19:03:26 -- common/autotest_common.sh@941 -- # uname 00:05:07.680 19:03:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:07.680 19:03:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3325391 00:05:07.680 19:03:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:07.680 19:03:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:07.680 19:03:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3325391' 00:05:07.680 killing process with pid 3325391 00:05:07.680 19:03:26 -- common/autotest_common.sh@955 -- # kill 3325391 00:05:07.680 19:03:26 -- common/autotest_common.sh@960 -- # wait 3325391 00:05:08.615 19:03:27 -- event/cpu_locks.sh@108 -- # killprocess 3325534 00:05:08.615 19:03:27 -- common/autotest_common.sh@936 -- # '[' -z 3325534 ']' 00:05:08.615 19:03:27 -- common/autotest_common.sh@940 -- # kill -0 3325534 00:05:08.615 19:03:27 -- common/autotest_common.sh@941 -- # uname 00:05:08.615 19:03:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:08.615 19:03:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3325534 00:05:08.615 19:03:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:08.615 19:03:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:08.615 19:03:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3325534' 00:05:08.615 killing process with pid 3325534 00:05:08.615 19:03:27 -- common/autotest_common.sh@955 -- # kill 3325534 00:05:08.615 19:03:27 -- common/autotest_common.sh@960 -- # wait 3325534 00:05:09.181 00:05:09.181 real 0m3.780s 00:05:09.181 user 0m4.167s 00:05:09.181 sys 0m1.038s 00:05:09.181 19:03:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:09.181 19:03:27 -- common/autotest_common.sh@10 -- # set +x 00:05:09.181 ************************************ 00:05:09.181 END TEST locking_app_on_unlocked_coremask 00:05:09.181 ************************************ 00:05:09.181 19:03:27 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:09.181 19:03:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:09.181 19:03:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:09.181 19:03:27 -- common/autotest_common.sh@10 -- # set +x 00:05:09.181 ************************************ 00:05:09.181 START TEST locking_app_on_locked_coremask 00:05:09.181 ************************************ 00:05:09.181 19:03:27 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:09.181 19:03:27 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3325964 00:05:09.181 19:03:27 -- event/cpu_locks.sh@116 -- # waitforlisten 3325964 /var/tmp/spdk.sock 00:05:09.181 19:03:27 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:09.181 19:03:27 -- common/autotest_common.sh@829 -- # '[' -z 3325964 ']' 00:05:09.181 19:03:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:09.181 19:03:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.181 19:03:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:09.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:09.181 19:03:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.181 19:03:27 -- common/autotest_common.sh@10 -- # set +x 00:05:09.181 [2024-11-18 19:03:27.563790] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:09.181 [2024-11-18 19:03:27.563872] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3325964 ] 00:05:09.181 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.181 [2024-11-18 19:03:27.624388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.181 [2024-11-18 19:03:27.736218] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.181 [2024-11-18 19:03:27.736407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.118 19:03:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.118 19:03:28 -- common/autotest_common.sh@862 -- # return 0 00:05:10.118 19:03:28 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3326103 00:05:10.118 19:03:28 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:10.118 19:03:28 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3326103 /var/tmp/spdk2.sock 00:05:10.118 19:03:28 -- common/autotest_common.sh@650 -- # local es=0 00:05:10.118 19:03:28 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3326103 /var/tmp/spdk2.sock 00:05:10.118 19:03:28 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:10.118 19:03:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:10.118 19:03:28 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:10.118 19:03:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:10.119 19:03:28 -- common/autotest_common.sh@653 -- # waitforlisten 3326103 /var/tmp/spdk2.sock 00:05:10.119 19:03:28 -- common/autotest_common.sh@829 -- # '[' -z 3326103 ']' 00:05:10.119 19:03:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:10.119 19:03:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.119 19:03:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:10.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:10.119 19:03:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.119 19:03:28 -- common/autotest_common.sh@10 -- # set +x 00:05:10.119 [2024-11-18 19:03:28.565016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.119 [2024-11-18 19:03:28.565083] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326103 ] 00:05:10.119 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.119 [2024-11-18 19:03:28.644464] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3325964 has claimed it. 00:05:10.119 [2024-11-18 19:03:28.644537] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:10.684 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3326103) - No such process 00:05:10.684 ERROR: process (pid: 3326103) is no longer running 00:05:10.684 19:03:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.684 19:03:29 -- common/autotest_common.sh@862 -- # return 1 00:05:10.684 19:03:29 -- common/autotest_common.sh@653 -- # es=1 00:05:10.684 19:03:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:10.684 19:03:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:10.684 19:03:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:10.684 19:03:29 -- event/cpu_locks.sh@122 -- # locks_exist 3325964 00:05:10.684 19:03:29 -- event/cpu_locks.sh@22 -- # lslocks -p 3325964 00:05:10.684 19:03:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:11.250 lslocks: write error 00:05:11.250 19:03:29 -- event/cpu_locks.sh@124 -- # killprocess 3325964 00:05:11.250 19:03:29 -- common/autotest_common.sh@936 -- # '[' -z 3325964 ']' 00:05:11.250 19:03:29 -- common/autotest_common.sh@940 -- # kill -0 3325964 00:05:11.250 19:03:29 -- common/autotest_common.sh@941 -- # uname 00:05:11.250 19:03:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.250 19:03:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3325964 00:05:11.250 19:03:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.250 19:03:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.250 19:03:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3325964' 00:05:11.250 killing process with pid 3325964 00:05:11.250 19:03:29 -- common/autotest_common.sh@955 -- # kill 3325964 00:05:11.250 19:03:29 -- common/autotest_common.sh@960 -- # wait 3325964 00:05:11.508 00:05:11.508 real 0m2.561s 00:05:11.508 user 0m2.936s 00:05:11.508 sys 0m0.658s 00:05:11.508 19:03:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.508 19:03:30 -- common/autotest_common.sh@10 -- # set +x 00:05:11.508 ************************************ 00:05:11.508 END TEST locking_app_on_locked_coremask 00:05:11.508 ************************************ 00:05:11.508 19:03:30 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:11.508 19:03:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.508 19:03:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.509 19:03:30 -- common/autotest_common.sh@10 -- # set +x 00:05:11.509 ************************************ 00:05:11.509 START TEST locking_overlapped_coremask 00:05:11.509 ************************************ 00:05:11.509 19:03:30 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:11.509 19:03:30 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3326281 00:05:11.509 19:03:30 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:11.509 19:03:30 -- event/cpu_locks.sh@133 -- # waitforlisten 3326281 /var/tmp/spdk.sock 00:05:11.509 19:03:30 -- common/autotest_common.sh@829 -- # '[' -z 3326281 ']' 00:05:11.509 19:03:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.509 19:03:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.509 19:03:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.509 19:03:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.509 19:03:30 -- common/autotest_common.sh@10 -- # set +x 00:05:11.767 [2024-11-18 19:03:30.156845] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.767 [2024-11-18 19:03:30.156926] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326281 ] 00:05:11.767 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.767 [2024-11-18 19:03:30.220516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:11.767 [2024-11-18 19:03:30.335470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.767 [2024-11-18 19:03:30.335697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:11.767 [2024-11-18 19:03:30.335753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:11.767 [2024-11-18 19:03:30.335757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.701 19:03:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.701 19:03:31 -- common/autotest_common.sh@862 -- # return 0 00:05:12.701 19:03:31 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3326420 00:05:12.701 19:03:31 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:12.701 19:03:31 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3326420 /var/tmp/spdk2.sock 00:05:12.701 19:03:31 -- common/autotest_common.sh@650 -- # local es=0 00:05:12.701 19:03:31 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 3326420 /var/tmp/spdk2.sock 00:05:12.701 19:03:31 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:12.701 19:03:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.701 19:03:31 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:12.701 19:03:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.701 19:03:31 -- common/autotest_common.sh@653 -- # waitforlisten 3326420 /var/tmp/spdk2.sock 00:05:12.701 19:03:31 -- common/autotest_common.sh@829 -- # '[' -z 3326420 ']' 00:05:12.701 19:03:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:12.701 19:03:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.701 19:03:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:12.701 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:12.701 19:03:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.701 19:03:31 -- common/autotest_common.sh@10 -- # set +x 00:05:12.701 [2024-11-18 19:03:31.152872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.701 [2024-11-18 19:03:31.152969] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326420 ] 00:05:12.701 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.701 [2024-11-18 19:03:31.243687] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3326281 has claimed it. 00:05:12.701 [2024-11-18 19:03:31.243758] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:13.267 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (3326420) - No such process 00:05:13.267 ERROR: process (pid: 3326420) is no longer running 00:05:13.267 19:03:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.267 19:03:31 -- common/autotest_common.sh@862 -- # return 1 00:05:13.267 19:03:31 -- common/autotest_common.sh@653 -- # es=1 00:05:13.267 19:03:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:13.267 19:03:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:13.267 19:03:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:13.267 19:03:31 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:13.267 19:03:31 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:13.267 19:03:31 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:13.267 19:03:31 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:13.267 19:03:31 -- event/cpu_locks.sh@141 -- # killprocess 3326281 00:05:13.267 19:03:31 -- common/autotest_common.sh@936 -- # '[' -z 3326281 ']' 00:05:13.267 19:03:31 -- common/autotest_common.sh@940 -- # kill -0 3326281 00:05:13.267 19:03:31 -- common/autotest_common.sh@941 -- # uname 00:05:13.267 19:03:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.267 19:03:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326281 00:05:13.525 19:03:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.525 19:03:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.525 19:03:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326281' 00:05:13.525 killing process with pid 3326281 00:05:13.525 19:03:31 -- common/autotest_common.sh@955 -- # kill 3326281 00:05:13.525 19:03:31 -- common/autotest_common.sh@960 -- # wait 3326281 00:05:13.783 00:05:13.783 real 0m2.237s 00:05:13.783 user 0m6.310s 00:05:13.783 sys 0m0.488s 00:05:13.783 19:03:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.783 19:03:32 -- common/autotest_common.sh@10 -- # set +x 00:05:13.783 ************************************ 00:05:13.783 END TEST locking_overlapped_coremask 00:05:13.783 ************************************ 00:05:13.783 19:03:32 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:13.783 19:03:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.783 19:03:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.783 19:03:32 -- common/autotest_common.sh@10 -- # set +x 00:05:13.783 ************************************ 00:05:13.783 START TEST locking_overlapped_coremask_via_rpc 00:05:13.783 ************************************ 00:05:13.783 19:03:32 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:13.783 19:03:32 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3326589 00:05:13.783 19:03:32 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:13.783 19:03:32 -- event/cpu_locks.sh@149 -- # waitforlisten 3326589 /var/tmp/spdk.sock 00:05:13.783 19:03:32 -- common/autotest_common.sh@829 -- # '[' -z 3326589 ']' 00:05:13.783 19:03:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:13.783 19:03:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.783 19:03:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:13.783 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:13.783 19:03:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.783 19:03:32 -- common/autotest_common.sh@10 -- # set +x 00:05:14.042 [2024-11-18 19:03:32.416731] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.042 [2024-11-18 19:03:32.416831] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326589 ] 00:05:14.042 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.042 [2024-11-18 19:03:32.486027] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:14.042 [2024-11-18 19:03:32.486070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:14.042 [2024-11-18 19:03:32.622148] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.042 [2024-11-18 19:03:32.622385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:14.042 [2024-11-18 19:03:32.622446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:14.042 [2024-11-18 19:03:32.622454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.975 19:03:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.975 19:03:33 -- common/autotest_common.sh@862 -- # return 0 00:05:14.975 19:03:33 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3326731 00:05:14.975 19:03:33 -- event/cpu_locks.sh@153 -- # waitforlisten 3326731 /var/tmp/spdk2.sock 00:05:14.975 19:03:33 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:14.975 19:03:33 -- common/autotest_common.sh@829 -- # '[' -z 3326731 ']' 00:05:14.975 19:03:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:14.975 19:03:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.975 19:03:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:14.975 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:14.975 19:03:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.975 19:03:33 -- common/autotest_common.sh@10 -- # set +x 00:05:14.975 [2024-11-18 19:03:33.557367] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.975 [2024-11-18 19:03:33.557444] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326731 ] 00:05:15.233 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.233 [2024-11-18 19:03:33.645038] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:15.233 [2024-11-18 19:03:33.645070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:15.492 [2024-11-18 19:03:33.861314] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:15.492 [2024-11-18 19:03:33.861598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:15.492 [2024-11-18 19:03:33.861656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:15.492 [2024-11-18 19:03:33.861658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:16.056 19:03:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.056 19:03:34 -- common/autotest_common.sh@862 -- # return 0 00:05:16.056 19:03:34 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:16.056 19:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:16.056 19:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.056 19:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:16.056 19:03:34 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:16.056 19:03:34 -- common/autotest_common.sh@650 -- # local es=0 00:05:16.056 19:03:34 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:16.056 19:03:34 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:16.056 19:03:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:16.056 19:03:34 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:16.056 19:03:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:16.056 19:03:34 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:16.056 19:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:16.056 19:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.056 [2024-11-18 19:03:34.520714] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3326589 has claimed it. 00:05:16.056 request: 00:05:16.056 { 00:05:16.056 "method": "framework_enable_cpumask_locks", 00:05:16.056 "req_id": 1 00:05:16.056 } 00:05:16.056 Got JSON-RPC error response 00:05:16.056 response: 00:05:16.056 { 00:05:16.056 "code": -32603, 00:05:16.056 "message": "Failed to claim CPU core: 2" 00:05:16.056 } 00:05:16.056 19:03:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:16.056 19:03:34 -- common/autotest_common.sh@653 -- # es=1 00:05:16.056 19:03:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:16.056 19:03:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:16.056 19:03:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:16.056 19:03:34 -- event/cpu_locks.sh@158 -- # waitforlisten 3326589 /var/tmp/spdk.sock 00:05:16.056 19:03:34 -- common/autotest_common.sh@829 -- # '[' -z 3326589 ']' 00:05:16.056 19:03:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.056 19:03:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.056 19:03:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.056 19:03:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.057 19:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.313 19:03:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.313 19:03:34 -- common/autotest_common.sh@862 -- # return 0 00:05:16.313 19:03:34 -- event/cpu_locks.sh@159 -- # waitforlisten 3326731 /var/tmp/spdk2.sock 00:05:16.313 19:03:34 -- common/autotest_common.sh@829 -- # '[' -z 3326731 ']' 00:05:16.313 19:03:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:16.313 19:03:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.313 19:03:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:16.313 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:16.313 19:03:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.313 19:03:34 -- common/autotest_common.sh@10 -- # set +x 00:05:16.570 19:03:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.570 19:03:35 -- common/autotest_common.sh@862 -- # return 0 00:05:16.570 19:03:35 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:16.570 19:03:35 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:16.570 19:03:35 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:16.570 19:03:35 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:16.570 00:05:16.570 real 0m2.679s 00:05:16.570 user 0m1.392s 00:05:16.570 sys 0m0.211s 00:05:16.570 19:03:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.570 19:03:35 -- common/autotest_common.sh@10 -- # set +x 00:05:16.570 ************************************ 00:05:16.570 END TEST locking_overlapped_coremask_via_rpc 00:05:16.570 ************************************ 00:05:16.570 19:03:35 -- event/cpu_locks.sh@174 -- # cleanup 00:05:16.571 19:03:35 -- event/cpu_locks.sh@15 -- # [[ -z 3326589 ]] 00:05:16.571 19:03:35 -- event/cpu_locks.sh@15 -- # killprocess 3326589 00:05:16.571 19:03:35 -- common/autotest_common.sh@936 -- # '[' -z 3326589 ']' 00:05:16.571 19:03:35 -- common/autotest_common.sh@940 -- # kill -0 3326589 00:05:16.571 19:03:35 -- common/autotest_common.sh@941 -- # uname 00:05:16.571 19:03:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.571 19:03:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326589 00:05:16.571 19:03:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.571 19:03:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.571 19:03:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326589' 00:05:16.571 killing process with pid 3326589 00:05:16.571 19:03:35 -- common/autotest_common.sh@955 -- # kill 3326589 00:05:16.571 19:03:35 -- common/autotest_common.sh@960 -- # wait 3326589 00:05:17.136 19:03:35 -- event/cpu_locks.sh@16 -- # [[ -z 3326731 ]] 00:05:17.136 19:03:35 -- event/cpu_locks.sh@16 -- # killprocess 3326731 00:05:17.136 19:03:35 -- common/autotest_common.sh@936 -- # '[' -z 3326731 ']' 00:05:17.136 19:03:35 -- common/autotest_common.sh@940 -- # kill -0 3326731 00:05:17.136 19:03:35 -- common/autotest_common.sh@941 -- # uname 00:05:17.136 19:03:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:17.136 19:03:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326731 00:05:17.136 19:03:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:17.136 19:03:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:17.136 19:03:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326731' 00:05:17.136 killing process with pid 3326731 00:05:17.136 19:03:35 -- common/autotest_common.sh@955 -- # kill 3326731 00:05:17.136 19:03:35 -- common/autotest_common.sh@960 -- # wait 3326731 00:05:17.702 19:03:36 -- event/cpu_locks.sh@18 -- # rm -f 00:05:17.702 19:03:36 -- event/cpu_locks.sh@1 -- # cleanup 00:05:17.702 19:03:36 -- event/cpu_locks.sh@15 -- # [[ -z 3326589 ]] 00:05:17.702 19:03:36 -- event/cpu_locks.sh@15 -- # killprocess 3326589 00:05:17.702 19:03:36 -- common/autotest_common.sh@936 -- # '[' -z 3326589 ']' 00:05:17.702 19:03:36 -- common/autotest_common.sh@940 -- # kill -0 3326589 00:05:17.702 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3326589) - No such process 00:05:17.702 19:03:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3326589 is not found' 00:05:17.702 Process with pid 3326589 is not found 00:05:17.702 19:03:36 -- event/cpu_locks.sh@16 -- # [[ -z 3326731 ]] 00:05:17.702 19:03:36 -- event/cpu_locks.sh@16 -- # killprocess 3326731 00:05:17.702 19:03:36 -- common/autotest_common.sh@936 -- # '[' -z 3326731 ']' 00:05:17.702 19:03:36 -- common/autotest_common.sh@940 -- # kill -0 3326731 00:05:17.702 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3326731) - No such process 00:05:17.702 19:03:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3326731 is not found' 00:05:17.702 Process with pid 3326731 is not found 00:05:17.702 19:03:36 -- event/cpu_locks.sh@18 -- # rm -f 00:05:17.702 00:05:17.702 real 0m20.031s 00:05:17.702 user 0m36.035s 00:05:17.702 sys 0m5.445s 00:05:17.702 19:03:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.702 19:03:36 -- common/autotest_common.sh@10 -- # set +x 00:05:17.702 ************************************ 00:05:17.702 END TEST cpu_locks 00:05:17.702 ************************************ 00:05:17.702 00:05:17.702 real 0m47.661s 00:05:17.702 user 1m31.474s 00:05:17.702 sys 0m9.442s 00:05:17.702 19:03:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.702 19:03:36 -- common/autotest_common.sh@10 -- # set +x 00:05:17.702 ************************************ 00:05:17.702 END TEST event 00:05:17.702 ************************************ 00:05:17.702 19:03:36 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:17.702 19:03:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.702 19:03:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.702 19:03:36 -- common/autotest_common.sh@10 -- # set +x 00:05:17.702 ************************************ 00:05:17.702 START TEST thread 00:05:17.702 ************************************ 00:05:17.702 19:03:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:17.702 * Looking for test storage... 00:05:17.702 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:17.702 19:03:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:17.702 19:03:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:17.702 19:03:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:17.702 19:03:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:17.702 19:03:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:17.702 19:03:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:17.702 19:03:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:17.702 19:03:36 -- scripts/common.sh@335 -- # IFS=.-: 00:05:17.702 19:03:36 -- scripts/common.sh@335 -- # read -ra ver1 00:05:17.702 19:03:36 -- scripts/common.sh@336 -- # IFS=.-: 00:05:17.702 19:03:36 -- scripts/common.sh@336 -- # read -ra ver2 00:05:17.702 19:03:36 -- scripts/common.sh@337 -- # local 'op=<' 00:05:17.702 19:03:36 -- scripts/common.sh@339 -- # ver1_l=2 00:05:17.702 19:03:36 -- scripts/common.sh@340 -- # ver2_l=1 00:05:17.703 19:03:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:17.703 19:03:36 -- scripts/common.sh@343 -- # case "$op" in 00:05:17.703 19:03:36 -- scripts/common.sh@344 -- # : 1 00:05:17.703 19:03:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:17.703 19:03:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:17.703 19:03:36 -- scripts/common.sh@364 -- # decimal 1 00:05:17.703 19:03:36 -- scripts/common.sh@352 -- # local d=1 00:05:17.703 19:03:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:17.703 19:03:36 -- scripts/common.sh@354 -- # echo 1 00:05:17.703 19:03:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:17.703 19:03:36 -- scripts/common.sh@365 -- # decimal 2 00:05:17.703 19:03:36 -- scripts/common.sh@352 -- # local d=2 00:05:17.703 19:03:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:17.703 19:03:36 -- scripts/common.sh@354 -- # echo 2 00:05:17.703 19:03:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:17.703 19:03:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:17.703 19:03:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:17.703 19:03:36 -- scripts/common.sh@367 -- # return 0 00:05:17.703 19:03:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:17.703 19:03:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:17.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.703 --rc genhtml_branch_coverage=1 00:05:17.703 --rc genhtml_function_coverage=1 00:05:17.703 --rc genhtml_legend=1 00:05:17.703 --rc geninfo_all_blocks=1 00:05:17.703 --rc geninfo_unexecuted_blocks=1 00:05:17.703 00:05:17.703 ' 00:05:17.703 19:03:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:17.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.703 --rc genhtml_branch_coverage=1 00:05:17.703 --rc genhtml_function_coverage=1 00:05:17.703 --rc genhtml_legend=1 00:05:17.703 --rc geninfo_all_blocks=1 00:05:17.703 --rc geninfo_unexecuted_blocks=1 00:05:17.703 00:05:17.703 ' 00:05:17.703 19:03:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:17.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.703 --rc genhtml_branch_coverage=1 00:05:17.703 --rc genhtml_function_coverage=1 00:05:17.703 --rc genhtml_legend=1 00:05:17.703 --rc geninfo_all_blocks=1 00:05:17.703 --rc geninfo_unexecuted_blocks=1 00:05:17.703 00:05:17.703 ' 00:05:17.703 19:03:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:17.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:17.703 --rc genhtml_branch_coverage=1 00:05:17.703 --rc genhtml_function_coverage=1 00:05:17.703 --rc genhtml_legend=1 00:05:17.703 --rc geninfo_all_blocks=1 00:05:17.703 --rc geninfo_unexecuted_blocks=1 00:05:17.703 00:05:17.703 ' 00:05:17.703 19:03:36 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:17.703 19:03:36 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:17.703 19:03:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.703 19:03:36 -- common/autotest_common.sh@10 -- # set +x 00:05:17.703 ************************************ 00:05:17.703 START TEST thread_poller_perf 00:05:17.703 ************************************ 00:05:17.703 19:03:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:17.703 [2024-11-18 19:03:36.241056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.703 [2024-11-18 19:03:36.241136] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327111 ] 00:05:17.703 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.703 [2024-11-18 19:03:36.301401] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:17.961 [2024-11-18 19:03:36.413736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.961 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:19.335 [2024-11-18T18:03:37.940Z] ====================================== 00:05:19.335 [2024-11-18T18:03:37.940Z] busy:2716107764 (cyc) 00:05:19.335 [2024-11-18T18:03:37.940Z] total_run_count: 280000 00:05:19.335 [2024-11-18T18:03:37.940Z] tsc_hz: 2700000000 (cyc) 00:05:19.335 [2024-11-18T18:03:37.940Z] ====================================== 00:05:19.335 [2024-11-18T18:03:37.940Z] poller_cost: 9700 (cyc), 3592 (nsec) 00:05:19.335 00:05:19.335 real 0m1.317s 00:05:19.335 user 0m1.219s 00:05:19.335 sys 0m0.091s 00:05:19.335 19:03:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.335 19:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:19.335 ************************************ 00:05:19.335 END TEST thread_poller_perf 00:05:19.335 ************************************ 00:05:19.335 19:03:37 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:19.335 19:03:37 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:19.335 19:03:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.335 19:03:37 -- common/autotest_common.sh@10 -- # set +x 00:05:19.335 ************************************ 00:05:19.335 START TEST thread_poller_perf 00:05:19.335 ************************************ 00:05:19.335 19:03:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:19.335 [2024-11-18 19:03:37.586187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.335 [2024-11-18 19:03:37.586266] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327388 ] 00:05:19.335 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.335 [2024-11-18 19:03:37.649946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.335 [2024-11-18 19:03:37.764905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.335 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:20.709 [2024-11-18T18:03:39.314Z] ====================================== 00:05:20.709 [2024-11-18T18:03:39.314Z] busy:2703743392 (cyc) 00:05:20.709 [2024-11-18T18:03:39.314Z] total_run_count: 3908000 00:05:20.709 [2024-11-18T18:03:39.314Z] tsc_hz: 2700000000 (cyc) 00:05:20.709 [2024-11-18T18:03:39.314Z] ====================================== 00:05:20.709 [2024-11-18T18:03:39.314Z] poller_cost: 691 (cyc), 255 (nsec) 00:05:20.709 00:05:20.709 real 0m1.318s 00:05:20.709 user 0m1.223s 00:05:20.709 sys 0m0.088s 00:05:20.709 19:03:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.709 19:03:38 -- common/autotest_common.sh@10 -- # set +x 00:05:20.709 ************************************ 00:05:20.709 END TEST thread_poller_perf 00:05:20.709 ************************************ 00:05:20.709 19:03:38 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:20.709 00:05:20.709 real 0m2.831s 00:05:20.709 user 0m2.553s 00:05:20.709 sys 0m0.281s 00:05:20.709 19:03:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:20.709 19:03:38 -- common/autotest_common.sh@10 -- # set +x 00:05:20.709 ************************************ 00:05:20.709 END TEST thread 00:05:20.709 ************************************ 00:05:20.709 19:03:38 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:20.709 19:03:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:20.709 19:03:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:20.709 19:03:38 -- common/autotest_common.sh@10 -- # set +x 00:05:20.709 ************************************ 00:05:20.709 START TEST accel 00:05:20.709 ************************************ 00:05:20.709 19:03:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:20.709 * Looking for test storage... 00:05:20.709 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:20.709 19:03:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:20.709 19:03:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:20.709 19:03:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:20.709 19:03:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:20.709 19:03:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:20.709 19:03:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:20.709 19:03:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:20.709 19:03:39 -- scripts/common.sh@335 -- # IFS=.-: 00:05:20.709 19:03:39 -- scripts/common.sh@335 -- # read -ra ver1 00:05:20.709 19:03:39 -- scripts/common.sh@336 -- # IFS=.-: 00:05:20.709 19:03:39 -- scripts/common.sh@336 -- # read -ra ver2 00:05:20.709 19:03:39 -- scripts/common.sh@337 -- # local 'op=<' 00:05:20.709 19:03:39 -- scripts/common.sh@339 -- # ver1_l=2 00:05:20.709 19:03:39 -- scripts/common.sh@340 -- # ver2_l=1 00:05:20.709 19:03:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:20.709 19:03:39 -- scripts/common.sh@343 -- # case "$op" in 00:05:20.709 19:03:39 -- scripts/common.sh@344 -- # : 1 00:05:20.709 19:03:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:20.709 19:03:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:20.709 19:03:39 -- scripts/common.sh@364 -- # decimal 1 00:05:20.709 19:03:39 -- scripts/common.sh@352 -- # local d=1 00:05:20.709 19:03:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:20.709 19:03:39 -- scripts/common.sh@354 -- # echo 1 00:05:20.709 19:03:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:20.709 19:03:39 -- scripts/common.sh@365 -- # decimal 2 00:05:20.709 19:03:39 -- scripts/common.sh@352 -- # local d=2 00:05:20.709 19:03:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:20.709 19:03:39 -- scripts/common.sh@354 -- # echo 2 00:05:20.709 19:03:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:20.709 19:03:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:20.709 19:03:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:20.709 19:03:39 -- scripts/common.sh@367 -- # return 0 00:05:20.709 19:03:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:20.709 19:03:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:20.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.709 --rc genhtml_branch_coverage=1 00:05:20.709 --rc genhtml_function_coverage=1 00:05:20.709 --rc genhtml_legend=1 00:05:20.709 --rc geninfo_all_blocks=1 00:05:20.709 --rc geninfo_unexecuted_blocks=1 00:05:20.709 00:05:20.709 ' 00:05:20.709 19:03:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:20.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.709 --rc genhtml_branch_coverage=1 00:05:20.709 --rc genhtml_function_coverage=1 00:05:20.709 --rc genhtml_legend=1 00:05:20.709 --rc geninfo_all_blocks=1 00:05:20.709 --rc geninfo_unexecuted_blocks=1 00:05:20.709 00:05:20.709 ' 00:05:20.709 19:03:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:20.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.709 --rc genhtml_branch_coverage=1 00:05:20.709 --rc genhtml_function_coverage=1 00:05:20.709 --rc genhtml_legend=1 00:05:20.709 --rc geninfo_all_blocks=1 00:05:20.709 --rc geninfo_unexecuted_blocks=1 00:05:20.709 00:05:20.709 ' 00:05:20.709 19:03:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:20.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.709 --rc genhtml_branch_coverage=1 00:05:20.709 --rc genhtml_function_coverage=1 00:05:20.709 --rc genhtml_legend=1 00:05:20.709 --rc geninfo_all_blocks=1 00:05:20.709 --rc geninfo_unexecuted_blocks=1 00:05:20.709 00:05:20.709 ' 00:05:20.709 19:03:39 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:20.709 19:03:39 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:20.709 19:03:39 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:20.709 19:03:39 -- accel/accel.sh@59 -- # spdk_tgt_pid=3327599 00:05:20.709 19:03:39 -- accel/accel.sh@60 -- # waitforlisten 3327599 00:05:20.709 19:03:39 -- common/autotest_common.sh@829 -- # '[' -z 3327599 ']' 00:05:20.709 19:03:39 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:20.710 19:03:39 -- accel/accel.sh@58 -- # build_accel_config 00:05:20.710 19:03:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.710 19:03:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.710 19:03:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:20.710 19:03:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.710 19:03:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:20.710 19:03:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.710 19:03:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:20.710 19:03:39 -- common/autotest_common.sh@10 -- # set +x 00:05:20.710 19:03:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:20.710 19:03:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:20.710 19:03:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:20.710 19:03:39 -- accel/accel.sh@42 -- # jq -r . 00:05:20.710 [2024-11-18 19:03:39.127302] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.710 [2024-11-18 19:03:39.127394] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327599 ] 00:05:20.710 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.710 [2024-11-18 19:03:39.186534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.710 [2024-11-18 19:03:39.300156] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.710 [2024-11-18 19:03:39.300341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.644 19:03:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.645 19:03:40 -- common/autotest_common.sh@862 -- # return 0 00:05:21.645 19:03:40 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:21.645 19:03:40 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:21.645 19:03:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.645 19:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:21.645 19:03:40 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:21.645 19:03:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # IFS== 00:05:21.645 19:03:40 -- accel/accel.sh@64 -- # read -r opc module 00:05:21.645 19:03:40 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:21.645 19:03:40 -- accel/accel.sh@67 -- # killprocess 3327599 00:05:21.645 19:03:40 -- common/autotest_common.sh@936 -- # '[' -z 3327599 ']' 00:05:21.645 19:03:40 -- common/autotest_common.sh@940 -- # kill -0 3327599 00:05:21.645 19:03:40 -- common/autotest_common.sh@941 -- # uname 00:05:21.645 19:03:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.645 19:03:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3327599 00:05:21.645 19:03:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.645 19:03:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.645 19:03:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3327599' 00:05:21.645 killing process with pid 3327599 00:05:21.645 19:03:40 -- common/autotest_common.sh@955 -- # kill 3327599 00:05:21.645 19:03:40 -- common/autotest_common.sh@960 -- # wait 3327599 00:05:22.212 19:03:40 -- accel/accel.sh@68 -- # trap - ERR 00:05:22.212 19:03:40 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:22.212 19:03:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:22.212 19:03:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.212 19:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:22.212 19:03:40 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:22.212 19:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:22.212 19:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.212 19:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.212 19:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.212 19:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.212 19:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.212 19:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.212 19:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.212 19:03:40 -- accel/accel.sh@42 -- # jq -r . 00:05:22.212 19:03:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.212 19:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:22.212 19:03:40 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:22.212 19:03:40 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:22.212 19:03:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.212 19:03:40 -- common/autotest_common.sh@10 -- # set +x 00:05:22.212 ************************************ 00:05:22.212 START TEST accel_missing_filename 00:05:22.212 ************************************ 00:05:22.212 19:03:40 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:22.212 19:03:40 -- common/autotest_common.sh@650 -- # local es=0 00:05:22.212 19:03:40 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:22.212 19:03:40 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:22.212 19:03:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.212 19:03:40 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:22.212 19:03:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.212 19:03:40 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:22.212 19:03:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:22.212 19:03:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.212 19:03:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.212 19:03:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.212 19:03:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.212 19:03:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.212 19:03:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.212 19:03:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.212 19:03:40 -- accel/accel.sh@42 -- # jq -r . 00:05:22.212 [2024-11-18 19:03:40.682852] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.212 [2024-11-18 19:03:40.682947] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327772 ] 00:05:22.212 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.212 [2024-11-18 19:03:40.743172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.470 [2024-11-18 19:03:40.859873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.470 [2024-11-18 19:03:40.918377] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:22.470 [2024-11-18 19:03:40.991705] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:22.728 A filename is required. 00:05:22.728 19:03:41 -- common/autotest_common.sh@653 -- # es=234 00:05:22.728 19:03:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:22.728 19:03:41 -- common/autotest_common.sh@662 -- # es=106 00:05:22.728 19:03:41 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:22.728 19:03:41 -- common/autotest_common.sh@670 -- # es=1 00:05:22.728 19:03:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:22.728 00:05:22.728 real 0m0.448s 00:05:22.728 user 0m0.337s 00:05:22.728 sys 0m0.140s 00:05:22.728 19:03:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.728 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:22.728 ************************************ 00:05:22.728 END TEST accel_missing_filename 00:05:22.728 ************************************ 00:05:22.728 19:03:41 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.728 19:03:41 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:22.728 19:03:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.729 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:22.729 ************************************ 00:05:22.729 START TEST accel_compress_verify 00:05:22.729 ************************************ 00:05:22.729 19:03:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.729 19:03:41 -- common/autotest_common.sh@650 -- # local es=0 00:05:22.729 19:03:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.729 19:03:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:22.729 19:03:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.729 19:03:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:22.729 19:03:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.729 19:03:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.729 19:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:22.729 19:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.729 19:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.729 19:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.729 19:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.729 19:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.729 19:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.729 19:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.729 19:03:41 -- accel/accel.sh@42 -- # jq -r . 00:05:22.729 [2024-11-18 19:03:41.160871] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.729 [2024-11-18 19:03:41.160959] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327923 ] 00:05:22.729 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.729 [2024-11-18 19:03:41.223710] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.987 [2024-11-18 19:03:41.338621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.987 [2024-11-18 19:03:41.397018] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:22.987 [2024-11-18 19:03:41.474063] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:23.246 00:05:23.246 Compression does not support the verify option, aborting. 00:05:23.246 19:03:41 -- common/autotest_common.sh@653 -- # es=161 00:05:23.246 19:03:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:23.246 19:03:41 -- common/autotest_common.sh@662 -- # es=33 00:05:23.246 19:03:41 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:23.246 19:03:41 -- common/autotest_common.sh@670 -- # es=1 00:05:23.246 19:03:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:23.246 00:05:23.246 real 0m0.456s 00:05:23.246 user 0m0.356s 00:05:23.246 sys 0m0.133s 00:05:23.246 19:03:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.246 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.246 ************************************ 00:05:23.246 END TEST accel_compress_verify 00:05:23.246 ************************************ 00:05:23.246 19:03:41 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:23.246 19:03:41 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:23.246 19:03:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.246 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.246 ************************************ 00:05:23.246 START TEST accel_wrong_workload 00:05:23.246 ************************************ 00:05:23.246 19:03:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:23.246 19:03:41 -- common/autotest_common.sh@650 -- # local es=0 00:05:23.246 19:03:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:23.246 19:03:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:23.246 19:03:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.246 19:03:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:23.246 19:03:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.246 19:03:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:23.246 19:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:23.246 19:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:23.246 19:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.246 19:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.246 19:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.246 19:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.246 19:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.246 19:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.246 19:03:41 -- accel/accel.sh@42 -- # jq -r . 00:05:23.246 Unsupported workload type: foobar 00:05:23.246 [2024-11-18 19:03:41.643036] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:23.246 accel_perf options: 00:05:23.246 [-h help message] 00:05:23.246 [-q queue depth per core] 00:05:23.246 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:23.246 [-T number of threads per core 00:05:23.246 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:23.246 [-t time in seconds] 00:05:23.246 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:23.246 [ dif_verify, , dif_generate, dif_generate_copy 00:05:23.246 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:23.246 [-l for compress/decompress workloads, name of uncompressed input file 00:05:23.246 [-S for crc32c workload, use this seed value (default 0) 00:05:23.246 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:23.246 [-f for fill workload, use this BYTE value (default 255) 00:05:23.246 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:23.246 [-y verify result if this switch is on] 00:05:23.246 [-a tasks to allocate per core (default: same value as -q)] 00:05:23.246 Can be used to spread operations across a wider range of memory. 00:05:23.246 19:03:41 -- common/autotest_common.sh@653 -- # es=1 00:05:23.246 19:03:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:23.246 19:03:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:23.246 19:03:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:23.246 00:05:23.246 real 0m0.025s 00:05:23.246 user 0m0.010s 00:05:23.246 sys 0m0.015s 00:05:23.246 19:03:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.246 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.246 ************************************ 00:05:23.246 END TEST accel_wrong_workload 00:05:23.246 ************************************ 00:05:23.246 Error: writing output failed: Broken pipe 00:05:23.246 19:03:41 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:23.246 19:03:41 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:23.246 19:03:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.246 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.246 ************************************ 00:05:23.246 START TEST accel_negative_buffers 00:05:23.246 ************************************ 00:05:23.246 19:03:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:23.246 19:03:41 -- common/autotest_common.sh@650 -- # local es=0 00:05:23.246 19:03:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:23.246 19:03:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:23.246 19:03:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.246 19:03:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:23.246 19:03:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.246 19:03:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:23.246 19:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:23.246 19:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:23.246 19:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.246 19:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.246 19:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.246 19:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.246 19:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.246 19:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.246 19:03:41 -- accel/accel.sh@42 -- # jq -r . 00:05:23.246 -x option must be non-negative. 00:05:23.246 [2024-11-18 19:03:41.688583] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:23.246 accel_perf options: 00:05:23.246 [-h help message] 00:05:23.246 [-q queue depth per core] 00:05:23.246 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:23.246 [-T number of threads per core 00:05:23.246 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:23.246 [-t time in seconds] 00:05:23.246 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:23.246 [ dif_verify, , dif_generate, dif_generate_copy 00:05:23.246 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:23.246 [-l for compress/decompress workloads, name of uncompressed input file 00:05:23.246 [-S for crc32c workload, use this seed value (default 0) 00:05:23.246 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:23.246 [-f for fill workload, use this BYTE value (default 255) 00:05:23.246 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:23.246 [-y verify result if this switch is on] 00:05:23.246 [-a tasks to allocate per core (default: same value as -q)] 00:05:23.246 Can be used to spread operations across a wider range of memory. 00:05:23.246 19:03:41 -- common/autotest_common.sh@653 -- # es=1 00:05:23.246 19:03:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:23.246 19:03:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:23.246 19:03:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:23.246 00:05:23.246 real 0m0.022s 00:05:23.246 user 0m0.011s 00:05:23.246 sys 0m0.012s 00:05:23.246 19:03:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.246 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.246 ************************************ 00:05:23.246 END TEST accel_negative_buffers 00:05:23.246 ************************************ 00:05:23.246 Error: writing output failed: Broken pipe 00:05:23.246 19:03:41 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:23.246 19:03:41 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:23.246 19:03:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.246 19:03:41 -- common/autotest_common.sh@10 -- # set +x 00:05:23.246 ************************************ 00:05:23.246 START TEST accel_crc32c 00:05:23.246 ************************************ 00:05:23.246 19:03:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:23.246 19:03:41 -- accel/accel.sh@16 -- # local accel_opc 00:05:23.246 19:03:41 -- accel/accel.sh@17 -- # local accel_module 00:05:23.247 19:03:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:23.247 19:03:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:23.247 19:03:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:23.247 19:03:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.247 19:03:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.247 19:03:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.247 19:03:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.247 19:03:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.247 19:03:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.247 19:03:41 -- accel/accel.sh@42 -- # jq -r . 00:05:23.247 [2024-11-18 19:03:41.737072] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.247 [2024-11-18 19:03:41.737145] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3327981 ] 00:05:23.247 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.247 [2024-11-18 19:03:41.801350] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.505 [2024-11-18 19:03:41.919360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.878 19:03:43 -- accel/accel.sh@18 -- # out=' 00:05:24.878 SPDK Configuration: 00:05:24.878 Core mask: 0x1 00:05:24.878 00:05:24.878 Accel Perf Configuration: 00:05:24.878 Workload Type: crc32c 00:05:24.878 CRC-32C seed: 32 00:05:24.878 Transfer size: 4096 bytes 00:05:24.878 Vector count 1 00:05:24.878 Module: software 00:05:24.878 Queue depth: 32 00:05:24.878 Allocate depth: 32 00:05:24.878 # threads/core: 1 00:05:24.878 Run time: 1 seconds 00:05:24.878 Verify: Yes 00:05:24.878 00:05:24.878 Running for 1 seconds... 00:05:24.878 00:05:24.878 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:24.878 ------------------------------------------------------------------------------------ 00:05:24.878 0,0 414624/s 1619 MiB/s 0 0 00:05:24.878 ==================================================================================== 00:05:24.878 Total 414624/s 1619 MiB/s 0 0' 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:24.878 19:03:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:24.878 19:03:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:24.878 19:03:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:24.878 19:03:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:24.878 19:03:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:24.878 19:03:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:24.878 19:03:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:24.878 19:03:43 -- accel/accel.sh@42 -- # jq -r . 00:05:24.878 [2024-11-18 19:03:43.205097] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.878 [2024-11-18 19:03:43.205183] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328239 ] 00:05:24.878 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.878 [2024-11-18 19:03:43.265376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.878 [2024-11-18 19:03:43.379682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val=0x1 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val=crc32c 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val=32 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:24.878 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.878 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.878 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val=software 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@23 -- # accel_module=software 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val=32 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val=32 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val=1 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val=Yes 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:24.879 19:03:43 -- accel/accel.sh@21 -- # val= 00:05:24.879 19:03:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # IFS=: 00:05:24.879 19:03:43 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@21 -- # val= 00:05:26.253 19:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@21 -- # val= 00:05:26.253 19:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@21 -- # val= 00:05:26.253 19:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@21 -- # val= 00:05:26.253 19:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@21 -- # val= 00:05:26.253 19:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@21 -- # val= 00:05:26.253 19:03:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # IFS=: 00:05:26.253 19:03:44 -- accel/accel.sh@20 -- # read -r var val 00:05:26.253 19:03:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:26.253 19:03:44 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:26.253 19:03:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:26.253 00:05:26.253 real 0m2.936s 00:05:26.253 user 0m2.632s 00:05:26.253 sys 0m0.296s 00:05:26.253 19:03:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.254 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:05:26.254 ************************************ 00:05:26.254 END TEST accel_crc32c 00:05:26.254 ************************************ 00:05:26.254 19:03:44 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:26.254 19:03:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:26.254 19:03:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.254 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:05:26.254 ************************************ 00:05:26.254 START TEST accel_crc32c_C2 00:05:26.254 ************************************ 00:05:26.254 19:03:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:26.254 19:03:44 -- accel/accel.sh@16 -- # local accel_opc 00:05:26.254 19:03:44 -- accel/accel.sh@17 -- # local accel_module 00:05:26.254 19:03:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:26.254 19:03:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:26.254 19:03:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.254 19:03:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.254 19:03:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.254 19:03:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.254 19:03:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.254 19:03:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.254 19:03:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.254 19:03:44 -- accel/accel.sh@42 -- # jq -r . 00:05:26.254 [2024-11-18 19:03:44.695367] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.254 [2024-11-18 19:03:44.695455] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328404 ] 00:05:26.254 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.254 [2024-11-18 19:03:44.756102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.512 [2024-11-18 19:03:44.873339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.885 19:03:46 -- accel/accel.sh@18 -- # out=' 00:05:27.885 SPDK Configuration: 00:05:27.885 Core mask: 0x1 00:05:27.885 00:05:27.885 Accel Perf Configuration: 00:05:27.885 Workload Type: crc32c 00:05:27.885 CRC-32C seed: 0 00:05:27.885 Transfer size: 4096 bytes 00:05:27.885 Vector count 2 00:05:27.885 Module: software 00:05:27.885 Queue depth: 32 00:05:27.885 Allocate depth: 32 00:05:27.885 # threads/core: 1 00:05:27.885 Run time: 1 seconds 00:05:27.885 Verify: Yes 00:05:27.885 00:05:27.885 Running for 1 seconds... 00:05:27.885 00:05:27.885 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:27.885 ------------------------------------------------------------------------------------ 00:05:27.885 0,0 315264/s 2463 MiB/s 0 0 00:05:27.885 ==================================================================================== 00:05:27.885 Total 315264/s 1231 MiB/s 0 0' 00:05:27.885 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:27.886 19:03:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.886 19:03:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.886 19:03:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.886 19:03:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.886 19:03:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.886 19:03:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.886 19:03:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.886 19:03:46 -- accel/accel.sh@42 -- # jq -r . 00:05:27.886 [2024-11-18 19:03:46.149959] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.886 [2024-11-18 19:03:46.150049] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328553 ] 00:05:27.886 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.886 [2024-11-18 19:03:46.210835] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.886 [2024-11-18 19:03:46.326525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=0x1 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=crc32c 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=0 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=software 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=32 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=32 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=1 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val=Yes 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:27.886 19:03:46 -- accel/accel.sh@21 -- # val= 00:05:27.886 19:03:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # IFS=: 00:05:27.886 19:03:46 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@21 -- # val= 00:05:29.306 19:03:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@21 -- # val= 00:05:29.306 19:03:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@21 -- # val= 00:05:29.306 19:03:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@21 -- # val= 00:05:29.306 19:03:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@21 -- # val= 00:05:29.306 19:03:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@21 -- # val= 00:05:29.306 19:03:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # IFS=: 00:05:29.306 19:03:47 -- accel/accel.sh@20 -- # read -r var val 00:05:29.306 19:03:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:29.306 19:03:47 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:29.306 19:03:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:29.306 00:05:29.306 real 0m2.924s 00:05:29.306 user 0m2.629s 00:05:29.306 sys 0m0.286s 00:05:29.306 19:03:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.306 19:03:47 -- common/autotest_common.sh@10 -- # set +x 00:05:29.306 ************************************ 00:05:29.306 END TEST accel_crc32c_C2 00:05:29.306 ************************************ 00:05:29.306 19:03:47 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:29.306 19:03:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:29.306 19:03:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.306 19:03:47 -- common/autotest_common.sh@10 -- # set +x 00:05:29.306 ************************************ 00:05:29.306 START TEST accel_copy 00:05:29.306 ************************************ 00:05:29.306 19:03:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:29.306 19:03:47 -- accel/accel.sh@16 -- # local accel_opc 00:05:29.306 19:03:47 -- accel/accel.sh@17 -- # local accel_module 00:05:29.306 19:03:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:29.306 19:03:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:29.306 19:03:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.306 19:03:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.306 19:03:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.306 19:03:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.306 19:03:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.306 19:03:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.306 19:03:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.306 19:03:47 -- accel/accel.sh@42 -- # jq -r . 00:05:29.306 [2024-11-18 19:03:47.648124] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.306 [2024-11-18 19:03:47.648217] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328728 ] 00:05:29.306 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.306 [2024-11-18 19:03:47.711902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.306 [2024-11-18 19:03:47.826317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.679 19:03:49 -- accel/accel.sh@18 -- # out=' 00:05:30.679 SPDK Configuration: 00:05:30.679 Core mask: 0x1 00:05:30.679 00:05:30.679 Accel Perf Configuration: 00:05:30.679 Workload Type: copy 00:05:30.679 Transfer size: 4096 bytes 00:05:30.679 Vector count 1 00:05:30.679 Module: software 00:05:30.680 Queue depth: 32 00:05:30.680 Allocate depth: 32 00:05:30.680 # threads/core: 1 00:05:30.680 Run time: 1 seconds 00:05:30.680 Verify: Yes 00:05:30.680 00:05:30.680 Running for 1 seconds... 00:05:30.680 00:05:30.680 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.680 ------------------------------------------------------------------------------------ 00:05:30.680 0,0 278688/s 1088 MiB/s 0 0 00:05:30.680 ==================================================================================== 00:05:30.680 Total 278688/s 1088 MiB/s 0 0' 00:05:30.680 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.680 19:03:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:30.680 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.680 19:03:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:30.680 19:03:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.680 19:03:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.680 19:03:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.680 19:03:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.680 19:03:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.680 19:03:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.680 19:03:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.680 19:03:49 -- accel/accel.sh@42 -- # jq -r . 00:05:30.680 [2024-11-18 19:03:49.106581] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.680 [2024-11-18 19:03:49.106698] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3328980 ] 00:05:30.680 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.680 [2024-11-18 19:03:49.166499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.680 [2024-11-18 19:03:49.282643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=0x1 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=copy 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=software 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=32 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=32 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=1 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val=Yes 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:30.939 19:03:49 -- accel/accel.sh@21 -- # val= 00:05:30.939 19:03:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # IFS=: 00:05:30.939 19:03:49 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@21 -- # val= 00:05:32.312 19:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@21 -- # val= 00:05:32.312 19:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@21 -- # val= 00:05:32.312 19:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@21 -- # val= 00:05:32.312 19:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@21 -- # val= 00:05:32.312 19:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@21 -- # val= 00:05:32.312 19:03:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # IFS=: 00:05:32.312 19:03:50 -- accel/accel.sh@20 -- # read -r var val 00:05:32.312 19:03:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:32.312 19:03:50 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:32.312 19:03:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:32.312 00:05:32.312 real 0m2.933s 00:05:32.312 user 0m2.623s 00:05:32.312 sys 0m0.300s 00:05:32.312 19:03:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.312 19:03:50 -- common/autotest_common.sh@10 -- # set +x 00:05:32.312 ************************************ 00:05:32.312 END TEST accel_copy 00:05:32.312 ************************************ 00:05:32.312 19:03:50 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:32.312 19:03:50 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:32.312 19:03:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.312 19:03:50 -- common/autotest_common.sh@10 -- # set +x 00:05:32.312 ************************************ 00:05:32.312 START TEST accel_fill 00:05:32.312 ************************************ 00:05:32.312 19:03:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:32.312 19:03:50 -- accel/accel.sh@16 -- # local accel_opc 00:05:32.312 19:03:50 -- accel/accel.sh@17 -- # local accel_module 00:05:32.312 19:03:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:32.312 19:03:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:32.312 19:03:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.312 19:03:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.312 19:03:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.312 19:03:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.312 19:03:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.312 19:03:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.312 19:03:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.312 19:03:50 -- accel/accel.sh@42 -- # jq -r . 00:05:32.312 [2024-11-18 19:03:50.602799] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.312 [2024-11-18 19:03:50.602883] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329137 ] 00:05:32.312 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.312 [2024-11-18 19:03:50.666948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.312 [2024-11-18 19:03:50.783263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.683 19:03:52 -- accel/accel.sh@18 -- # out=' 00:05:33.683 SPDK Configuration: 00:05:33.683 Core mask: 0x1 00:05:33.683 00:05:33.683 Accel Perf Configuration: 00:05:33.683 Workload Type: fill 00:05:33.683 Fill pattern: 0x80 00:05:33.683 Transfer size: 4096 bytes 00:05:33.683 Vector count 1 00:05:33.683 Module: software 00:05:33.683 Queue depth: 64 00:05:33.683 Allocate depth: 64 00:05:33.683 # threads/core: 1 00:05:33.683 Run time: 1 seconds 00:05:33.683 Verify: Yes 00:05:33.683 00:05:33.683 Running for 1 seconds... 00:05:33.683 00:05:33.683 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.683 ------------------------------------------------------------------------------------ 00:05:33.683 0,0 403264/s 1575 MiB/s 0 0 00:05:33.683 ==================================================================================== 00:05:33.683 Total 403264/s 1575 MiB/s 0 0' 00:05:33.683 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.683 19:03:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:33.683 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.683 19:03:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:33.683 19:03:52 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.683 19:03:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.683 19:03:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.683 19:03:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.683 19:03:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.683 19:03:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.683 19:03:52 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.683 19:03:52 -- accel/accel.sh@42 -- # jq -r . 00:05:33.683 [2024-11-18 19:03:52.074447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.683 [2024-11-18 19:03:52.074539] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329284 ] 00:05:33.683 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.683 [2024-11-18 19:03:52.135408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.683 [2024-11-18 19:03:52.254566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=0x1 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=fill 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=0x80 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=software 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=64 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=64 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=1 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val=Yes 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:33.941 19:03:52 -- accel/accel.sh@21 -- # val= 00:05:33.941 19:03:52 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # IFS=: 00:05:33.941 19:03:52 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@21 -- # val= 00:05:35.315 19:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@21 -- # val= 00:05:35.315 19:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@21 -- # val= 00:05:35.315 19:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@21 -- # val= 00:05:35.315 19:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@21 -- # val= 00:05:35.315 19:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@21 -- # val= 00:05:35.315 19:03:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # IFS=: 00:05:35.315 19:03:53 -- accel/accel.sh@20 -- # read -r var val 00:05:35.315 19:03:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:35.315 19:03:53 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:35.315 19:03:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:35.315 00:05:35.315 real 0m2.928s 00:05:35.315 user 0m2.611s 00:05:35.315 sys 0m0.306s 00:05:35.315 19:03:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.315 19:03:53 -- common/autotest_common.sh@10 -- # set +x 00:05:35.315 ************************************ 00:05:35.315 END TEST accel_fill 00:05:35.315 ************************************ 00:05:35.315 19:03:53 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:35.315 19:03:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.315 19:03:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.315 19:03:53 -- common/autotest_common.sh@10 -- # set +x 00:05:35.315 ************************************ 00:05:35.315 START TEST accel_copy_crc32c 00:05:35.315 ************************************ 00:05:35.315 19:03:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:35.315 19:03:53 -- accel/accel.sh@16 -- # local accel_opc 00:05:35.315 19:03:53 -- accel/accel.sh@17 -- # local accel_module 00:05:35.315 19:03:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:35.315 19:03:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:35.315 19:03:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.315 19:03:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.315 19:03:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.315 19:03:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.315 19:03:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.315 19:03:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.315 19:03:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.315 19:03:53 -- accel/accel.sh@42 -- # jq -r . 00:05:35.315 [2024-11-18 19:03:53.555296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.315 [2024-11-18 19:03:53.555388] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329563 ] 00:05:35.315 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.315 [2024-11-18 19:03:53.615746] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.315 [2024-11-18 19:03:53.732135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.688 19:03:55 -- accel/accel.sh@18 -- # out=' 00:05:36.688 SPDK Configuration: 00:05:36.688 Core mask: 0x1 00:05:36.688 00:05:36.688 Accel Perf Configuration: 00:05:36.688 Workload Type: copy_crc32c 00:05:36.688 CRC-32C seed: 0 00:05:36.688 Vector size: 4096 bytes 00:05:36.688 Transfer size: 4096 bytes 00:05:36.688 Vector count 1 00:05:36.688 Module: software 00:05:36.688 Queue depth: 32 00:05:36.688 Allocate depth: 32 00:05:36.688 # threads/core: 1 00:05:36.688 Run time: 1 seconds 00:05:36.688 Verify: Yes 00:05:36.688 00:05:36.688 Running for 1 seconds... 00:05:36.688 00:05:36.688 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.688 ------------------------------------------------------------------------------------ 00:05:36.688 0,0 218400/s 853 MiB/s 0 0 00:05:36.688 ==================================================================================== 00:05:36.688 Total 218400/s 853 MiB/s 0 0' 00:05:36.688 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.688 19:03:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:36.688 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.688 19:03:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:36.688 19:03:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.688 19:03:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.688 19:03:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.688 19:03:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.688 19:03:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.688 19:03:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.689 19:03:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.689 19:03:55 -- accel/accel.sh@42 -- # jq -r . 00:05:36.689 [2024-11-18 19:03:55.027861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.689 [2024-11-18 19:03:55.027965] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329707 ] 00:05:36.689 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.689 [2024-11-18 19:03:55.087590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.689 [2024-11-18 19:03:55.203232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=0x1 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=0 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=software 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=32 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=32 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=1 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val=Yes 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:36.689 19:03:55 -- accel/accel.sh@21 -- # val= 00:05:36.689 19:03:55 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # IFS=: 00:05:36.689 19:03:55 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@21 -- # val= 00:05:38.061 19:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@21 -- # val= 00:05:38.061 19:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@21 -- # val= 00:05:38.061 19:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@21 -- # val= 00:05:38.061 19:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@21 -- # val= 00:05:38.061 19:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@21 -- # val= 00:05:38.061 19:03:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # IFS=: 00:05:38.061 19:03:56 -- accel/accel.sh@20 -- # read -r var val 00:05:38.061 19:03:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:38.061 19:03:56 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:38.061 19:03:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:38.061 00:05:38.061 real 0m2.933s 00:05:38.061 user 0m2.636s 00:05:38.061 sys 0m0.287s 00:05:38.061 19:03:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.061 19:03:56 -- common/autotest_common.sh@10 -- # set +x 00:05:38.061 ************************************ 00:05:38.061 END TEST accel_copy_crc32c 00:05:38.061 ************************************ 00:05:38.061 19:03:56 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:38.061 19:03:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:38.061 19:03:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.061 19:03:56 -- common/autotest_common.sh@10 -- # set +x 00:05:38.061 ************************************ 00:05:38.061 START TEST accel_copy_crc32c_C2 00:05:38.061 ************************************ 00:05:38.061 19:03:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:38.061 19:03:56 -- accel/accel.sh@16 -- # local accel_opc 00:05:38.061 19:03:56 -- accel/accel.sh@17 -- # local accel_module 00:05:38.061 19:03:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:38.061 19:03:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:38.061 19:03:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.061 19:03:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.061 19:03:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.061 19:03:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.061 19:03:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.061 19:03:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.061 19:03:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.061 19:03:56 -- accel/accel.sh@42 -- # jq -r . 00:05:38.061 [2024-11-18 19:03:56.510787] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.061 [2024-11-18 19:03:56.510874] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3329867 ] 00:05:38.061 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.061 [2024-11-18 19:03:56.571149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.319 [2024-11-18 19:03:56.690077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.693 19:03:57 -- accel/accel.sh@18 -- # out=' 00:05:39.693 SPDK Configuration: 00:05:39.693 Core mask: 0x1 00:05:39.693 00:05:39.693 Accel Perf Configuration: 00:05:39.693 Workload Type: copy_crc32c 00:05:39.693 CRC-32C seed: 0 00:05:39.693 Vector size: 4096 bytes 00:05:39.693 Transfer size: 8192 bytes 00:05:39.693 Vector count 2 00:05:39.693 Module: software 00:05:39.693 Queue depth: 32 00:05:39.693 Allocate depth: 32 00:05:39.693 # threads/core: 1 00:05:39.693 Run time: 1 seconds 00:05:39.693 Verify: Yes 00:05:39.693 00:05:39.693 Running for 1 seconds... 00:05:39.693 00:05:39.693 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.693 ------------------------------------------------------------------------------------ 00:05:39.693 0,0 154720/s 1208 MiB/s 0 0 00:05:39.693 ==================================================================================== 00:05:39.693 Total 154720/s 604 MiB/s 0 0' 00:05:39.693 19:03:57 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:39.693 19:03:57 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:39.693 19:03:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.693 19:03:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.693 19:03:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.693 19:03:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.693 19:03:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.693 19:03:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.693 19:03:57 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.693 19:03:57 -- accel/accel.sh@42 -- # jq -r . 00:05:39.693 [2024-11-18 19:03:57.978386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.693 [2024-11-18 19:03:57.978472] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330128 ] 00:05:39.693 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.693 [2024-11-18 19:03:58.043061] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.693 [2024-11-18 19:03:58.163358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val=0x1 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val=0 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.693 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.693 19:03:58 -- accel/accel.sh@21 -- # val=software 00:05:39.693 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.693 19:03:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val=32 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val=32 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val=1 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val=Yes 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.694 19:03:58 -- accel/accel.sh@21 -- # val= 00:05:39.694 19:03:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # IFS=: 00:05:39.694 19:03:58 -- accel/accel.sh@20 -- # read -r var val 00:05:41.067 19:03:59 -- accel/accel.sh@21 -- # val= 00:05:41.067 19:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.067 19:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.067 19:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.067 19:03:59 -- accel/accel.sh@21 -- # val= 00:05:41.067 19:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.068 19:03:59 -- accel/accel.sh@21 -- # val= 00:05:41.068 19:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.068 19:03:59 -- accel/accel.sh@21 -- # val= 00:05:41.068 19:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.068 19:03:59 -- accel/accel.sh@21 -- # val= 00:05:41.068 19:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.068 19:03:59 -- accel/accel.sh@21 -- # val= 00:05:41.068 19:03:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # IFS=: 00:05:41.068 19:03:59 -- accel/accel.sh@20 -- # read -r var val 00:05:41.068 19:03:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.068 19:03:59 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:41.068 19:03:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.068 00:05:41.068 real 0m2.956s 00:05:41.068 user 0m2.659s 00:05:41.068 sys 0m0.288s 00:05:41.068 19:03:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.068 19:03:59 -- common/autotest_common.sh@10 -- # set +x 00:05:41.068 ************************************ 00:05:41.068 END TEST accel_copy_crc32c_C2 00:05:41.068 ************************************ 00:05:41.068 19:03:59 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:41.068 19:03:59 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:41.068 19:03:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.068 19:03:59 -- common/autotest_common.sh@10 -- # set +x 00:05:41.068 ************************************ 00:05:41.068 START TEST accel_dualcast 00:05:41.068 ************************************ 00:05:41.068 19:03:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:41.068 19:03:59 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.068 19:03:59 -- accel/accel.sh@17 -- # local accel_module 00:05:41.068 19:03:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:41.068 19:03:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:41.068 19:03:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.068 19:03:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.068 19:03:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.068 19:03:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.068 19:03:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.068 19:03:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.068 19:03:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.068 19:03:59 -- accel/accel.sh@42 -- # jq -r . 00:05:41.068 [2024-11-18 19:03:59.492783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.068 [2024-11-18 19:03:59.492877] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330290 ] 00:05:41.068 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.068 [2024-11-18 19:03:59.554237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.326 [2024-11-18 19:03:59.674340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.699 19:04:00 -- accel/accel.sh@18 -- # out=' 00:05:42.699 SPDK Configuration: 00:05:42.699 Core mask: 0x1 00:05:42.699 00:05:42.699 Accel Perf Configuration: 00:05:42.699 Workload Type: dualcast 00:05:42.699 Transfer size: 4096 bytes 00:05:42.699 Vector count 1 00:05:42.699 Module: software 00:05:42.699 Queue depth: 32 00:05:42.699 Allocate depth: 32 00:05:42.699 # threads/core: 1 00:05:42.699 Run time: 1 seconds 00:05:42.699 Verify: Yes 00:05:42.699 00:05:42.699 Running for 1 seconds... 00:05:42.699 00:05:42.699 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.699 ------------------------------------------------------------------------------------ 00:05:42.699 0,0 293376/s 1146 MiB/s 0 0 00:05:42.699 ==================================================================================== 00:05:42.699 Total 293376/s 1146 MiB/s 0 0' 00:05:42.699 19:04:00 -- accel/accel.sh@20 -- # IFS=: 00:05:42.699 19:04:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:42.699 19:04:00 -- accel/accel.sh@20 -- # read -r var val 00:05:42.699 19:04:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:42.699 19:04:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.699 19:04:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.699 19:04:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.699 19:04:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.699 19:04:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.699 19:04:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.700 19:04:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.700 19:04:00 -- accel/accel.sh@42 -- # jq -r . 00:05:42.700 [2024-11-18 19:04:00.975038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.700 [2024-11-18 19:04:00.975126] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330432 ] 00:05:42.700 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.700 [2024-11-18 19:04:01.036226] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.700 [2024-11-18 19:04:01.155062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=0x1 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=dualcast 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=software 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=32 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=32 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=1 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val=Yes 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.700 19:04:01 -- accel/accel.sh@21 -- # val= 00:05:42.700 19:04:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # IFS=: 00:05:42.700 19:04:01 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@21 -- # val= 00:05:44.074 19:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@21 -- # val= 00:05:44.074 19:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@21 -- # val= 00:05:44.074 19:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@21 -- # val= 00:05:44.074 19:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@21 -- # val= 00:05:44.074 19:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@21 -- # val= 00:05:44.074 19:04:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # IFS=: 00:05:44.074 19:04:02 -- accel/accel.sh@20 -- # read -r var val 00:05:44.074 19:04:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.074 19:04:02 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:44.074 19:04:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.074 00:05:44.074 real 0m2.964s 00:05:44.074 user 0m2.660s 00:05:44.074 sys 0m0.294s 00:05:44.074 19:04:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.074 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:05:44.074 ************************************ 00:05:44.074 END TEST accel_dualcast 00:05:44.074 ************************************ 00:05:44.074 19:04:02 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:44.074 19:04:02 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:44.074 19:04:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.074 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:05:44.074 ************************************ 00:05:44.074 START TEST accel_compare 00:05:44.074 ************************************ 00:05:44.074 19:04:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:44.074 19:04:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.074 19:04:02 -- accel/accel.sh@17 -- # local accel_module 00:05:44.074 19:04:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:44.074 19:04:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:44.074 19:04:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.074 19:04:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.074 19:04:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.074 19:04:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.074 19:04:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.074 19:04:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.074 19:04:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.074 19:04:02 -- accel/accel.sh@42 -- # jq -r . 00:05:44.074 [2024-11-18 19:04:02.483159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.074 [2024-11-18 19:04:02.483245] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330696 ] 00:05:44.074 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.074 [2024-11-18 19:04:02.544137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.074 [2024-11-18 19:04:02.661452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.452 19:04:03 -- accel/accel.sh@18 -- # out=' 00:05:45.452 SPDK Configuration: 00:05:45.452 Core mask: 0x1 00:05:45.452 00:05:45.452 Accel Perf Configuration: 00:05:45.452 Workload Type: compare 00:05:45.452 Transfer size: 4096 bytes 00:05:45.452 Vector count 1 00:05:45.452 Module: software 00:05:45.452 Queue depth: 32 00:05:45.452 Allocate depth: 32 00:05:45.452 # threads/core: 1 00:05:45.452 Run time: 1 seconds 00:05:45.452 Verify: Yes 00:05:45.452 00:05:45.452 Running for 1 seconds... 00:05:45.452 00:05:45.452 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.452 ------------------------------------------------------------------------------------ 00:05:45.452 0,0 397280/s 1551 MiB/s 0 0 00:05:45.452 ==================================================================================== 00:05:45.452 Total 397280/s 1551 MiB/s 0 0' 00:05:45.452 19:04:03 -- accel/accel.sh@20 -- # IFS=: 00:05:45.452 19:04:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:45.452 19:04:03 -- accel/accel.sh@20 -- # read -r var val 00:05:45.452 19:04:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:45.452 19:04:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.452 19:04:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.452 19:04:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.452 19:04:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.452 19:04:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.452 19:04:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.452 19:04:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.452 19:04:03 -- accel/accel.sh@42 -- # jq -r . 00:05:45.452 [2024-11-18 19:04:03.958713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.452 [2024-11-18 19:04:03.958806] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3330856 ] 00:05:45.452 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.452 [2024-11-18 19:04:04.020734] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.710 [2024-11-18 19:04:04.141129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.710 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.710 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.710 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=0x1 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=compare 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=software 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=32 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=32 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=1 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val=Yes 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.711 19:04:04 -- accel/accel.sh@21 -- # val= 00:05:45.711 19:04:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # IFS=: 00:05:45.711 19:04:04 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@21 -- # val= 00:05:47.084 19:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # IFS=: 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@21 -- # val= 00:05:47.084 19:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # IFS=: 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@21 -- # val= 00:05:47.084 19:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # IFS=: 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@21 -- # val= 00:05:47.084 19:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # IFS=: 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@21 -- # val= 00:05:47.084 19:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # IFS=: 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@21 -- # val= 00:05:47.084 19:04:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # IFS=: 00:05:47.084 19:04:05 -- accel/accel.sh@20 -- # read -r var val 00:05:47.084 19:04:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.084 19:04:05 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:47.084 19:04:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.084 00:05:47.084 real 0m2.962s 00:05:47.084 user 0m2.666s 00:05:47.084 sys 0m0.288s 00:05:47.084 19:04:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.084 19:04:05 -- common/autotest_common.sh@10 -- # set +x 00:05:47.084 ************************************ 00:05:47.084 END TEST accel_compare 00:05:47.084 ************************************ 00:05:47.084 19:04:05 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:47.084 19:04:05 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:47.084 19:04:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.084 19:04:05 -- common/autotest_common.sh@10 -- # set +x 00:05:47.084 ************************************ 00:05:47.084 START TEST accel_xor 00:05:47.084 ************************************ 00:05:47.085 19:04:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:47.085 19:04:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.085 19:04:05 -- accel/accel.sh@17 -- # local accel_module 00:05:47.085 19:04:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:47.085 19:04:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:47.085 19:04:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.085 19:04:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.085 19:04:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.085 19:04:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.085 19:04:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.085 19:04:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.085 19:04:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.085 19:04:05 -- accel/accel.sh@42 -- # jq -r . 00:05:47.085 [2024-11-18 19:04:05.468555] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.085 [2024-11-18 19:04:05.468655] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331017 ] 00:05:47.085 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.085 [2024-11-18 19:04:05.530385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.085 [2024-11-18 19:04:05.648745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.459 19:04:06 -- accel/accel.sh@18 -- # out=' 00:05:48.459 SPDK Configuration: 00:05:48.459 Core mask: 0x1 00:05:48.459 00:05:48.459 Accel Perf Configuration: 00:05:48.459 Workload Type: xor 00:05:48.459 Source buffers: 2 00:05:48.459 Transfer size: 4096 bytes 00:05:48.459 Vector count 1 00:05:48.459 Module: software 00:05:48.459 Queue depth: 32 00:05:48.459 Allocate depth: 32 00:05:48.459 # threads/core: 1 00:05:48.459 Run time: 1 seconds 00:05:48.459 Verify: Yes 00:05:48.459 00:05:48.459 Running for 1 seconds... 00:05:48.459 00:05:48.459 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.459 ------------------------------------------------------------------------------------ 00:05:48.459 0,0 190592/s 744 MiB/s 0 0 00:05:48.459 ==================================================================================== 00:05:48.459 Total 190592/s 744 MiB/s 0 0' 00:05:48.459 19:04:06 -- accel/accel.sh@20 -- # IFS=: 00:05:48.459 19:04:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:48.459 19:04:06 -- accel/accel.sh@20 -- # read -r var val 00:05:48.459 19:04:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:48.459 19:04:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.459 19:04:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.459 19:04:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.459 19:04:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.459 19:04:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.459 19:04:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.459 19:04:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.460 19:04:06 -- accel/accel.sh@42 -- # jq -r . 00:05:48.460 [2024-11-18 19:04:06.944375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.460 [2024-11-18 19:04:06.944460] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331187 ] 00:05:48.460 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.460 [2024-11-18 19:04:07.007349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.718 [2024-11-18 19:04:07.126231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=0x1 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=xor 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=2 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=software 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=32 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=32 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=1 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val=Yes 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.718 19:04:07 -- accel/accel.sh@21 -- # val= 00:05:48.718 19:04:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # IFS=: 00:05:48.718 19:04:07 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@21 -- # val= 00:05:50.091 19:04:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # IFS=: 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@21 -- # val= 00:05:50.091 19:04:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # IFS=: 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@21 -- # val= 00:05:50.091 19:04:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # IFS=: 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@21 -- # val= 00:05:50.091 19:04:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # IFS=: 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@21 -- # val= 00:05:50.091 19:04:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # IFS=: 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@21 -- # val= 00:05:50.091 19:04:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # IFS=: 00:05:50.091 19:04:08 -- accel/accel.sh@20 -- # read -r var val 00:05:50.091 19:04:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.091 19:04:08 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:50.092 19:04:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.092 00:05:50.092 real 0m2.944s 00:05:50.092 user 0m2.644s 00:05:50.092 sys 0m0.292s 00:05:50.092 19:04:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.092 19:04:08 -- common/autotest_common.sh@10 -- # set +x 00:05:50.092 ************************************ 00:05:50.092 END TEST accel_xor 00:05:50.092 ************************************ 00:05:50.092 19:04:08 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:50.092 19:04:08 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:50.092 19:04:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.092 19:04:08 -- common/autotest_common.sh@10 -- # set +x 00:05:50.092 ************************************ 00:05:50.092 START TEST accel_xor 00:05:50.092 ************************************ 00:05:50.092 19:04:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:50.092 19:04:08 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.092 19:04:08 -- accel/accel.sh@17 -- # local accel_module 00:05:50.092 19:04:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:50.092 19:04:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:50.092 19:04:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.092 19:04:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.092 19:04:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.092 19:04:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.092 19:04:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.092 19:04:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.092 19:04:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.092 19:04:08 -- accel/accel.sh@42 -- # jq -r . 00:05:50.092 [2024-11-18 19:04:08.439591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.092 [2024-11-18 19:04:08.439697] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331445 ] 00:05:50.092 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.092 [2024-11-18 19:04:08.499336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.092 [2024-11-18 19:04:08.619649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.466 19:04:09 -- accel/accel.sh@18 -- # out=' 00:05:51.466 SPDK Configuration: 00:05:51.466 Core mask: 0x1 00:05:51.466 00:05:51.466 Accel Perf Configuration: 00:05:51.466 Workload Type: xor 00:05:51.466 Source buffers: 3 00:05:51.466 Transfer size: 4096 bytes 00:05:51.466 Vector count 1 00:05:51.466 Module: software 00:05:51.466 Queue depth: 32 00:05:51.466 Allocate depth: 32 00:05:51.466 # threads/core: 1 00:05:51.466 Run time: 1 seconds 00:05:51.466 Verify: Yes 00:05:51.466 00:05:51.466 Running for 1 seconds... 00:05:51.466 00:05:51.466 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.466 ------------------------------------------------------------------------------------ 00:05:51.466 0,0 183136/s 715 MiB/s 0 0 00:05:51.466 ==================================================================================== 00:05:51.466 Total 183136/s 715 MiB/s 0 0' 00:05:51.466 19:04:09 -- accel/accel.sh@20 -- # IFS=: 00:05:51.466 19:04:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:51.466 19:04:09 -- accel/accel.sh@20 -- # read -r var val 00:05:51.466 19:04:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:51.466 19:04:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.466 19:04:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.466 19:04:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.466 19:04:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.466 19:04:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.466 19:04:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.466 19:04:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.466 19:04:09 -- accel/accel.sh@42 -- # jq -r . 00:05:51.466 [2024-11-18 19:04:09.922601] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.466 [2024-11-18 19:04:09.922706] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331583 ] 00:05:51.466 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.466 [2024-11-18 19:04:09.983675] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.724 [2024-11-18 19:04:10.106971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=0x1 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=xor 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=3 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=software 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=32 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=32 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=1 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val=Yes 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:51.724 19:04:10 -- accel/accel.sh@21 -- # val= 00:05:51.724 19:04:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # IFS=: 00:05:51.724 19:04:10 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@21 -- # val= 00:05:53.097 19:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@21 -- # val= 00:05:53.097 19:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@21 -- # val= 00:05:53.097 19:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@21 -- # val= 00:05:53.097 19:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@21 -- # val= 00:05:53.097 19:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@21 -- # val= 00:05:53.097 19:04:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # IFS=: 00:05:53.097 19:04:11 -- accel/accel.sh@20 -- # read -r var val 00:05:53.097 19:04:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:53.097 19:04:11 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:53.097 19:04:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.097 00:05:53.097 real 0m2.963s 00:05:53.097 user 0m2.668s 00:05:53.097 sys 0m0.286s 00:05:53.097 19:04:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.097 19:04:11 -- common/autotest_common.sh@10 -- # set +x 00:05:53.097 ************************************ 00:05:53.097 END TEST accel_xor 00:05:53.097 ************************************ 00:05:53.097 19:04:11 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:53.097 19:04:11 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:53.097 19:04:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.097 19:04:11 -- common/autotest_common.sh@10 -- # set +x 00:05:53.097 ************************************ 00:05:53.097 START TEST accel_dif_verify 00:05:53.097 ************************************ 00:05:53.097 19:04:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:53.097 19:04:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.097 19:04:11 -- accel/accel.sh@17 -- # local accel_module 00:05:53.097 19:04:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:53.097 19:04:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:53.097 19:04:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.097 19:04:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.097 19:04:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.097 19:04:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.097 19:04:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.097 19:04:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.097 19:04:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.097 19:04:11 -- accel/accel.sh@42 -- # jq -r . 00:05:53.097 [2024-11-18 19:04:11.427557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.097 [2024-11-18 19:04:11.427669] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3331748 ] 00:05:53.097 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.097 [2024-11-18 19:04:11.490163] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.097 [2024-11-18 19:04:11.609245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.470 19:04:12 -- accel/accel.sh@18 -- # out=' 00:05:54.470 SPDK Configuration: 00:05:54.470 Core mask: 0x1 00:05:54.470 00:05:54.470 Accel Perf Configuration: 00:05:54.470 Workload Type: dif_verify 00:05:54.470 Vector size: 4096 bytes 00:05:54.470 Transfer size: 4096 bytes 00:05:54.470 Block size: 512 bytes 00:05:54.470 Metadata size: 8 bytes 00:05:54.470 Vector count 1 00:05:54.470 Module: software 00:05:54.470 Queue depth: 32 00:05:54.470 Allocate depth: 32 00:05:54.470 # threads/core: 1 00:05:54.470 Run time: 1 seconds 00:05:54.470 Verify: No 00:05:54.470 00:05:54.470 Running for 1 seconds... 00:05:54.470 00:05:54.470 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.470 ------------------------------------------------------------------------------------ 00:05:54.470 0,0 81920/s 325 MiB/s 0 0 00:05:54.470 ==================================================================================== 00:05:54.470 Total 81920/s 320 MiB/s 0 0' 00:05:54.470 19:04:12 -- accel/accel.sh@20 -- # IFS=: 00:05:54.470 19:04:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:54.470 19:04:12 -- accel/accel.sh@20 -- # read -r var val 00:05:54.470 19:04:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:54.470 19:04:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.470 19:04:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.470 19:04:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.470 19:04:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.470 19:04:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.470 19:04:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.470 19:04:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.470 19:04:12 -- accel/accel.sh@42 -- # jq -r . 00:05:54.470 [2024-11-18 19:04:12.909473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.470 [2024-11-18 19:04:12.909562] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332010 ] 00:05:54.470 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.470 [2024-11-18 19:04:12.970866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.728 [2024-11-18 19:04:13.090039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.728 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.728 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.728 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.728 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.728 19:04:13 -- accel/accel.sh@21 -- # val=0x1 00:05:54.728 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.728 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.728 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.728 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.728 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.728 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val=dif_verify 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val=software 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val=32 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val=32 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val=1 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val=No 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:54.729 19:04:13 -- accel/accel.sh@21 -- # val= 00:05:54.729 19:04:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # IFS=: 00:05:54.729 19:04:13 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@21 -- # val= 00:05:56.102 19:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@21 -- # val= 00:05:56.102 19:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@21 -- # val= 00:05:56.102 19:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@21 -- # val= 00:05:56.102 19:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@21 -- # val= 00:05:56.102 19:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@21 -- # val= 00:05:56.102 19:04:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # IFS=: 00:05:56.102 19:04:14 -- accel/accel.sh@20 -- # read -r var val 00:05:56.102 19:04:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:56.102 19:04:14 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:56.102 19:04:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:56.102 00:05:56.102 real 0m2.966s 00:05:56.102 user 0m2.664s 00:05:56.102 sys 0m0.296s 00:05:56.102 19:04:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.102 19:04:14 -- common/autotest_common.sh@10 -- # set +x 00:05:56.102 ************************************ 00:05:56.102 END TEST accel_dif_verify 00:05:56.102 ************************************ 00:05:56.102 19:04:14 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:56.102 19:04:14 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:56.102 19:04:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.102 19:04:14 -- common/autotest_common.sh@10 -- # set +x 00:05:56.102 ************************************ 00:05:56.102 START TEST accel_dif_generate 00:05:56.102 ************************************ 00:05:56.102 19:04:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:05:56.102 19:04:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.102 19:04:14 -- accel/accel.sh@17 -- # local accel_module 00:05:56.102 19:04:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:56.102 19:04:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:56.102 19:04:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.102 19:04:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.102 19:04:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.102 19:04:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.102 19:04:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.102 19:04:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.102 19:04:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.102 19:04:14 -- accel/accel.sh@42 -- # jq -r . 00:05:56.102 [2024-11-18 19:04:14.416627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.102 [2024-11-18 19:04:14.416721] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332172 ] 00:05:56.102 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.102 [2024-11-18 19:04:14.483476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.102 [2024-11-18 19:04:14.603753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.475 19:04:15 -- accel/accel.sh@18 -- # out=' 00:05:57.475 SPDK Configuration: 00:05:57.475 Core mask: 0x1 00:05:57.475 00:05:57.475 Accel Perf Configuration: 00:05:57.475 Workload Type: dif_generate 00:05:57.475 Vector size: 4096 bytes 00:05:57.475 Transfer size: 4096 bytes 00:05:57.475 Block size: 512 bytes 00:05:57.475 Metadata size: 8 bytes 00:05:57.475 Vector count 1 00:05:57.475 Module: software 00:05:57.475 Queue depth: 32 00:05:57.475 Allocate depth: 32 00:05:57.475 # threads/core: 1 00:05:57.475 Run time: 1 seconds 00:05:57.475 Verify: No 00:05:57.475 00:05:57.475 Running for 1 seconds... 00:05:57.475 00:05:57.475 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.475 ------------------------------------------------------------------------------------ 00:05:57.475 0,0 96384/s 382 MiB/s 0 0 00:05:57.475 ==================================================================================== 00:05:57.475 Total 96384/s 376 MiB/s 0 0' 00:05:57.475 19:04:15 -- accel/accel.sh@20 -- # IFS=: 00:05:57.475 19:04:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:57.475 19:04:15 -- accel/accel.sh@20 -- # read -r var val 00:05:57.475 19:04:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:57.475 19:04:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.475 19:04:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.475 19:04:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.475 19:04:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.475 19:04:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.475 19:04:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.475 19:04:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.475 19:04:15 -- accel/accel.sh@42 -- # jq -r . 00:05:57.475 [2024-11-18 19:04:15.906996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.475 [2024-11-18 19:04:15.907088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332312 ] 00:05:57.475 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.475 [2024-11-18 19:04:15.968055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.733 [2024-11-18 19:04:16.083605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=0x1 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=dif_generate 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=software 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=32 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=32 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=1 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val=No 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:57.733 19:04:16 -- accel/accel.sh@21 -- # val= 00:05:57.733 19:04:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # IFS=: 00:05:57.733 19:04:16 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@21 -- # val= 00:05:59.106 19:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # IFS=: 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@21 -- # val= 00:05:59.106 19:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # IFS=: 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@21 -- # val= 00:05:59.106 19:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # IFS=: 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@21 -- # val= 00:05:59.106 19:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # IFS=: 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@21 -- # val= 00:05:59.106 19:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # IFS=: 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@21 -- # val= 00:05:59.106 19:04:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # IFS=: 00:05:59.106 19:04:17 -- accel/accel.sh@20 -- # read -r var val 00:05:59.106 19:04:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:59.106 19:04:17 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:59.106 19:04:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.106 00:05:59.106 real 0m2.961s 00:05:59.106 user 0m2.668s 00:05:59.106 sys 0m0.286s 00:05:59.106 19:04:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.106 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:05:59.106 ************************************ 00:05:59.106 END TEST accel_dif_generate 00:05:59.106 ************************************ 00:05:59.106 19:04:17 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:59.106 19:04:17 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:59.106 19:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.106 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:05:59.106 ************************************ 00:05:59.106 START TEST accel_dif_generate_copy 00:05:59.106 ************************************ 00:05:59.106 19:04:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:05:59.106 19:04:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.106 19:04:17 -- accel/accel.sh@17 -- # local accel_module 00:05:59.106 19:04:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:59.107 19:04:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:59.107 19:04:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.107 19:04:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.107 19:04:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.107 19:04:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.107 19:04:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.107 19:04:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.107 19:04:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.107 19:04:17 -- accel/accel.sh@42 -- # jq -r . 00:05:59.107 [2024-11-18 19:04:17.405232] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.107 [2024-11-18 19:04:17.405325] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332595 ] 00:05:59.107 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.107 [2024-11-18 19:04:17.466221] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.107 [2024-11-18 19:04:17.585121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.480 19:04:18 -- accel/accel.sh@18 -- # out=' 00:06:00.480 SPDK Configuration: 00:06:00.480 Core mask: 0x1 00:06:00.480 00:06:00.480 Accel Perf Configuration: 00:06:00.480 Workload Type: dif_generate_copy 00:06:00.480 Vector size: 4096 bytes 00:06:00.480 Transfer size: 4096 bytes 00:06:00.480 Vector count 1 00:06:00.480 Module: software 00:06:00.480 Queue depth: 32 00:06:00.480 Allocate depth: 32 00:06:00.480 # threads/core: 1 00:06:00.480 Run time: 1 seconds 00:06:00.480 Verify: No 00:06:00.480 00:06:00.480 Running for 1 seconds... 00:06:00.480 00:06:00.480 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:00.480 ------------------------------------------------------------------------------------ 00:06:00.480 0,0 75520/s 299 MiB/s 0 0 00:06:00.480 ==================================================================================== 00:06:00.480 Total 75520/s 295 MiB/s 0 0' 00:06:00.480 19:04:18 -- accel/accel.sh@20 -- # IFS=: 00:06:00.480 19:04:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:00.480 19:04:18 -- accel/accel.sh@20 -- # read -r var val 00:06:00.480 19:04:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:00.480 19:04:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.480 19:04:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.480 19:04:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.480 19:04:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.480 19:04:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.480 19:04:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.480 19:04:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.480 19:04:18 -- accel/accel.sh@42 -- # jq -r . 00:06:00.480 [2024-11-18 19:04:18.870973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.480 [2024-11-18 19:04:18.871068] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332738 ] 00:06:00.480 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.480 [2024-11-18 19:04:18.932029] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.480 [2024-11-18 19:04:19.052063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=0x1 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=software 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=32 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=32 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=1 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val=No 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:00.738 19:04:19 -- accel/accel.sh@21 -- # val= 00:06:00.738 19:04:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # IFS=: 00:06:00.738 19:04:19 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@21 -- # val= 00:06:02.112 19:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@21 -- # val= 00:06:02.112 19:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@21 -- # val= 00:06:02.112 19:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@21 -- # val= 00:06:02.112 19:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@21 -- # val= 00:06:02.112 19:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@21 -- # val= 00:06:02.112 19:04:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # IFS=: 00:06:02.112 19:04:20 -- accel/accel.sh@20 -- # read -r var val 00:06:02.112 19:04:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:02.112 19:04:20 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:02.112 19:04:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.112 00:06:02.112 real 0m2.953s 00:06:02.112 user 0m2.659s 00:06:02.112 sys 0m0.285s 00:06:02.112 19:04:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.112 19:04:20 -- common/autotest_common.sh@10 -- # set +x 00:06:02.112 ************************************ 00:06:02.112 END TEST accel_dif_generate_copy 00:06:02.112 ************************************ 00:06:02.112 19:04:20 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:02.112 19:04:20 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.112 19:04:20 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:02.112 19:04:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.112 19:04:20 -- common/autotest_common.sh@10 -- # set +x 00:06:02.112 ************************************ 00:06:02.112 START TEST accel_comp 00:06:02.112 ************************************ 00:06:02.112 19:04:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.112 19:04:20 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.112 19:04:20 -- accel/accel.sh@17 -- # local accel_module 00:06:02.112 19:04:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.112 19:04:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.112 19:04:20 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.112 19:04:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.112 19:04:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.112 19:04:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.112 19:04:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.112 19:04:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.112 19:04:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.112 19:04:20 -- accel/accel.sh@42 -- # jq -r . 00:06:02.112 [2024-11-18 19:04:20.382745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.112 [2024-11-18 19:04:20.382842] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3332899 ] 00:06:02.112 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.112 [2024-11-18 19:04:20.443870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.112 [2024-11-18 19:04:20.563522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.487 19:04:21 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:03.487 00:06:03.487 SPDK Configuration: 00:06:03.487 Core mask: 0x1 00:06:03.487 00:06:03.487 Accel Perf Configuration: 00:06:03.487 Workload Type: compress 00:06:03.487 Transfer size: 4096 bytes 00:06:03.487 Vector count 1 00:06:03.487 Module: software 00:06:03.487 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.487 Queue depth: 32 00:06:03.487 Allocate depth: 32 00:06:03.487 # threads/core: 1 00:06:03.487 Run time: 1 seconds 00:06:03.487 Verify: No 00:06:03.487 00:06:03.487 Running for 1 seconds... 00:06:03.487 00:06:03.487 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:03.487 ------------------------------------------------------------------------------------ 00:06:03.487 0,0 31520/s 131 MiB/s 0 0 00:06:03.487 ==================================================================================== 00:06:03.487 Total 31520/s 123 MiB/s 0 0' 00:06:03.487 19:04:21 -- accel/accel.sh@20 -- # IFS=: 00:06:03.487 19:04:21 -- accel/accel.sh@20 -- # read -r var val 00:06:03.487 19:04:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.487 19:04:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.487 19:04:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.487 19:04:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.487 19:04:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.487 19:04:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.487 19:04:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.487 19:04:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.487 19:04:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.487 19:04:21 -- accel/accel.sh@42 -- # jq -r . 00:06:03.487 [2024-11-18 19:04:21.868356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.487 [2024-11-18 19:04:21.868467] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333161 ] 00:06:03.487 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.487 [2024-11-18 19:04:21.940782] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.487 [2024-11-18 19:04:22.059836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=0x1 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=compress 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=software 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=32 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=32 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=1 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val=No 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:03.746 19:04:22 -- accel/accel.sh@21 -- # val= 00:06:03.746 19:04:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # IFS=: 00:06:03.746 19:04:22 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@21 -- # val= 00:06:05.170 19:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@21 -- # val= 00:06:05.170 19:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@21 -- # val= 00:06:05.170 19:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@21 -- # val= 00:06:05.170 19:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@21 -- # val= 00:06:05.170 19:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@21 -- # val= 00:06:05.170 19:04:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # IFS=: 00:06:05.170 19:04:23 -- accel/accel.sh@20 -- # read -r var val 00:06:05.170 19:04:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:05.170 19:04:23 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:05.170 19:04:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.170 00:06:05.170 real 0m2.986s 00:06:05.170 user 0m2.685s 00:06:05.170 sys 0m0.293s 00:06:05.170 19:04:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.170 19:04:23 -- common/autotest_common.sh@10 -- # set +x 00:06:05.170 ************************************ 00:06:05.170 END TEST accel_comp 00:06:05.170 ************************************ 00:06:05.170 19:04:23 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:05.170 19:04:23 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:05.170 19:04:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.170 19:04:23 -- common/autotest_common.sh@10 -- # set +x 00:06:05.170 ************************************ 00:06:05.170 START TEST accel_decomp 00:06:05.170 ************************************ 00:06:05.170 19:04:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:05.170 19:04:23 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.170 19:04:23 -- accel/accel.sh@17 -- # local accel_module 00:06:05.170 19:04:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:05.170 19:04:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:05.170 19:04:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.170 19:04:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.170 19:04:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.170 19:04:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.170 19:04:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.171 19:04:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.171 19:04:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.171 19:04:23 -- accel/accel.sh@42 -- # jq -r . 00:06:05.171 [2024-11-18 19:04:23.391183] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.171 [2024-11-18 19:04:23.391269] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333329 ] 00:06:05.171 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.171 [2024-11-18 19:04:23.451776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.171 [2024-11-18 19:04:23.569470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.545 19:04:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:06.545 00:06:06.545 SPDK Configuration: 00:06:06.545 Core mask: 0x1 00:06:06.545 00:06:06.545 Accel Perf Configuration: 00:06:06.545 Workload Type: decompress 00:06:06.545 Transfer size: 4096 bytes 00:06:06.545 Vector count 1 00:06:06.545 Module: software 00:06:06.545 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.545 Queue depth: 32 00:06:06.545 Allocate depth: 32 00:06:06.545 # threads/core: 1 00:06:06.545 Run time: 1 seconds 00:06:06.545 Verify: Yes 00:06:06.545 00:06:06.545 Running for 1 seconds... 00:06:06.545 00:06:06.545 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:06.545 ------------------------------------------------------------------------------------ 00:06:06.545 0,0 55360/s 102 MiB/s 0 0 00:06:06.545 ==================================================================================== 00:06:06.545 Total 55360/s 216 MiB/s 0 0' 00:06:06.545 19:04:24 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:06.545 19:04:24 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:06.545 19:04:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.545 19:04:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.545 19:04:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.545 19:04:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.545 19:04:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.545 19:04:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.545 19:04:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.545 19:04:24 -- accel/accel.sh@42 -- # jq -r . 00:06:06.545 [2024-11-18 19:04:24.865958] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.545 [2024-11-18 19:04:24.866052] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333469 ] 00:06:06.545 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.545 [2024-11-18 19:04:24.925641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.545 [2024-11-18 19:04:25.045888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val=0x1 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val=decompress 00:06:06.545 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.545 19:04:25 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.545 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.545 19:04:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val=software 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val=32 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val=32 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val=1 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val=Yes 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:06.546 19:04:25 -- accel/accel.sh@21 -- # val= 00:06:06.546 19:04:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # IFS=: 00:06:06.546 19:04:25 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@21 -- # val= 00:06:07.921 19:04:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@21 -- # val= 00:06:07.921 19:04:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@21 -- # val= 00:06:07.921 19:04:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@21 -- # val= 00:06:07.921 19:04:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@21 -- # val= 00:06:07.921 19:04:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@21 -- # val= 00:06:07.921 19:04:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # IFS=: 00:06:07.921 19:04:26 -- accel/accel.sh@20 -- # read -r var val 00:06:07.921 19:04:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.921 19:04:26 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:07.921 19:04:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.921 00:06:07.921 real 0m2.951s 00:06:07.921 user 0m2.656s 00:06:07.921 sys 0m0.288s 00:06:07.921 19:04:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.921 19:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:07.921 ************************************ 00:06:07.921 END TEST accel_decomp 00:06:07.921 ************************************ 00:06:07.921 19:04:26 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.921 19:04:26 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:07.921 19:04:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.921 19:04:26 -- common/autotest_common.sh@10 -- # set +x 00:06:07.921 ************************************ 00:06:07.921 START TEST accel_decmop_full 00:06:07.921 ************************************ 00:06:07.921 19:04:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.921 19:04:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.921 19:04:26 -- accel/accel.sh@17 -- # local accel_module 00:06:07.921 19:04:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.921 19:04:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:07.921 19:04:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.921 19:04:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.921 19:04:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.921 19:04:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.921 19:04:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.921 19:04:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.921 19:04:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.921 19:04:26 -- accel/accel.sh@42 -- # jq -r . 00:06:07.921 [2024-11-18 19:04:26.367910] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.921 [2024-11-18 19:04:26.368000] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333745 ] 00:06:07.921 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.921 [2024-11-18 19:04:26.430255] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.180 [2024-11-18 19:04:26.550913] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.554 19:04:27 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:09.554 00:06:09.554 SPDK Configuration: 00:06:09.554 Core mask: 0x1 00:06:09.554 00:06:09.554 Accel Perf Configuration: 00:06:09.554 Workload Type: decompress 00:06:09.554 Transfer size: 111250 bytes 00:06:09.554 Vector count 1 00:06:09.554 Module: software 00:06:09.554 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.554 Queue depth: 32 00:06:09.554 Allocate depth: 32 00:06:09.554 # threads/core: 1 00:06:09.554 Run time: 1 seconds 00:06:09.554 Verify: Yes 00:06:09.554 00:06:09.554 Running for 1 seconds... 00:06:09.554 00:06:09.554 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.554 ------------------------------------------------------------------------------------ 00:06:09.554 0,0 3808/s 157 MiB/s 0 0 00:06:09.554 ==================================================================================== 00:06:09.554 Total 3808/s 404 MiB/s 0 0' 00:06:09.554 19:04:27 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:09.554 19:04:27 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:09.554 19:04:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.554 19:04:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.554 19:04:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.554 19:04:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.554 19:04:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.554 19:04:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.554 19:04:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.554 19:04:27 -- accel/accel.sh@42 -- # jq -r . 00:06:09.554 [2024-11-18 19:04:27.871320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.554 [2024-11-18 19:04:27.871415] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3333892 ] 00:06:09.554 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.554 [2024-11-18 19:04:27.931583] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.554 [2024-11-18 19:04:28.051420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=0x1 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=decompress 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=software 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=32 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=32 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=1 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val=Yes 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:09.554 19:04:28 -- accel/accel.sh@21 -- # val= 00:06:09.554 19:04:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # IFS=: 00:06:09.554 19:04:28 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@21 -- # val= 00:06:10.926 19:04:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@21 -- # val= 00:06:10.926 19:04:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@21 -- # val= 00:06:10.926 19:04:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@21 -- # val= 00:06:10.926 19:04:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@21 -- # val= 00:06:10.926 19:04:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@21 -- # val= 00:06:10.926 19:04:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # IFS=: 00:06:10.926 19:04:29 -- accel/accel.sh@20 -- # read -r var val 00:06:10.926 19:04:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.926 19:04:29 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:10.926 19:04:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.926 00:06:10.926 real 0m3.002s 00:06:10.926 user 0m2.703s 00:06:10.926 sys 0m0.290s 00:06:10.926 19:04:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.926 19:04:29 -- common/autotest_common.sh@10 -- # set +x 00:06:10.926 ************************************ 00:06:10.926 END TEST accel_decmop_full 00:06:10.926 ************************************ 00:06:10.926 19:04:29 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.926 19:04:29 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:10.926 19:04:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.926 19:04:29 -- common/autotest_common.sh@10 -- # set +x 00:06:10.926 ************************************ 00:06:10.926 START TEST accel_decomp_mcore 00:06:10.926 ************************************ 00:06:10.926 19:04:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.926 19:04:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.926 19:04:29 -- accel/accel.sh@17 -- # local accel_module 00:06:10.926 19:04:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.926 19:04:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:10.926 19:04:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.926 19:04:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.926 19:04:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.927 19:04:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.927 19:04:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.927 19:04:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.927 19:04:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.927 19:04:29 -- accel/accel.sh@42 -- # jq -r . 00:06:10.927 [2024-11-18 19:04:29.392344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.927 [2024-11-18 19:04:29.392431] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334051 ] 00:06:10.927 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.927 [2024-11-18 19:04:29.457093] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:11.184 [2024-11-18 19:04:29.582884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.184 [2024-11-18 19:04:29.582914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:11.184 [2024-11-18 19:04:29.582966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:11.184 [2024-11-18 19:04:29.582970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.557 19:04:30 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:12.557 00:06:12.557 SPDK Configuration: 00:06:12.557 Core mask: 0xf 00:06:12.557 00:06:12.557 Accel Perf Configuration: 00:06:12.557 Workload Type: decompress 00:06:12.557 Transfer size: 4096 bytes 00:06:12.557 Vector count 1 00:06:12.557 Module: software 00:06:12.557 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.557 Queue depth: 32 00:06:12.557 Allocate depth: 32 00:06:12.557 # threads/core: 1 00:06:12.557 Run time: 1 seconds 00:06:12.557 Verify: Yes 00:06:12.557 00:06:12.557 Running for 1 seconds... 00:06:12.557 00:06:12.557 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.557 ------------------------------------------------------------------------------------ 00:06:12.557 0,0 49600/s 91 MiB/s 0 0 00:06:12.557 3,0 50400/s 92 MiB/s 0 0 00:06:12.557 2,0 50368/s 92 MiB/s 0 0 00:06:12.557 1,0 50336/s 92 MiB/s 0 0 00:06:12.557 ==================================================================================== 00:06:12.557 Total 200704/s 784 MiB/s 0 0' 00:06:12.557 19:04:30 -- accel/accel.sh@20 -- # IFS=: 00:06:12.557 19:04:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:12.557 19:04:30 -- accel/accel.sh@20 -- # read -r var val 00:06:12.557 19:04:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:12.557 19:04:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.557 19:04:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.557 19:04:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.557 19:04:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.557 19:04:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.558 19:04:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.558 19:04:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.558 19:04:30 -- accel/accel.sh@42 -- # jq -r . 00:06:12.558 [2024-11-18 19:04:30.890141] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.558 [2024-11-18 19:04:30.890237] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334318 ] 00:06:12.558 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.558 [2024-11-18 19:04:30.951050] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:12.558 [2024-11-18 19:04:31.072105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:12.558 [2024-11-18 19:04:31.072159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:12.558 [2024-11-18 19:04:31.072212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:12.558 [2024-11-18 19:04:31.072215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=0xf 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=decompress 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=software 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=32 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=32 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=1 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val=Yes 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:12.558 19:04:31 -- accel/accel.sh@21 -- # val= 00:06:12.558 19:04:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # IFS=: 00:06:12.558 19:04:31 -- accel/accel.sh@20 -- # read -r var val 00:06:13.933 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.933 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.933 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.933 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.933 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.933 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.933 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.933 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.933 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.933 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.934 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.934 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.934 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.934 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.934 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.934 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.934 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.934 19:04:32 -- accel/accel.sh@21 -- # val= 00:06:13.934 19:04:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # IFS=: 00:06:13.934 19:04:32 -- accel/accel.sh@20 -- # read -r var val 00:06:13.934 19:04:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.934 19:04:32 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:13.934 19:04:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.934 00:06:13.934 real 0m2.989s 00:06:13.934 user 0m9.581s 00:06:13.934 sys 0m0.310s 00:06:13.934 19:04:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.934 19:04:32 -- common/autotest_common.sh@10 -- # set +x 00:06:13.934 ************************************ 00:06:13.934 END TEST accel_decomp_mcore 00:06:13.934 ************************************ 00:06:13.934 19:04:32 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.934 19:04:32 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:13.934 19:04:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.934 19:04:32 -- common/autotest_common.sh@10 -- # set +x 00:06:13.934 ************************************ 00:06:13.934 START TEST accel_decomp_full_mcore 00:06:13.934 ************************************ 00:06:13.934 19:04:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.934 19:04:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.934 19:04:32 -- accel/accel.sh@17 -- # local accel_module 00:06:13.934 19:04:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.934 19:04:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:13.934 19:04:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.934 19:04:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.934 19:04:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.934 19:04:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.934 19:04:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.934 19:04:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.934 19:04:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.934 19:04:32 -- accel/accel.sh@42 -- # jq -r . 00:06:13.934 [2024-11-18 19:04:32.409365] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.934 [2024-11-18 19:04:32.409458] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334481 ] 00:06:13.934 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.934 [2024-11-18 19:04:32.471473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:14.192 [2024-11-18 19:04:32.595603] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:14.192 [2024-11-18 19:04:32.595661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:14.192 [2024-11-18 19:04:32.595713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:14.192 [2024-11-18 19:04:32.595716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.566 19:04:33 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:15.566 00:06:15.566 SPDK Configuration: 00:06:15.566 Core mask: 0xf 00:06:15.566 00:06:15.566 Accel Perf Configuration: 00:06:15.566 Workload Type: decompress 00:06:15.566 Transfer size: 111250 bytes 00:06:15.566 Vector count 1 00:06:15.566 Module: software 00:06:15.566 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.566 Queue depth: 32 00:06:15.566 Allocate depth: 32 00:06:15.566 # threads/core: 1 00:06:15.566 Run time: 1 seconds 00:06:15.566 Verify: Yes 00:06:15.566 00:06:15.566 Running for 1 seconds... 00:06:15.566 00:06:15.566 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.566 ------------------------------------------------------------------------------------ 00:06:15.566 0,0 3776/s 155 MiB/s 0 0 00:06:15.566 3,0 3776/s 155 MiB/s 0 0 00:06:15.566 2,0 3776/s 155 MiB/s 0 0 00:06:15.566 1,0 3808/s 157 MiB/s 0 0 00:06:15.566 ==================================================================================== 00:06:15.566 Total 15136/s 1605 MiB/s 0 0' 00:06:15.566 19:04:33 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:15.566 19:04:33 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:15.566 19:04:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.566 19:04:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.566 19:04:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.566 19:04:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.566 19:04:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.566 19:04:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.566 19:04:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.566 19:04:33 -- accel/accel.sh@42 -- # jq -r . 00:06:15.566 [2024-11-18 19:04:33.923128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.566 [2024-11-18 19:04:33.923221] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334628 ] 00:06:15.566 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.566 [2024-11-18 19:04:33.985021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:15.566 [2024-11-18 19:04:34.105230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:15.566 [2024-11-18 19:04:34.105261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:15.566 [2024-11-18 19:04:34.105317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:15.566 [2024-11-18 19:04:34.105321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val=0xf 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val=decompress 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:15.566 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.566 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.566 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val=software 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val=32 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val=32 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val=1 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val=Yes 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:15.825 19:04:34 -- accel/accel.sh@21 -- # val= 00:06:15.825 19:04:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # IFS=: 00:06:15.825 19:04:34 -- accel/accel.sh@20 -- # read -r var val 00:06:17.197 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.197 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.197 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.197 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.197 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.197 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.197 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.197 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.197 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@21 -- # val= 00:06:17.198 19:04:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # IFS=: 00:06:17.198 19:04:35 -- accel/accel.sh@20 -- # read -r var val 00:06:17.198 19:04:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:17.198 19:04:35 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:17.198 19:04:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:17.198 00:06:17.198 real 0m3.006s 00:06:17.198 user 0m9.677s 00:06:17.198 sys 0m0.296s 00:06:17.198 19:04:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:17.198 19:04:35 -- common/autotest_common.sh@10 -- # set +x 00:06:17.198 ************************************ 00:06:17.198 END TEST accel_decomp_full_mcore 00:06:17.198 ************************************ 00:06:17.198 19:04:35 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.198 19:04:35 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:17.198 19:04:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.198 19:04:35 -- common/autotest_common.sh@10 -- # set +x 00:06:17.198 ************************************ 00:06:17.198 START TEST accel_decomp_mthread 00:06:17.198 ************************************ 00:06:17.198 19:04:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.198 19:04:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:17.198 19:04:35 -- accel/accel.sh@17 -- # local accel_module 00:06:17.198 19:04:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.198 19:04:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.198 19:04:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.198 19:04:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.198 19:04:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.198 19:04:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.198 19:04:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.198 19:04:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.198 19:04:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.198 19:04:35 -- accel/accel.sh@42 -- # jq -r . 00:06:17.198 [2024-11-18 19:04:35.438925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.198 [2024-11-18 19:04:35.439018] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3334910 ] 00:06:17.198 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.198 [2024-11-18 19:04:35.500135] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.198 [2024-11-18 19:04:35.620198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.572 19:04:36 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.572 00:06:18.572 SPDK Configuration: 00:06:18.572 Core mask: 0x1 00:06:18.572 00:06:18.572 Accel Perf Configuration: 00:06:18.572 Workload Type: decompress 00:06:18.572 Transfer size: 4096 bytes 00:06:18.572 Vector count 1 00:06:18.572 Module: software 00:06:18.572 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.572 Queue depth: 32 00:06:18.572 Allocate depth: 32 00:06:18.572 # threads/core: 2 00:06:18.572 Run time: 1 seconds 00:06:18.572 Verify: Yes 00:06:18.572 00:06:18.572 Running for 1 seconds... 00:06:18.572 00:06:18.572 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.572 ------------------------------------------------------------------------------------ 00:06:18.572 0,1 28064/s 51 MiB/s 0 0 00:06:18.572 0,0 27968/s 51 MiB/s 0 0 00:06:18.572 ==================================================================================== 00:06:18.572 Total 56032/s 218 MiB/s 0 0' 00:06:18.572 19:04:36 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:18.572 19:04:36 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:18.572 19:04:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.572 19:04:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.572 19:04:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.572 19:04:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.572 19:04:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.572 19:04:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.572 19:04:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.572 19:04:36 -- accel/accel.sh@42 -- # jq -r . 00:06:18.572 [2024-11-18 19:04:36.923018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.572 [2024-11-18 19:04:36.923115] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335059 ] 00:06:18.572 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.572 [2024-11-18 19:04:36.984027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.572 [2024-11-18 19:04:37.103925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=0x1 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=decompress 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=software 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=32 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=32 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.572 19:04:37 -- accel/accel.sh@21 -- # val=2 00:06:18.572 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.572 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.830 19:04:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.830 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.830 19:04:37 -- accel/accel.sh@21 -- # val=Yes 00:06:18.830 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.830 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.830 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:18.830 19:04:37 -- accel/accel.sh@21 -- # val= 00:06:18.830 19:04:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # IFS=: 00:06:18.830 19:04:37 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@21 -- # val= 00:06:20.202 19:04:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # IFS=: 00:06:20.202 19:04:38 -- accel/accel.sh@20 -- # read -r var val 00:06:20.202 19:04:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:20.202 19:04:38 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:20.202 19:04:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:20.202 00:06:20.202 real 0m2.977s 00:06:20.202 user 0m2.689s 00:06:20.202 sys 0m0.281s 00:06:20.202 19:04:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.202 19:04:38 -- common/autotest_common.sh@10 -- # set +x 00:06:20.202 ************************************ 00:06:20.202 END TEST accel_decomp_mthread 00:06:20.202 ************************************ 00:06:20.202 19:04:38 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:20.202 19:04:38 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:20.202 19:04:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.202 19:04:38 -- common/autotest_common.sh@10 -- # set +x 00:06:20.202 ************************************ 00:06:20.202 START TEST accel_deomp_full_mthread 00:06:20.202 ************************************ 00:06:20.202 19:04:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:20.202 19:04:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:20.202 19:04:38 -- accel/accel.sh@17 -- # local accel_module 00:06:20.202 19:04:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:20.202 19:04:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:20.202 19:04:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.202 19:04:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.202 19:04:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.202 19:04:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.202 19:04:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.202 19:04:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.202 19:04:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.202 19:04:38 -- accel/accel.sh@42 -- # jq -r . 00:06:20.202 [2024-11-18 19:04:38.447307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.202 [2024-11-18 19:04:38.447401] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335214 ] 00:06:20.202 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.202 [2024-11-18 19:04:38.507755] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.202 [2024-11-18 19:04:38.631751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.577 19:04:39 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.577 00:06:21.577 SPDK Configuration: 00:06:21.577 Core mask: 0x1 00:06:21.577 00:06:21.577 Accel Perf Configuration: 00:06:21.577 Workload Type: decompress 00:06:21.577 Transfer size: 111250 bytes 00:06:21.577 Vector count 1 00:06:21.577 Module: software 00:06:21.577 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.577 Queue depth: 32 00:06:21.577 Allocate depth: 32 00:06:21.577 # threads/core: 2 00:06:21.577 Run time: 1 seconds 00:06:21.577 Verify: Yes 00:06:21.577 00:06:21.577 Running for 1 seconds... 00:06:21.577 00:06:21.577 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.577 ------------------------------------------------------------------------------------ 00:06:21.577 0,1 1952/s 80 MiB/s 0 0 00:06:21.577 0,0 1920/s 79 MiB/s 0 0 00:06:21.577 ==================================================================================== 00:06:21.577 Total 3872/s 410 MiB/s 0 0' 00:06:21.577 19:04:39 -- accel/accel.sh@20 -- # IFS=: 00:06:21.577 19:04:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.577 19:04:39 -- accel/accel.sh@20 -- # read -r var val 00:06:21.577 19:04:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:21.577 19:04:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.577 19:04:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.577 19:04:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.577 19:04:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.577 19:04:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.577 19:04:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.577 19:04:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.577 19:04:39 -- accel/accel.sh@42 -- # jq -r . 00:06:21.577 [2024-11-18 19:04:39.960253] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.577 [2024-11-18 19:04:39.960342] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335481 ] 00:06:21.577 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.577 [2024-11-18 19:04:40.021265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.577 [2024-11-18 19:04:40.144107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=0x1 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=decompress 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=software 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=32 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=32 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=2 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val=Yes 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:21.836 19:04:40 -- accel/accel.sh@21 -- # val= 00:06:21.836 19:04:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # IFS=: 00:06:21.836 19:04:40 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@21 -- # val= 00:06:23.210 19:04:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # IFS=: 00:06:23.210 19:04:41 -- accel/accel.sh@20 -- # read -r var val 00:06:23.210 19:04:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:23.210 19:04:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:23.210 19:04:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:23.210 00:06:23.210 real 0m3.031s 00:06:23.210 user 0m2.740s 00:06:23.210 sys 0m0.283s 00:06:23.210 19:04:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.210 19:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:23.210 ************************************ 00:06:23.210 END TEST accel_deomp_full_mthread 00:06:23.210 ************************************ 00:06:23.210 19:04:41 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:23.210 19:04:41 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:23.210 19:04:41 -- accel/accel.sh@129 -- # build_accel_config 00:06:23.210 19:04:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:23.210 19:04:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.210 19:04:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.210 19:04:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.210 19:04:41 -- common/autotest_common.sh@10 -- # set +x 00:06:23.210 19:04:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.210 19:04:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.210 19:04:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.210 19:04:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.210 19:04:41 -- accel/accel.sh@42 -- # jq -r . 00:06:23.210 ************************************ 00:06:23.210 START TEST accel_dif_functional_tests 00:06:23.210 ************************************ 00:06:23.210 19:04:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:23.210 [2024-11-18 19:04:41.527639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.210 [2024-11-18 19:04:41.527726] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335643 ] 00:06:23.210 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.210 [2024-11-18 19:04:41.589152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:23.210 [2024-11-18 19:04:41.709784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.210 [2024-11-18 19:04:41.709839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.210 [2024-11-18 19:04:41.709843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.210 00:06:23.210 00:06:23.210 CUnit - A unit testing framework for C - Version 2.1-3 00:06:23.210 http://cunit.sourceforge.net/ 00:06:23.210 00:06:23.210 00:06:23.210 Suite: accel_dif 00:06:23.210 Test: verify: DIF generated, GUARD check ...passed 00:06:23.211 Test: verify: DIF generated, APPTAG check ...passed 00:06:23.211 Test: verify: DIF generated, REFTAG check ...passed 00:06:23.211 Test: verify: DIF not generated, GUARD check ...[2024-11-18 19:04:41.812675] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:23.211 [2024-11-18 19:04:41.812746] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:23.211 passed 00:06:23.211 Test: verify: DIF not generated, APPTAG check ...[2024-11-18 19:04:41.812790] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:23.211 [2024-11-18 19:04:41.812822] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:23.211 passed 00:06:23.211 Test: verify: DIF not generated, REFTAG check ...[2024-11-18 19:04:41.812858] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:23.211 [2024-11-18 19:04:41.812887] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:23.211 passed 00:06:23.211 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:23.211 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-18 19:04:41.812958] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:23.211 passed 00:06:23.211 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:23.211 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:23.211 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:23.211 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-18 19:04:41.813115] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:23.211 passed 00:06:23.211 Test: generate copy: DIF generated, GUARD check ...passed 00:06:23.211 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:23.211 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:23.211 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:23.211 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:23.211 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:23.211 Test: generate copy: iovecs-len validate ...[2024-11-18 19:04:41.813381] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:23.211 passed 00:06:23.211 Test: generate copy: buffer alignment validate ...passed 00:06:23.211 00:06:23.211 Run Summary: Type Total Ran Passed Failed Inactive 00:06:23.211 suites 1 1 n/a 0 0 00:06:23.211 tests 20 20 20 0 0 00:06:23.211 asserts 204 204 204 0 n/a 00:06:23.211 00:06:23.211 Elapsed time = 0.003 seconds 00:06:23.776 00:06:23.776 real 0m0.593s 00:06:23.776 user 0m0.910s 00:06:23.776 sys 0m0.184s 00:06:23.776 19:04:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.776 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:23.776 ************************************ 00:06:23.776 END TEST accel_dif_functional_tests 00:06:23.776 ************************************ 00:06:23.776 00:06:23.776 real 1m3.166s 00:06:23.776 user 1m10.917s 00:06:23.776 sys 0m7.310s 00:06:23.776 19:04:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.776 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:23.776 ************************************ 00:06:23.776 END TEST accel 00:06:23.776 ************************************ 00:06:23.776 19:04:42 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.776 19:04:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:23.776 19:04:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.776 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:23.776 ************************************ 00:06:23.776 START TEST accel_rpc 00:06:23.776 ************************************ 00:06:23.776 19:04:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:23.776 * Looking for test storage... 00:06:23.776 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:23.776 19:04:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:23.776 19:04:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:23.776 19:04:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:23.776 19:04:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:23.776 19:04:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:23.776 19:04:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:23.776 19:04:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:23.776 19:04:42 -- scripts/common.sh@335 -- # IFS=.-: 00:06:23.776 19:04:42 -- scripts/common.sh@335 -- # read -ra ver1 00:06:23.776 19:04:42 -- scripts/common.sh@336 -- # IFS=.-: 00:06:23.776 19:04:42 -- scripts/common.sh@336 -- # read -ra ver2 00:06:23.776 19:04:42 -- scripts/common.sh@337 -- # local 'op=<' 00:06:23.776 19:04:42 -- scripts/common.sh@339 -- # ver1_l=2 00:06:23.776 19:04:42 -- scripts/common.sh@340 -- # ver2_l=1 00:06:23.776 19:04:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:23.776 19:04:42 -- scripts/common.sh@343 -- # case "$op" in 00:06:23.776 19:04:42 -- scripts/common.sh@344 -- # : 1 00:06:23.776 19:04:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:23.776 19:04:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:23.776 19:04:42 -- scripts/common.sh@364 -- # decimal 1 00:06:23.776 19:04:42 -- scripts/common.sh@352 -- # local d=1 00:06:23.776 19:04:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:23.776 19:04:42 -- scripts/common.sh@354 -- # echo 1 00:06:23.776 19:04:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:23.776 19:04:42 -- scripts/common.sh@365 -- # decimal 2 00:06:23.776 19:04:42 -- scripts/common.sh@352 -- # local d=2 00:06:23.776 19:04:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:23.776 19:04:42 -- scripts/common.sh@354 -- # echo 2 00:06:23.776 19:04:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:23.776 19:04:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:23.776 19:04:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:23.776 19:04:42 -- scripts/common.sh@367 -- # return 0 00:06:23.776 19:04:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:23.776 19:04:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:23.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.776 --rc genhtml_branch_coverage=1 00:06:23.776 --rc genhtml_function_coverage=1 00:06:23.776 --rc genhtml_legend=1 00:06:23.776 --rc geninfo_all_blocks=1 00:06:23.776 --rc geninfo_unexecuted_blocks=1 00:06:23.776 00:06:23.776 ' 00:06:23.776 19:04:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:23.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.776 --rc genhtml_branch_coverage=1 00:06:23.776 --rc genhtml_function_coverage=1 00:06:23.776 --rc genhtml_legend=1 00:06:23.776 --rc geninfo_all_blocks=1 00:06:23.776 --rc geninfo_unexecuted_blocks=1 00:06:23.776 00:06:23.776 ' 00:06:23.776 19:04:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:23.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.776 --rc genhtml_branch_coverage=1 00:06:23.776 --rc genhtml_function_coverage=1 00:06:23.776 --rc genhtml_legend=1 00:06:23.776 --rc geninfo_all_blocks=1 00:06:23.776 --rc geninfo_unexecuted_blocks=1 00:06:23.776 00:06:23.776 ' 00:06:23.776 19:04:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:23.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:23.776 --rc genhtml_branch_coverage=1 00:06:23.776 --rc genhtml_function_coverage=1 00:06:23.776 --rc genhtml_legend=1 00:06:23.776 --rc geninfo_all_blocks=1 00:06:23.776 --rc geninfo_unexecuted_blocks=1 00:06:23.776 00:06:23.776 ' 00:06:23.776 19:04:42 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:23.777 19:04:42 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3335839 00:06:23.777 19:04:42 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:23.777 19:04:42 -- accel/accel_rpc.sh@15 -- # waitforlisten 3335839 00:06:23.777 19:04:42 -- common/autotest_common.sh@829 -- # '[' -z 3335839 ']' 00:06:23.777 19:04:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.777 19:04:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.777 19:04:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.777 19:04:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.777 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:23.777 [2024-11-18 19:04:42.333487] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.777 [2024-11-18 19:04:42.333567] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3335839 ] 00:06:23.777 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.035 [2024-11-18 19:04:42.391774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.035 [2024-11-18 19:04:42.502031] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:24.035 [2024-11-18 19:04:42.502214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.035 19:04:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:24.035 19:04:42 -- common/autotest_common.sh@862 -- # return 0 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:24.035 19:04:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.035 19:04:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.035 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:24.035 ************************************ 00:06:24.035 START TEST accel_assign_opcode 00:06:24.035 ************************************ 00:06:24.035 19:04:42 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:24.035 19:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.035 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:24.035 [2024-11-18 19:04:42.558760] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:24.035 19:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:24.035 19:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.035 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:24.035 [2024-11-18 19:04:42.566774] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:24.035 19:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.035 19:04:42 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:24.035 19:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.035 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:24.294 19:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.294 19:04:42 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:24.294 19:04:42 -- accel/accel_rpc.sh@42 -- # grep software 00:06:24.294 19:04:42 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:24.294 19:04:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:24.294 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:24.294 19:04:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:24.294 software 00:06:24.294 00:06:24.294 real 0m0.305s 00:06:24.294 user 0m0.039s 00:06:24.294 sys 0m0.010s 00:06:24.294 19:04:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.294 19:04:42 -- common/autotest_common.sh@10 -- # set +x 00:06:24.294 ************************************ 00:06:24.294 END TEST accel_assign_opcode 00:06:24.294 ************************************ 00:06:24.294 19:04:42 -- accel/accel_rpc.sh@55 -- # killprocess 3335839 00:06:24.294 19:04:42 -- common/autotest_common.sh@936 -- # '[' -z 3335839 ']' 00:06:24.294 19:04:42 -- common/autotest_common.sh@940 -- # kill -0 3335839 00:06:24.294 19:04:42 -- common/autotest_common.sh@941 -- # uname 00:06:24.294 19:04:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:24.294 19:04:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3335839 00:06:24.552 19:04:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:24.552 19:04:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:24.552 19:04:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3335839' 00:06:24.552 killing process with pid 3335839 00:06:24.552 19:04:42 -- common/autotest_common.sh@955 -- # kill 3335839 00:06:24.552 19:04:42 -- common/autotest_common.sh@960 -- # wait 3335839 00:06:24.810 00:06:24.810 real 0m1.265s 00:06:24.810 user 0m1.168s 00:06:24.810 sys 0m0.463s 00:06:24.810 19:04:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.810 19:04:43 -- common/autotest_common.sh@10 -- # set +x 00:06:24.810 ************************************ 00:06:24.810 END TEST accel_rpc 00:06:24.810 ************************************ 00:06:25.069 19:04:43 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:25.069 19:04:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.069 19:04:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.069 19:04:43 -- common/autotest_common.sh@10 -- # set +x 00:06:25.069 ************************************ 00:06:25.069 START TEST app_cmdline 00:06:25.069 ************************************ 00:06:25.069 19:04:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:25.069 * Looking for test storage... 00:06:25.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:25.069 19:04:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:25.069 19:04:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:25.069 19:04:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:25.069 19:04:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:25.069 19:04:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:25.069 19:04:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:25.069 19:04:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:25.069 19:04:43 -- scripts/common.sh@335 -- # IFS=.-: 00:06:25.069 19:04:43 -- scripts/common.sh@335 -- # read -ra ver1 00:06:25.069 19:04:43 -- scripts/common.sh@336 -- # IFS=.-: 00:06:25.069 19:04:43 -- scripts/common.sh@336 -- # read -ra ver2 00:06:25.069 19:04:43 -- scripts/common.sh@337 -- # local 'op=<' 00:06:25.069 19:04:43 -- scripts/common.sh@339 -- # ver1_l=2 00:06:25.069 19:04:43 -- scripts/common.sh@340 -- # ver2_l=1 00:06:25.069 19:04:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:25.069 19:04:43 -- scripts/common.sh@343 -- # case "$op" in 00:06:25.069 19:04:43 -- scripts/common.sh@344 -- # : 1 00:06:25.069 19:04:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:25.069 19:04:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:25.069 19:04:43 -- scripts/common.sh@364 -- # decimal 1 00:06:25.069 19:04:43 -- scripts/common.sh@352 -- # local d=1 00:06:25.069 19:04:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:25.069 19:04:43 -- scripts/common.sh@354 -- # echo 1 00:06:25.069 19:04:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:25.069 19:04:43 -- scripts/common.sh@365 -- # decimal 2 00:06:25.069 19:04:43 -- scripts/common.sh@352 -- # local d=2 00:06:25.069 19:04:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:25.069 19:04:43 -- scripts/common.sh@354 -- # echo 2 00:06:25.069 19:04:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:25.069 19:04:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:25.069 19:04:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:25.069 19:04:43 -- scripts/common.sh@367 -- # return 0 00:06:25.069 19:04:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:25.069 19:04:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:25.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.069 --rc genhtml_branch_coverage=1 00:06:25.069 --rc genhtml_function_coverage=1 00:06:25.069 --rc genhtml_legend=1 00:06:25.069 --rc geninfo_all_blocks=1 00:06:25.069 --rc geninfo_unexecuted_blocks=1 00:06:25.069 00:06:25.069 ' 00:06:25.069 19:04:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:25.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.069 --rc genhtml_branch_coverage=1 00:06:25.069 --rc genhtml_function_coverage=1 00:06:25.069 --rc genhtml_legend=1 00:06:25.069 --rc geninfo_all_blocks=1 00:06:25.069 --rc geninfo_unexecuted_blocks=1 00:06:25.069 00:06:25.069 ' 00:06:25.069 19:04:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:25.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.069 --rc genhtml_branch_coverage=1 00:06:25.069 --rc genhtml_function_coverage=1 00:06:25.069 --rc genhtml_legend=1 00:06:25.069 --rc geninfo_all_blocks=1 00:06:25.069 --rc geninfo_unexecuted_blocks=1 00:06:25.069 00:06:25.069 ' 00:06:25.069 19:04:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:25.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.069 --rc genhtml_branch_coverage=1 00:06:25.069 --rc genhtml_function_coverage=1 00:06:25.069 --rc genhtml_legend=1 00:06:25.069 --rc geninfo_all_blocks=1 00:06:25.069 --rc geninfo_unexecuted_blocks=1 00:06:25.069 00:06:25.069 ' 00:06:25.069 19:04:43 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:25.069 19:04:43 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3336052 00:06:25.069 19:04:43 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:25.069 19:04:43 -- app/cmdline.sh@18 -- # waitforlisten 3336052 00:06:25.069 19:04:43 -- common/autotest_common.sh@829 -- # '[' -z 3336052 ']' 00:06:25.069 19:04:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.069 19:04:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.070 19:04:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.070 19:04:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.070 19:04:43 -- common/autotest_common.sh@10 -- # set +x 00:06:25.070 [2024-11-18 19:04:43.606507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.070 [2024-11-18 19:04:43.606631] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3336052 ] 00:06:25.070 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.070 [2024-11-18 19:04:43.665245] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.328 [2024-11-18 19:04:43.777339] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.328 [2024-11-18 19:04:43.777525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.261 19:04:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.261 19:04:44 -- common/autotest_common.sh@862 -- # return 0 00:06:26.261 19:04:44 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:26.261 { 00:06:26.261 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:26.261 "fields": { 00:06:26.261 "major": 24, 00:06:26.261 "minor": 1, 00:06:26.261 "patch": 1, 00:06:26.261 "suffix": "-pre", 00:06:26.261 "commit": "c13c99a5e" 00:06:26.261 } 00:06:26.261 } 00:06:26.520 19:04:44 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:26.520 19:04:44 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:26.520 19:04:44 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:26.520 19:04:44 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:26.520 19:04:44 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:26.520 19:04:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:26.520 19:04:44 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:26.520 19:04:44 -- common/autotest_common.sh@10 -- # set +x 00:06:26.520 19:04:44 -- app/cmdline.sh@26 -- # sort 00:06:26.520 19:04:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:26.520 19:04:44 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:26.520 19:04:44 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:26.520 19:04:44 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.520 19:04:44 -- common/autotest_common.sh@650 -- # local es=0 00:06:26.520 19:04:44 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.520 19:04:44 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.520 19:04:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.520 19:04:44 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.520 19:04:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.520 19:04:44 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.520 19:04:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:26.520 19:04:44 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:26.520 19:04:44 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:26.520 19:04:44 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:26.778 request: 00:06:26.778 { 00:06:26.778 "method": "env_dpdk_get_mem_stats", 00:06:26.778 "req_id": 1 00:06:26.778 } 00:06:26.778 Got JSON-RPC error response 00:06:26.778 response: 00:06:26.778 { 00:06:26.778 "code": -32601, 00:06:26.778 "message": "Method not found" 00:06:26.778 } 00:06:26.778 19:04:45 -- common/autotest_common.sh@653 -- # es=1 00:06:26.778 19:04:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:26.778 19:04:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:26.778 19:04:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:26.778 19:04:45 -- app/cmdline.sh@1 -- # killprocess 3336052 00:06:26.778 19:04:45 -- common/autotest_common.sh@936 -- # '[' -z 3336052 ']' 00:06:26.778 19:04:45 -- common/autotest_common.sh@940 -- # kill -0 3336052 00:06:26.778 19:04:45 -- common/autotest_common.sh@941 -- # uname 00:06:26.778 19:04:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:26.778 19:04:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3336052 00:06:26.778 19:04:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:26.778 19:04:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:26.778 19:04:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3336052' 00:06:26.778 killing process with pid 3336052 00:06:26.778 19:04:45 -- common/autotest_common.sh@955 -- # kill 3336052 00:06:26.778 19:04:45 -- common/autotest_common.sh@960 -- # wait 3336052 00:06:27.344 00:06:27.344 real 0m2.312s 00:06:27.344 user 0m2.953s 00:06:27.344 sys 0m0.525s 00:06:27.344 19:04:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.344 19:04:45 -- common/autotest_common.sh@10 -- # set +x 00:06:27.344 ************************************ 00:06:27.344 END TEST app_cmdline 00:06:27.344 ************************************ 00:06:27.344 19:04:45 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:27.344 19:04:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.344 19:04:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.344 19:04:45 -- common/autotest_common.sh@10 -- # set +x 00:06:27.344 ************************************ 00:06:27.344 START TEST version 00:06:27.344 ************************************ 00:06:27.344 19:04:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:27.344 * Looking for test storage... 00:06:27.344 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:27.344 19:04:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.344 19:04:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.344 19:04:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.344 19:04:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.344 19:04:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.344 19:04:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.344 19:04:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.344 19:04:45 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.344 19:04:45 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.344 19:04:45 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.344 19:04:45 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.344 19:04:45 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.344 19:04:45 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.344 19:04:45 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.344 19:04:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.344 19:04:45 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.344 19:04:45 -- scripts/common.sh@344 -- # : 1 00:06:27.344 19:04:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.344 19:04:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.344 19:04:45 -- scripts/common.sh@364 -- # decimal 1 00:06:27.344 19:04:45 -- scripts/common.sh@352 -- # local d=1 00:06:27.344 19:04:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.344 19:04:45 -- scripts/common.sh@354 -- # echo 1 00:06:27.344 19:04:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.344 19:04:45 -- scripts/common.sh@365 -- # decimal 2 00:06:27.344 19:04:45 -- scripts/common.sh@352 -- # local d=2 00:06:27.344 19:04:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.344 19:04:45 -- scripts/common.sh@354 -- # echo 2 00:06:27.344 19:04:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.344 19:04:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.344 19:04:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.344 19:04:45 -- scripts/common.sh@367 -- # return 0 00:06:27.344 19:04:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.344 19:04:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.344 --rc genhtml_branch_coverage=1 00:06:27.344 --rc genhtml_function_coverage=1 00:06:27.344 --rc genhtml_legend=1 00:06:27.344 --rc geninfo_all_blocks=1 00:06:27.344 --rc geninfo_unexecuted_blocks=1 00:06:27.344 00:06:27.344 ' 00:06:27.344 19:04:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.344 --rc genhtml_branch_coverage=1 00:06:27.344 --rc genhtml_function_coverage=1 00:06:27.344 --rc genhtml_legend=1 00:06:27.344 --rc geninfo_all_blocks=1 00:06:27.344 --rc geninfo_unexecuted_blocks=1 00:06:27.344 00:06:27.344 ' 00:06:27.344 19:04:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.344 --rc genhtml_branch_coverage=1 00:06:27.344 --rc genhtml_function_coverage=1 00:06:27.344 --rc genhtml_legend=1 00:06:27.344 --rc geninfo_all_blocks=1 00:06:27.344 --rc geninfo_unexecuted_blocks=1 00:06:27.344 00:06:27.344 ' 00:06:27.344 19:04:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.344 --rc genhtml_branch_coverage=1 00:06:27.344 --rc genhtml_function_coverage=1 00:06:27.344 --rc genhtml_legend=1 00:06:27.344 --rc geninfo_all_blocks=1 00:06:27.344 --rc geninfo_unexecuted_blocks=1 00:06:27.344 00:06:27.344 ' 00:06:27.344 19:04:45 -- app/version.sh@17 -- # get_header_version major 00:06:27.344 19:04:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.344 19:04:45 -- app/version.sh@14 -- # cut -f2 00:06:27.344 19:04:45 -- app/version.sh@14 -- # tr -d '"' 00:06:27.344 19:04:45 -- app/version.sh@17 -- # major=24 00:06:27.344 19:04:45 -- app/version.sh@18 -- # get_header_version minor 00:06:27.344 19:04:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.344 19:04:45 -- app/version.sh@14 -- # cut -f2 00:06:27.344 19:04:45 -- app/version.sh@14 -- # tr -d '"' 00:06:27.344 19:04:45 -- app/version.sh@18 -- # minor=1 00:06:27.344 19:04:45 -- app/version.sh@19 -- # get_header_version patch 00:06:27.344 19:04:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.345 19:04:45 -- app/version.sh@14 -- # cut -f2 00:06:27.345 19:04:45 -- app/version.sh@14 -- # tr -d '"' 00:06:27.345 19:04:45 -- app/version.sh@19 -- # patch=1 00:06:27.345 19:04:45 -- app/version.sh@20 -- # get_header_version suffix 00:06:27.345 19:04:45 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:27.345 19:04:45 -- app/version.sh@14 -- # cut -f2 00:06:27.345 19:04:45 -- app/version.sh@14 -- # tr -d '"' 00:06:27.345 19:04:45 -- app/version.sh@20 -- # suffix=-pre 00:06:27.345 19:04:45 -- app/version.sh@22 -- # version=24.1 00:06:27.345 19:04:45 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:27.345 19:04:45 -- app/version.sh@25 -- # version=24.1.1 00:06:27.345 19:04:45 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:27.345 19:04:45 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:27.345 19:04:45 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:27.604 19:04:45 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:27.604 19:04:45 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:27.604 00:06:27.604 real 0m0.185s 00:06:27.604 user 0m0.125s 00:06:27.604 sys 0m0.084s 00:06:27.604 19:04:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.604 19:04:45 -- common/autotest_common.sh@10 -- # set +x 00:06:27.604 ************************************ 00:06:27.604 END TEST version 00:06:27.604 ************************************ 00:06:27.604 19:04:45 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@191 -- # uname -s 00:06:27.604 19:04:45 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:27.604 19:04:45 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:27.604 19:04:45 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:27.604 19:04:45 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:27.604 19:04:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:27.604 19:04:45 -- common/autotest_common.sh@10 -- # set +x 00:06:27.604 19:04:45 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:27.604 19:04:45 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:27.604 19:04:45 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:27.604 19:04:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:27.604 19:04:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.604 19:04:45 -- common/autotest_common.sh@10 -- # set +x 00:06:27.604 ************************************ 00:06:27.604 START TEST nvmf_tcp 00:06:27.604 ************************************ 00:06:27.604 19:04:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:27.604 * Looking for test storage... 00:06:27.604 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:27.604 19:04:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.604 19:04:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.604 19:04:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.604 19:04:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.604 19:04:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.604 19:04:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.604 19:04:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.604 19:04:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.604 19:04:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.604 19:04:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.604 19:04:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.604 19:04:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.604 19:04:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.604 19:04:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.604 19:04:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.604 19:04:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.604 19:04:46 -- scripts/common.sh@344 -- # : 1 00:06:27.604 19:04:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.604 19:04:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.604 19:04:46 -- scripts/common.sh@364 -- # decimal 1 00:06:27.604 19:04:46 -- scripts/common.sh@352 -- # local d=1 00:06:27.604 19:04:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.604 19:04:46 -- scripts/common.sh@354 -- # echo 1 00:06:27.604 19:04:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.604 19:04:46 -- scripts/common.sh@365 -- # decimal 2 00:06:27.604 19:04:46 -- scripts/common.sh@352 -- # local d=2 00:06:27.604 19:04:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.604 19:04:46 -- scripts/common.sh@354 -- # echo 2 00:06:27.604 19:04:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.604 19:04:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.604 19:04:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.604 19:04:46 -- scripts/common.sh@367 -- # return 0 00:06:27.604 19:04:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.604 19:04:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.604 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.604 --rc genhtml_branch_coverage=1 00:06:27.604 --rc genhtml_function_coverage=1 00:06:27.604 --rc genhtml_legend=1 00:06:27.604 --rc geninfo_all_blocks=1 00:06:27.604 --rc geninfo_unexecuted_blocks=1 00:06:27.604 00:06:27.604 ' 00:06:27.604 19:04:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.604 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.604 --rc genhtml_branch_coverage=1 00:06:27.604 --rc genhtml_function_coverage=1 00:06:27.604 --rc genhtml_legend=1 00:06:27.604 --rc geninfo_all_blocks=1 00:06:27.604 --rc geninfo_unexecuted_blocks=1 00:06:27.604 00:06:27.604 ' 00:06:27.604 19:04:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.604 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.604 --rc genhtml_branch_coverage=1 00:06:27.604 --rc genhtml_function_coverage=1 00:06:27.604 --rc genhtml_legend=1 00:06:27.604 --rc geninfo_all_blocks=1 00:06:27.604 --rc geninfo_unexecuted_blocks=1 00:06:27.604 00:06:27.604 ' 00:06:27.604 19:04:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.604 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.604 --rc genhtml_branch_coverage=1 00:06:27.604 --rc genhtml_function_coverage=1 00:06:27.604 --rc genhtml_legend=1 00:06:27.604 --rc geninfo_all_blocks=1 00:06:27.604 --rc geninfo_unexecuted_blocks=1 00:06:27.604 00:06:27.604 ' 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.604 19:04:46 -- nvmf/common.sh@7 -- # uname -s 00:06:27.604 19:04:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.604 19:04:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.604 19:04:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.604 19:04:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.604 19:04:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.604 19:04:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.604 19:04:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.604 19:04:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.604 19:04:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.604 19:04:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.604 19:04:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.604 19:04:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.604 19:04:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.604 19:04:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.604 19:04:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.604 19:04:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:27.604 19:04:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.604 19:04:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.604 19:04:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.604 19:04:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.604 19:04:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.604 19:04:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.604 19:04:46 -- paths/export.sh@5 -- # export PATH 00:06:27.604 19:04:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.604 19:04:46 -- nvmf/common.sh@46 -- # : 0 00:06:27.604 19:04:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:27.604 19:04:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:27.604 19:04:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.604 19:04:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.604 19:04:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:27.604 19:04:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:27.604 19:04:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:27.604 19:04:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:27.604 19:04:46 -- common/autotest_common.sh@10 -- # set +x 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:27.604 19:04:46 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:27.605 19:04:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:27.605 19:04:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.605 19:04:46 -- common/autotest_common.sh@10 -- # set +x 00:06:27.605 ************************************ 00:06:27.605 START TEST nvmf_example 00:06:27.605 ************************************ 00:06:27.605 19:04:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:27.605 * Looking for test storage... 00:06:27.863 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:27.863 19:04:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.863 19:04:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.863 19:04:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.863 19:04:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.863 19:04:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.863 19:04:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.863 19:04:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.863 19:04:46 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.863 19:04:46 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.863 19:04:46 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.863 19:04:46 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.863 19:04:46 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.863 19:04:46 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.863 19:04:46 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.863 19:04:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.863 19:04:46 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.863 19:04:46 -- scripts/common.sh@344 -- # : 1 00:06:27.863 19:04:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.863 19:04:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.863 19:04:46 -- scripts/common.sh@364 -- # decimal 1 00:06:27.863 19:04:46 -- scripts/common.sh@352 -- # local d=1 00:06:27.863 19:04:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.863 19:04:46 -- scripts/common.sh@354 -- # echo 1 00:06:27.863 19:04:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.863 19:04:46 -- scripts/common.sh@365 -- # decimal 2 00:06:27.863 19:04:46 -- scripts/common.sh@352 -- # local d=2 00:06:27.863 19:04:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.863 19:04:46 -- scripts/common.sh@354 -- # echo 2 00:06:27.863 19:04:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.863 19:04:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.863 19:04:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.863 19:04:46 -- scripts/common.sh@367 -- # return 0 00:06:27.863 19:04:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.863 19:04:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.863 --rc genhtml_branch_coverage=1 00:06:27.863 --rc genhtml_function_coverage=1 00:06:27.863 --rc genhtml_legend=1 00:06:27.863 --rc geninfo_all_blocks=1 00:06:27.863 --rc geninfo_unexecuted_blocks=1 00:06:27.863 00:06:27.863 ' 00:06:27.863 19:04:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.863 --rc genhtml_branch_coverage=1 00:06:27.863 --rc genhtml_function_coverage=1 00:06:27.863 --rc genhtml_legend=1 00:06:27.863 --rc geninfo_all_blocks=1 00:06:27.863 --rc geninfo_unexecuted_blocks=1 00:06:27.863 00:06:27.863 ' 00:06:27.863 19:04:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.863 --rc genhtml_branch_coverage=1 00:06:27.863 --rc genhtml_function_coverage=1 00:06:27.863 --rc genhtml_legend=1 00:06:27.863 --rc geninfo_all_blocks=1 00:06:27.863 --rc geninfo_unexecuted_blocks=1 00:06:27.863 00:06:27.863 ' 00:06:27.863 19:04:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.863 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.863 --rc genhtml_branch_coverage=1 00:06:27.863 --rc genhtml_function_coverage=1 00:06:27.863 --rc genhtml_legend=1 00:06:27.863 --rc geninfo_all_blocks=1 00:06:27.863 --rc geninfo_unexecuted_blocks=1 00:06:27.863 00:06:27.863 ' 00:06:27.863 19:04:46 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:27.863 19:04:46 -- nvmf/common.sh@7 -- # uname -s 00:06:27.863 19:04:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:27.863 19:04:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:27.863 19:04:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:27.863 19:04:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:27.863 19:04:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:27.863 19:04:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:27.863 19:04:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:27.863 19:04:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:27.863 19:04:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:27.863 19:04:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:27.863 19:04:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.863 19:04:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:27.863 19:04:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:27.863 19:04:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:27.863 19:04:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:27.863 19:04:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:27.863 19:04:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:27.863 19:04:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:27.863 19:04:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:27.863 19:04:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.863 19:04:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.863 19:04:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.863 19:04:46 -- paths/export.sh@5 -- # export PATH 00:06:27.863 19:04:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:27.863 19:04:46 -- nvmf/common.sh@46 -- # : 0 00:06:27.863 19:04:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:27.863 19:04:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:27.863 19:04:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:27.864 19:04:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:27.864 19:04:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:27.864 19:04:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:27.864 19:04:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:27.864 19:04:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:27.864 19:04:46 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:27.864 19:04:46 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:27.864 19:04:46 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:27.864 19:04:46 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:27.864 19:04:46 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:27.864 19:04:46 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:27.864 19:04:46 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:27.864 19:04:46 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:27.864 19:04:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:27.864 19:04:46 -- common/autotest_common.sh@10 -- # set +x 00:06:27.864 19:04:46 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:27.864 19:04:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:27.864 19:04:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:27.864 19:04:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:27.864 19:04:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:27.864 19:04:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:27.864 19:04:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:27.864 19:04:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:27.864 19:04:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:27.864 19:04:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:27.864 19:04:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:27.864 19:04:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:27.864 19:04:46 -- common/autotest_common.sh@10 -- # set +x 00:06:29.764 19:04:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:29.764 19:04:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:29.764 19:04:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:29.764 19:04:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:29.764 19:04:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:29.764 19:04:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:29.764 19:04:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:29.764 19:04:48 -- nvmf/common.sh@294 -- # net_devs=() 00:06:29.764 19:04:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:29.764 19:04:48 -- nvmf/common.sh@295 -- # e810=() 00:06:29.764 19:04:48 -- nvmf/common.sh@295 -- # local -ga e810 00:06:29.764 19:04:48 -- nvmf/common.sh@296 -- # x722=() 00:06:29.764 19:04:48 -- nvmf/common.sh@296 -- # local -ga x722 00:06:29.764 19:04:48 -- nvmf/common.sh@297 -- # mlx=() 00:06:29.764 19:04:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:29.764 19:04:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:29.764 19:04:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:29.764 19:04:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:29.764 19:04:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:29.764 19:04:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:29.764 19:04:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:29.764 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:29.764 19:04:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:29.764 19:04:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:29.764 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:29.764 19:04:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:29.764 19:04:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:29.764 19:04:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:29.764 19:04:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:29.764 19:04:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:29.764 19:04:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:29.764 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:29.764 19:04:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:29.764 19:04:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:29.764 19:04:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:29.764 19:04:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:29.764 19:04:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:29.764 19:04:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:29.764 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:29.764 19:04:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:29.764 19:04:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:29.764 19:04:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:29.764 19:04:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:29.764 19:04:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:29.764 19:04:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:29.764 19:04:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:29.764 19:04:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:29.764 19:04:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:29.764 19:04:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:29.764 19:04:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:29.764 19:04:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:29.764 19:04:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:29.764 19:04:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:29.764 19:04:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:29.764 19:04:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:29.764 19:04:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:29.764 19:04:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:30.023 19:04:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:30.023 19:04:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:30.023 19:04:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:30.023 19:04:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:30.023 19:04:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:30.023 19:04:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:30.023 19:04:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:30.023 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:30.023 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.357 ms 00:06:30.023 00:06:30.023 --- 10.0.0.2 ping statistics --- 00:06:30.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:30.023 rtt min/avg/max/mdev = 0.357/0.357/0.357/0.000 ms 00:06:30.023 19:04:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:30.023 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:30.023 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:06:30.023 00:06:30.023 --- 10.0.0.1 ping statistics --- 00:06:30.023 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:30.023 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:06:30.023 19:04:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:30.023 19:04:48 -- nvmf/common.sh@410 -- # return 0 00:06:30.023 19:04:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:30.023 19:04:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:30.023 19:04:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:30.023 19:04:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:30.023 19:04:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:30.023 19:04:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:30.023 19:04:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:30.023 19:04:48 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:30.023 19:04:48 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:30.023 19:04:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:30.023 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.023 19:04:48 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:30.023 19:04:48 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:30.023 19:04:48 -- target/nvmf_example.sh@34 -- # nvmfpid=3338119 00:06:30.023 19:04:48 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:30.023 19:04:48 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:30.023 19:04:48 -- target/nvmf_example.sh@36 -- # waitforlisten 3338119 00:06:30.023 19:04:48 -- common/autotest_common.sh@829 -- # '[' -z 3338119 ']' 00:06:30.023 19:04:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.023 19:04:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.023 19:04:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.023 19:04:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.023 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.023 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.282 19:04:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.282 19:04:48 -- common/autotest_common.sh@862 -- # return 0 00:06:30.282 19:04:48 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:30.282 19:04:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:30.282 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.282 19:04:48 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:30.282 19:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.282 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.282 19:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.282 19:04:48 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:30.282 19:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.282 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.540 19:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.540 19:04:48 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:30.540 19:04:48 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:30.540 19:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.540 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.540 19:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.540 19:04:48 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:30.540 19:04:48 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:30.540 19:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.540 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.540 19:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.540 19:04:48 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:30.540 19:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.540 19:04:48 -- common/autotest_common.sh@10 -- # set +x 00:06:30.540 19:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.540 19:04:48 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:30.540 19:04:48 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:30.540 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.745 Initializing NVMe Controllers 00:06:42.745 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:42.745 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:42.745 Initialization complete. Launching workers. 00:06:42.745 ======================================================== 00:06:42.745 Latency(us) 00:06:42.745 Device Information : IOPS MiB/s Average min max 00:06:42.745 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14755.00 57.64 4337.75 761.00 15638.69 00:06:42.745 ======================================================== 00:06:42.745 Total : 14755.00 57.64 4337.75 761.00 15638.69 00:06:42.745 00:06:42.745 19:04:59 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:42.745 19:04:59 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:42.745 19:04:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:42.745 19:04:59 -- nvmf/common.sh@116 -- # sync 00:06:42.745 19:04:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:42.745 19:04:59 -- nvmf/common.sh@119 -- # set +e 00:06:42.745 19:04:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:42.745 19:04:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:42.745 rmmod nvme_tcp 00:06:42.745 rmmod nvme_fabrics 00:06:42.745 rmmod nvme_keyring 00:06:42.745 19:04:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:42.745 19:04:59 -- nvmf/common.sh@123 -- # set -e 00:06:42.745 19:04:59 -- nvmf/common.sh@124 -- # return 0 00:06:42.745 19:04:59 -- nvmf/common.sh@477 -- # '[' -n 3338119 ']' 00:06:42.745 19:04:59 -- nvmf/common.sh@478 -- # killprocess 3338119 00:06:42.745 19:04:59 -- common/autotest_common.sh@936 -- # '[' -z 3338119 ']' 00:06:42.745 19:04:59 -- common/autotest_common.sh@940 -- # kill -0 3338119 00:06:42.745 19:04:59 -- common/autotest_common.sh@941 -- # uname 00:06:42.745 19:04:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.745 19:04:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3338119 00:06:42.745 19:04:59 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:42.745 19:04:59 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:42.745 19:04:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3338119' 00:06:42.745 killing process with pid 3338119 00:06:42.745 19:04:59 -- common/autotest_common.sh@955 -- # kill 3338119 00:06:42.745 19:04:59 -- common/autotest_common.sh@960 -- # wait 3338119 00:06:42.745 nvmf threads initialize successfully 00:06:42.745 bdev subsystem init successfully 00:06:42.745 created a nvmf target service 00:06:42.745 create targets's poll groups done 00:06:42.745 all subsystems of target started 00:06:42.745 nvmf target is running 00:06:42.745 all subsystems of target stopped 00:06:42.745 destroy targets's poll groups done 00:06:42.745 destroyed the nvmf target service 00:06:42.745 bdev subsystem finish successfully 00:06:42.745 nvmf threads destroy successfully 00:06:42.745 19:04:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:42.745 19:04:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:42.745 19:04:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:42.745 19:04:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:42.745 19:04:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:42.745 19:04:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:42.745 19:04:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:42.745 19:04:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.004 19:05:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:43.004 19:05:01 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:43.004 19:05:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:43.004 19:05:01 -- common/autotest_common.sh@10 -- # set +x 00:06:43.004 00:06:43.004 real 0m15.427s 00:06:43.004 user 0m41.389s 00:06:43.004 sys 0m3.766s 00:06:43.004 19:05:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.004 19:05:01 -- common/autotest_common.sh@10 -- # set +x 00:06:43.004 ************************************ 00:06:43.004 END TEST nvmf_example 00:06:43.004 ************************************ 00:06:43.264 19:05:01 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:43.264 19:05:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:43.264 19:05:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.264 19:05:01 -- common/autotest_common.sh@10 -- # set +x 00:06:43.264 ************************************ 00:06:43.264 START TEST nvmf_filesystem 00:06:43.264 ************************************ 00:06:43.264 19:05:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:43.264 * Looking for test storage... 00:06:43.264 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.264 19:05:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.264 19:05:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.264 19:05:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.264 19:05:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.264 19:05:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.264 19:05:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.264 19:05:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.264 19:05:01 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.264 19:05:01 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.264 19:05:01 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.264 19:05:01 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.264 19:05:01 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.264 19:05:01 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.264 19:05:01 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.264 19:05:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.264 19:05:01 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.264 19:05:01 -- scripts/common.sh@344 -- # : 1 00:06:43.264 19:05:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.264 19:05:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.264 19:05:01 -- scripts/common.sh@364 -- # decimal 1 00:06:43.264 19:05:01 -- scripts/common.sh@352 -- # local d=1 00:06:43.264 19:05:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.264 19:05:01 -- scripts/common.sh@354 -- # echo 1 00:06:43.264 19:05:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.264 19:05:01 -- scripts/common.sh@365 -- # decimal 2 00:06:43.264 19:05:01 -- scripts/common.sh@352 -- # local d=2 00:06:43.264 19:05:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.264 19:05:01 -- scripts/common.sh@354 -- # echo 2 00:06:43.264 19:05:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.264 19:05:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.264 19:05:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.264 19:05:01 -- scripts/common.sh@367 -- # return 0 00:06:43.264 19:05:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.264 19:05:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.264 --rc genhtml_branch_coverage=1 00:06:43.264 --rc genhtml_function_coverage=1 00:06:43.264 --rc genhtml_legend=1 00:06:43.264 --rc geninfo_all_blocks=1 00:06:43.264 --rc geninfo_unexecuted_blocks=1 00:06:43.264 00:06:43.264 ' 00:06:43.264 19:05:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.264 --rc genhtml_branch_coverage=1 00:06:43.264 --rc genhtml_function_coverage=1 00:06:43.264 --rc genhtml_legend=1 00:06:43.264 --rc geninfo_all_blocks=1 00:06:43.264 --rc geninfo_unexecuted_blocks=1 00:06:43.264 00:06:43.264 ' 00:06:43.264 19:05:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.264 --rc genhtml_branch_coverage=1 00:06:43.264 --rc genhtml_function_coverage=1 00:06:43.264 --rc genhtml_legend=1 00:06:43.265 --rc geninfo_all_blocks=1 00:06:43.265 --rc geninfo_unexecuted_blocks=1 00:06:43.265 00:06:43.265 ' 00:06:43.265 19:05:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.265 --rc genhtml_branch_coverage=1 00:06:43.265 --rc genhtml_function_coverage=1 00:06:43.265 --rc genhtml_legend=1 00:06:43.265 --rc geninfo_all_blocks=1 00:06:43.265 --rc geninfo_unexecuted_blocks=1 00:06:43.265 00:06:43.265 ' 00:06:43.265 19:05:01 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:43.265 19:05:01 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:43.265 19:05:01 -- common/autotest_common.sh@34 -- # set -e 00:06:43.265 19:05:01 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:43.265 19:05:01 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:43.265 19:05:01 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:43.265 19:05:01 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:43.265 19:05:01 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:43.265 19:05:01 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:43.265 19:05:01 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:43.265 19:05:01 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:43.265 19:05:01 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:43.265 19:05:01 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:43.265 19:05:01 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:43.265 19:05:01 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:43.265 19:05:01 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:43.265 19:05:01 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:43.265 19:05:01 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:43.265 19:05:01 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:43.265 19:05:01 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:43.265 19:05:01 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:43.265 19:05:01 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:43.265 19:05:01 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:43.265 19:05:01 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:43.265 19:05:01 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:43.265 19:05:01 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:43.265 19:05:01 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:43.265 19:05:01 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:43.265 19:05:01 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:43.265 19:05:01 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:43.265 19:05:01 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:43.265 19:05:01 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:43.265 19:05:01 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:43.265 19:05:01 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:43.265 19:05:01 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:43.265 19:05:01 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:43.265 19:05:01 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:43.265 19:05:01 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:43.265 19:05:01 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:43.265 19:05:01 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:43.265 19:05:01 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:43.265 19:05:01 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:43.265 19:05:01 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:43.265 19:05:01 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:43.265 19:05:01 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:43.265 19:05:01 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:43.265 19:05:01 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:43.265 19:05:01 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:43.265 19:05:01 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:43.265 19:05:01 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:43.265 19:05:01 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:43.265 19:05:01 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:43.265 19:05:01 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:43.265 19:05:01 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:43.265 19:05:01 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:43.265 19:05:01 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:43.265 19:05:01 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:43.265 19:05:01 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:43.265 19:05:01 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:43.265 19:05:01 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:43.265 19:05:01 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:43.265 19:05:01 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:43.265 19:05:01 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:43.265 19:05:01 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:43.265 19:05:01 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:43.265 19:05:01 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:43.265 19:05:01 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:43.265 19:05:01 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:43.265 19:05:01 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:43.265 19:05:01 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:43.265 19:05:01 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:43.265 19:05:01 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:43.265 19:05:01 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:43.265 19:05:01 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:43.265 19:05:01 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:43.265 19:05:01 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:43.265 19:05:01 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:43.265 19:05:01 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:43.265 19:05:01 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:43.265 19:05:01 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:43.265 19:05:01 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:43.265 19:05:01 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:43.265 19:05:01 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:43.265 19:05:01 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:43.265 19:05:01 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:43.265 19:05:01 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.265 19:05:01 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:43.265 19:05:01 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.265 19:05:01 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:43.265 19:05:01 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:43.265 19:05:01 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:43.265 19:05:01 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:43.265 19:05:01 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:43.265 19:05:01 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:43.265 19:05:01 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:43.265 19:05:01 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:43.265 #define SPDK_CONFIG_H 00:06:43.265 #define SPDK_CONFIG_APPS 1 00:06:43.265 #define SPDK_CONFIG_ARCH native 00:06:43.265 #undef SPDK_CONFIG_ASAN 00:06:43.265 #undef SPDK_CONFIG_AVAHI 00:06:43.265 #undef SPDK_CONFIG_CET 00:06:43.265 #define SPDK_CONFIG_COVERAGE 1 00:06:43.265 #define SPDK_CONFIG_CROSS_PREFIX 00:06:43.265 #undef SPDK_CONFIG_CRYPTO 00:06:43.265 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:43.265 #undef SPDK_CONFIG_CUSTOMOCF 00:06:43.265 #undef SPDK_CONFIG_DAOS 00:06:43.265 #define SPDK_CONFIG_DAOS_DIR 00:06:43.265 #define SPDK_CONFIG_DEBUG 1 00:06:43.265 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:43.265 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:43.265 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:43.265 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:43.265 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:43.265 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:43.265 #define SPDK_CONFIG_EXAMPLES 1 00:06:43.265 #undef SPDK_CONFIG_FC 00:06:43.265 #define SPDK_CONFIG_FC_PATH 00:06:43.265 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:43.265 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:43.265 #undef SPDK_CONFIG_FUSE 00:06:43.265 #undef SPDK_CONFIG_FUZZER 00:06:43.265 #define SPDK_CONFIG_FUZZER_LIB 00:06:43.265 #undef SPDK_CONFIG_GOLANG 00:06:43.265 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:43.265 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:43.265 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:43.265 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:43.265 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:43.265 #define SPDK_CONFIG_IDXD 1 00:06:43.265 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:43.265 #undef SPDK_CONFIG_IPSEC_MB 00:06:43.265 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:43.265 #define SPDK_CONFIG_ISAL 1 00:06:43.265 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:43.265 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:43.265 #define SPDK_CONFIG_LIBDIR 00:06:43.265 #undef SPDK_CONFIG_LTO 00:06:43.265 #define SPDK_CONFIG_MAX_LCORES 00:06:43.265 #define SPDK_CONFIG_NVME_CUSE 1 00:06:43.266 #undef SPDK_CONFIG_OCF 00:06:43.266 #define SPDK_CONFIG_OCF_PATH 00:06:43.266 #define SPDK_CONFIG_OPENSSL_PATH 00:06:43.266 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:43.266 #undef SPDK_CONFIG_PGO_USE 00:06:43.266 #define SPDK_CONFIG_PREFIX /usr/local 00:06:43.266 #undef SPDK_CONFIG_RAID5F 00:06:43.266 #undef SPDK_CONFIG_RBD 00:06:43.266 #define SPDK_CONFIG_RDMA 1 00:06:43.266 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:43.266 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:43.266 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:43.266 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:43.266 #define SPDK_CONFIG_SHARED 1 00:06:43.266 #undef SPDK_CONFIG_SMA 00:06:43.266 #define SPDK_CONFIG_TESTS 1 00:06:43.266 #undef SPDK_CONFIG_TSAN 00:06:43.266 #define SPDK_CONFIG_UBLK 1 00:06:43.266 #define SPDK_CONFIG_UBSAN 1 00:06:43.266 #undef SPDK_CONFIG_UNIT_TESTS 00:06:43.266 #undef SPDK_CONFIG_URING 00:06:43.266 #define SPDK_CONFIG_URING_PATH 00:06:43.266 #undef SPDK_CONFIG_URING_ZNS 00:06:43.266 #undef SPDK_CONFIG_USDT 00:06:43.266 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:43.266 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:43.266 #undef SPDK_CONFIG_VFIO_USER 00:06:43.266 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:43.266 #define SPDK_CONFIG_VHOST 1 00:06:43.266 #define SPDK_CONFIG_VIRTIO 1 00:06:43.266 #undef SPDK_CONFIG_VTUNE 00:06:43.266 #define SPDK_CONFIG_VTUNE_DIR 00:06:43.266 #define SPDK_CONFIG_WERROR 1 00:06:43.266 #define SPDK_CONFIG_WPDK_DIR 00:06:43.266 #undef SPDK_CONFIG_XNVME 00:06:43.266 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:43.266 19:05:01 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:43.266 19:05:01 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.266 19:05:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.266 19:05:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.266 19:05:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.266 19:05:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.266 19:05:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.266 19:05:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.266 19:05:01 -- paths/export.sh@5 -- # export PATH 00:06:43.266 19:05:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.266 19:05:01 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.266 19:05:01 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:43.266 19:05:01 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:43.266 19:05:01 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:43.266 19:05:01 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:43.266 19:05:01 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:43.266 19:05:01 -- pm/common@16 -- # TEST_TAG=N/A 00:06:43.266 19:05:01 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:43.266 19:05:01 -- common/autotest_common.sh@52 -- # : 1 00:06:43.266 19:05:01 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:43.266 19:05:01 -- common/autotest_common.sh@56 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:43.266 19:05:01 -- common/autotest_common.sh@58 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:43.266 19:05:01 -- common/autotest_common.sh@60 -- # : 1 00:06:43.266 19:05:01 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:43.266 19:05:01 -- common/autotest_common.sh@62 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:43.266 19:05:01 -- common/autotest_common.sh@64 -- # : 00:06:43.266 19:05:01 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:43.266 19:05:01 -- common/autotest_common.sh@66 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:43.266 19:05:01 -- common/autotest_common.sh@68 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:43.266 19:05:01 -- common/autotest_common.sh@70 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:43.266 19:05:01 -- common/autotest_common.sh@72 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:43.266 19:05:01 -- common/autotest_common.sh@74 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:43.266 19:05:01 -- common/autotest_common.sh@76 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:43.266 19:05:01 -- common/autotest_common.sh@78 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:43.266 19:05:01 -- common/autotest_common.sh@80 -- # : 1 00:06:43.266 19:05:01 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:43.266 19:05:01 -- common/autotest_common.sh@82 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:43.266 19:05:01 -- common/autotest_common.sh@84 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:43.266 19:05:01 -- common/autotest_common.sh@86 -- # : 1 00:06:43.266 19:05:01 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:43.266 19:05:01 -- common/autotest_common.sh@88 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:43.266 19:05:01 -- common/autotest_common.sh@90 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:43.266 19:05:01 -- common/autotest_common.sh@92 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:43.266 19:05:01 -- common/autotest_common.sh@94 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:43.266 19:05:01 -- common/autotest_common.sh@96 -- # : tcp 00:06:43.266 19:05:01 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:43.266 19:05:01 -- common/autotest_common.sh@98 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:43.266 19:05:01 -- common/autotest_common.sh@100 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:43.266 19:05:01 -- common/autotest_common.sh@102 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:43.266 19:05:01 -- common/autotest_common.sh@104 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:43.266 19:05:01 -- common/autotest_common.sh@106 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:43.266 19:05:01 -- common/autotest_common.sh@108 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:43.266 19:05:01 -- common/autotest_common.sh@110 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:43.266 19:05:01 -- common/autotest_common.sh@112 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:43.266 19:05:01 -- common/autotest_common.sh@114 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:43.266 19:05:01 -- common/autotest_common.sh@116 -- # : 1 00:06:43.266 19:05:01 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:43.266 19:05:01 -- common/autotest_common.sh@118 -- # : 00:06:43.266 19:05:01 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:43.266 19:05:01 -- common/autotest_common.sh@120 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:43.266 19:05:01 -- common/autotest_common.sh@122 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:43.266 19:05:01 -- common/autotest_common.sh@124 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:43.266 19:05:01 -- common/autotest_common.sh@126 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:43.266 19:05:01 -- common/autotest_common.sh@128 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:43.266 19:05:01 -- common/autotest_common.sh@130 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:43.266 19:05:01 -- common/autotest_common.sh@132 -- # : 00:06:43.266 19:05:01 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:43.266 19:05:01 -- common/autotest_common.sh@134 -- # : true 00:06:43.266 19:05:01 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:43.266 19:05:01 -- common/autotest_common.sh@136 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:43.266 19:05:01 -- common/autotest_common.sh@138 -- # : 0 00:06:43.266 19:05:01 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:43.267 19:05:01 -- common/autotest_common.sh@140 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:43.267 19:05:01 -- common/autotest_common.sh@142 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:43.267 19:05:01 -- common/autotest_common.sh@144 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:43.267 19:05:01 -- common/autotest_common.sh@146 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:43.267 19:05:01 -- common/autotest_common.sh@148 -- # : e810 00:06:43.267 19:05:01 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:43.267 19:05:01 -- common/autotest_common.sh@150 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:43.267 19:05:01 -- common/autotest_common.sh@152 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:43.267 19:05:01 -- common/autotest_common.sh@154 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:43.267 19:05:01 -- common/autotest_common.sh@156 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:43.267 19:05:01 -- common/autotest_common.sh@158 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:43.267 19:05:01 -- common/autotest_common.sh@160 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:43.267 19:05:01 -- common/autotest_common.sh@163 -- # : 00:06:43.267 19:05:01 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:43.267 19:05:01 -- common/autotest_common.sh@165 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:43.267 19:05:01 -- common/autotest_common.sh@167 -- # : 0 00:06:43.267 19:05:01 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:43.267 19:05:01 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:43.267 19:05:01 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.267 19:05:01 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:43.267 19:05:01 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.267 19:05:01 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:43.267 19:05:01 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:43.267 19:05:01 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:43.267 19:05:01 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.267 19:05:01 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:43.267 19:05:01 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.267 19:05:01 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:43.267 19:05:01 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:43.267 19:05:01 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:43.267 19:05:01 -- common/autotest_common.sh@196 -- # cat 00:06:43.267 19:05:01 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:43.267 19:05:01 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.267 19:05:01 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:43.267 19:05:01 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.267 19:05:01 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:43.267 19:05:01 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:43.267 19:05:01 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:43.267 19:05:01 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.267 19:05:01 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:43.267 19:05:01 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.267 19:05:01 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:43.267 19:05:01 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.267 19:05:01 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:43.267 19:05:01 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.267 19:05:01 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:43.267 19:05:01 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.267 19:05:01 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:43.267 19:05:01 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.267 19:05:01 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:43.267 19:05:01 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:43.267 19:05:01 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:43.267 19:05:01 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:43.267 19:05:01 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:43.267 19:05:01 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:43.267 19:05:01 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:43.267 19:05:01 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:43.267 19:05:01 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:43.267 19:05:01 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:43.267 19:05:01 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:43.267 19:05:01 -- common/autotest_common.sh@259 -- # valgrind= 00:06:43.267 19:05:01 -- common/autotest_common.sh@265 -- # uname -s 00:06:43.267 19:05:01 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:43.267 19:05:01 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:43.267 19:05:01 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:43.267 19:05:01 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:43.267 19:05:01 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:43.267 19:05:01 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:43.267 19:05:01 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:43.267 19:05:01 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:43.267 19:05:01 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:43.267 19:05:01 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:43.267 19:05:01 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:43.267 19:05:01 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:43.267 19:05:01 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:43.267 19:05:01 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:43.267 19:05:01 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:43.267 19:05:01 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:43.267 19:05:01 -- common/autotest_common.sh@319 -- # [[ -z 3339854 ]] 00:06:43.267 19:05:01 -- common/autotest_common.sh@319 -- # kill -0 3339854 00:06:43.267 19:05:01 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:43.267 19:05:01 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:43.267 19:05:01 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:43.267 19:05:01 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:43.267 19:05:01 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:43.267 19:05:01 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:43.267 19:05:01 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:43.267 19:05:01 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:43.268 19:05:01 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.Y7eZTM 00:06:43.268 19:05:01 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:43.268 19:05:01 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.Y7eZTM/tests/target /tmp/spdk.Y7eZTM 00:06:43.268 19:05:01 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@328 -- # df -T 00:06:43.268 19:05:01 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=55336529920 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=6651990016 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991667200 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993833984 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=425984 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:43.268 19:05:01 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:43.268 19:05:01 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:43.268 19:05:01 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:43.268 19:05:01 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:43.268 * Looking for test storage... 00:06:43.268 19:05:01 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:43.268 19:05:01 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:43.268 19:05:01 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.268 19:05:01 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:43.268 19:05:01 -- common/autotest_common.sh@373 -- # mount=/ 00:06:43.268 19:05:01 -- common/autotest_common.sh@375 -- # target_space=55336529920 00:06:43.268 19:05:01 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:43.268 19:05:01 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:43.268 19:05:01 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@382 -- # new_size=8866582528 00:06:43.268 19:05:01 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:43.268 19:05:01 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.268 19:05:01 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.268 19:05:01 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.268 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:43.268 19:05:01 -- common/autotest_common.sh@390 -- # return 0 00:06:43.268 19:05:01 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:43.268 19:05:01 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:43.268 19:05:01 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:43.268 19:05:01 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:43.268 19:05:01 -- common/autotest_common.sh@1682 -- # true 00:06:43.268 19:05:01 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:43.268 19:05:01 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@27 -- # exec 00:06:43.268 19:05:01 -- common/autotest_common.sh@29 -- # exec 00:06:43.268 19:05:01 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:43.268 19:05:01 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:43.268 19:05:01 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:43.268 19:05:01 -- common/autotest_common.sh@18 -- # set -x 00:06:43.268 19:05:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:43.268 19:05:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:43.268 19:05:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:43.527 19:05:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:43.527 19:05:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:43.527 19:05:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:43.527 19:05:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:43.527 19:05:01 -- scripts/common.sh@335 -- # IFS=.-: 00:06:43.527 19:05:01 -- scripts/common.sh@335 -- # read -ra ver1 00:06:43.527 19:05:01 -- scripts/common.sh@336 -- # IFS=.-: 00:06:43.527 19:05:01 -- scripts/common.sh@336 -- # read -ra ver2 00:06:43.527 19:05:01 -- scripts/common.sh@337 -- # local 'op=<' 00:06:43.527 19:05:01 -- scripts/common.sh@339 -- # ver1_l=2 00:06:43.527 19:05:01 -- scripts/common.sh@340 -- # ver2_l=1 00:06:43.527 19:05:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:43.527 19:05:01 -- scripts/common.sh@343 -- # case "$op" in 00:06:43.527 19:05:01 -- scripts/common.sh@344 -- # : 1 00:06:43.527 19:05:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:43.527 19:05:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:43.527 19:05:01 -- scripts/common.sh@364 -- # decimal 1 00:06:43.527 19:05:01 -- scripts/common.sh@352 -- # local d=1 00:06:43.527 19:05:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:43.527 19:05:01 -- scripts/common.sh@354 -- # echo 1 00:06:43.527 19:05:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:43.527 19:05:01 -- scripts/common.sh@365 -- # decimal 2 00:06:43.527 19:05:01 -- scripts/common.sh@352 -- # local d=2 00:06:43.527 19:05:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:43.527 19:05:01 -- scripts/common.sh@354 -- # echo 2 00:06:43.527 19:05:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:43.527 19:05:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:43.527 19:05:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:43.528 19:05:01 -- scripts/common.sh@367 -- # return 0 00:06:43.528 19:05:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:43.528 19:05:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:43.528 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.528 --rc genhtml_branch_coverage=1 00:06:43.528 --rc genhtml_function_coverage=1 00:06:43.528 --rc genhtml_legend=1 00:06:43.528 --rc geninfo_all_blocks=1 00:06:43.528 --rc geninfo_unexecuted_blocks=1 00:06:43.528 00:06:43.528 ' 00:06:43.528 19:05:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:43.528 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.528 --rc genhtml_branch_coverage=1 00:06:43.528 --rc genhtml_function_coverage=1 00:06:43.528 --rc genhtml_legend=1 00:06:43.528 --rc geninfo_all_blocks=1 00:06:43.528 --rc geninfo_unexecuted_blocks=1 00:06:43.528 00:06:43.528 ' 00:06:43.528 19:05:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:43.528 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.528 --rc genhtml_branch_coverage=1 00:06:43.528 --rc genhtml_function_coverage=1 00:06:43.528 --rc genhtml_legend=1 00:06:43.528 --rc geninfo_all_blocks=1 00:06:43.528 --rc geninfo_unexecuted_blocks=1 00:06:43.528 00:06:43.528 ' 00:06:43.528 19:05:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:43.528 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:43.528 --rc genhtml_branch_coverage=1 00:06:43.528 --rc genhtml_function_coverage=1 00:06:43.528 --rc genhtml_legend=1 00:06:43.528 --rc geninfo_all_blocks=1 00:06:43.528 --rc geninfo_unexecuted_blocks=1 00:06:43.528 00:06:43.528 ' 00:06:43.528 19:05:01 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:43.528 19:05:01 -- nvmf/common.sh@7 -- # uname -s 00:06:43.528 19:05:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:43.528 19:05:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:43.528 19:05:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:43.528 19:05:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:43.528 19:05:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:43.528 19:05:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:43.528 19:05:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:43.528 19:05:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:43.528 19:05:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:43.528 19:05:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:43.528 19:05:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.528 19:05:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:43.528 19:05:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:43.528 19:05:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:43.528 19:05:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:43.528 19:05:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:43.528 19:05:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:43.528 19:05:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:43.528 19:05:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:43.528 19:05:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.528 19:05:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.528 19:05:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.528 19:05:01 -- paths/export.sh@5 -- # export PATH 00:06:43.528 19:05:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:43.528 19:05:01 -- nvmf/common.sh@46 -- # : 0 00:06:43.528 19:05:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:43.528 19:05:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:43.528 19:05:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:43.528 19:05:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:43.528 19:05:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:43.528 19:05:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:43.528 19:05:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:43.528 19:05:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:43.528 19:05:01 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:43.528 19:05:01 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:43.528 19:05:01 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:43.528 19:05:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:43.528 19:05:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:43.528 19:05:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:43.528 19:05:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:43.528 19:05:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:43.528 19:05:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:43.528 19:05:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:43.528 19:05:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.528 19:05:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:43.528 19:05:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:43.528 19:05:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:43.528 19:05:01 -- common/autotest_common.sh@10 -- # set +x 00:06:45.428 19:05:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:45.428 19:05:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:45.428 19:05:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:45.428 19:05:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:45.428 19:05:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:45.428 19:05:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:45.428 19:05:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:45.428 19:05:03 -- nvmf/common.sh@294 -- # net_devs=() 00:06:45.428 19:05:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:45.428 19:05:03 -- nvmf/common.sh@295 -- # e810=() 00:06:45.428 19:05:03 -- nvmf/common.sh@295 -- # local -ga e810 00:06:45.428 19:05:03 -- nvmf/common.sh@296 -- # x722=() 00:06:45.428 19:05:03 -- nvmf/common.sh@296 -- # local -ga x722 00:06:45.428 19:05:03 -- nvmf/common.sh@297 -- # mlx=() 00:06:45.428 19:05:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:45.428 19:05:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:45.428 19:05:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:45.428 19:05:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:45.428 19:05:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:45.428 19:05:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.428 19:05:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:45.428 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:45.428 19:05:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.428 19:05:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:45.428 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:45.428 19:05:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:45.428 19:05:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.428 19:05:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.428 19:05:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.428 19:05:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.428 19:05:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:45.428 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:45.428 19:05:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.428 19:05:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.428 19:05:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.428 19:05:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.428 19:05:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.428 19:05:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:45.428 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:45.428 19:05:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.428 19:05:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:45.428 19:05:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:45.428 19:05:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:45.428 19:05:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:45.429 19:05:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:45.429 19:05:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:45.429 19:05:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:45.429 19:05:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:45.429 19:05:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:45.429 19:05:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:45.429 19:05:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:45.429 19:05:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:45.429 19:05:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:45.429 19:05:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:45.429 19:05:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:45.429 19:05:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:45.429 19:05:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:45.429 19:05:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:45.429 19:05:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:45.429 19:05:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:45.429 19:05:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:45.429 19:05:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:45.429 19:05:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:45.429 19:05:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:45.429 19:05:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:45.429 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:45.429 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:06:45.429 00:06:45.429 --- 10.0.0.2 ping statistics --- 00:06:45.429 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.429 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:06:45.429 19:05:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:45.429 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:45.429 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:06:45.429 00:06:45.429 --- 10.0.0.1 ping statistics --- 00:06:45.429 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.429 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:06:45.429 19:05:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:45.429 19:05:03 -- nvmf/common.sh@410 -- # return 0 00:06:45.429 19:05:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:45.429 19:05:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:45.429 19:05:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:45.429 19:05:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:45.429 19:05:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:45.429 19:05:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:45.429 19:05:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:45.429 19:05:04 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:45.429 19:05:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:45.429 19:05:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.429 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:06:45.429 ************************************ 00:06:45.429 START TEST nvmf_filesystem_no_in_capsule 00:06:45.429 ************************************ 00:06:45.429 19:05:04 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:45.429 19:05:04 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:45.429 19:05:04 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:45.429 19:05:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:45.429 19:05:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:45.429 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:06:45.429 19:05:04 -- nvmf/common.sh@469 -- # nvmfpid=3341504 00:06:45.429 19:05:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:45.429 19:05:04 -- nvmf/common.sh@470 -- # waitforlisten 3341504 00:06:45.429 19:05:04 -- common/autotest_common.sh@829 -- # '[' -z 3341504 ']' 00:06:45.429 19:05:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.429 19:05:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.429 19:05:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.429 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.429 19:05:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.429 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:06:45.687 [2024-11-18 19:05:04.067773] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.687 [2024-11-18 19:05:04.067853] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:45.687 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.687 [2024-11-18 19:05:04.137079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:45.687 [2024-11-18 19:05:04.257588] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.687 [2024-11-18 19:05:04.257753] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:45.687 [2024-11-18 19:05:04.257773] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:45.687 [2024-11-18 19:05:04.257788] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:45.687 [2024-11-18 19:05:04.257845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.687 [2024-11-18 19:05:04.257906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:45.687 [2024-11-18 19:05:04.257959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:45.687 [2024-11-18 19:05:04.257962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.683 19:05:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.684 19:05:05 -- common/autotest_common.sh@862 -- # return 0 00:06:46.684 19:05:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:46.684 19:05:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 19:05:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:46.684 19:05:05 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:46.684 19:05:05 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:46.684 19:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 [2024-11-18 19:05:05.063272] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:46.684 19:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.684 19:05:05 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:46.684 19:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 Malloc1 00:06:46.684 19:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.684 19:05:05 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:46.684 19:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 19:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.684 19:05:05 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:46.684 19:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 19:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.684 19:05:05 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:46.684 19:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 [2024-11-18 19:05:05.252115] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:46.684 19:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.684 19:05:05 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:46.684 19:05:05 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:46.684 19:05:05 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:46.684 19:05:05 -- common/autotest_common.sh@1369 -- # local bs 00:06:46.684 19:05:05 -- common/autotest_common.sh@1370 -- # local nb 00:06:46.684 19:05:05 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:46.684 19:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.684 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:06:46.684 19:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.684 19:05:05 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:46.684 { 00:06:46.684 "name": "Malloc1", 00:06:46.684 "aliases": [ 00:06:46.684 "361cd9cd-e5a4-406b-aeb6-d080c8b2297b" 00:06:46.684 ], 00:06:46.684 "product_name": "Malloc disk", 00:06:46.684 "block_size": 512, 00:06:46.684 "num_blocks": 1048576, 00:06:46.684 "uuid": "361cd9cd-e5a4-406b-aeb6-d080c8b2297b", 00:06:46.684 "assigned_rate_limits": { 00:06:46.684 "rw_ios_per_sec": 0, 00:06:46.684 "rw_mbytes_per_sec": 0, 00:06:46.684 "r_mbytes_per_sec": 0, 00:06:46.684 "w_mbytes_per_sec": 0 00:06:46.684 }, 00:06:46.684 "claimed": true, 00:06:46.684 "claim_type": "exclusive_write", 00:06:46.684 "zoned": false, 00:06:46.684 "supported_io_types": { 00:06:46.684 "read": true, 00:06:46.684 "write": true, 00:06:46.684 "unmap": true, 00:06:46.684 "write_zeroes": true, 00:06:46.684 "flush": true, 00:06:46.684 "reset": true, 00:06:46.684 "compare": false, 00:06:46.684 "compare_and_write": false, 00:06:46.684 "abort": true, 00:06:46.684 "nvme_admin": false, 00:06:46.684 "nvme_io": false 00:06:46.684 }, 00:06:46.684 "memory_domains": [ 00:06:46.684 { 00:06:46.684 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:46.684 "dma_device_type": 2 00:06:46.684 } 00:06:46.684 ], 00:06:46.684 "driver_specific": {} 00:06:46.684 } 00:06:46.684 ]' 00:06:46.684 19:05:05 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:46.941 19:05:05 -- common/autotest_common.sh@1372 -- # bs=512 00:06:46.941 19:05:05 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:46.941 19:05:05 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:46.941 19:05:05 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:46.941 19:05:05 -- common/autotest_common.sh@1377 -- # echo 512 00:06:46.941 19:05:05 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:46.941 19:05:05 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:47.506 19:05:06 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:47.506 19:05:06 -- common/autotest_common.sh@1187 -- # local i=0 00:06:47.506 19:05:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:47.506 19:05:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:47.506 19:05:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:50.032 19:05:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:50.032 19:05:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:50.032 19:05:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:50.032 19:05:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:50.032 19:05:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:50.032 19:05:08 -- common/autotest_common.sh@1197 -- # return 0 00:06:50.032 19:05:08 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:50.032 19:05:08 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:50.032 19:05:08 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:50.032 19:05:08 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:50.032 19:05:08 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:50.032 19:05:08 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:50.032 19:05:08 -- setup/common.sh@80 -- # echo 536870912 00:06:50.032 19:05:08 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:50.032 19:05:08 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:50.032 19:05:08 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:50.032 19:05:08 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:50.032 19:05:08 -- target/filesystem.sh@69 -- # partprobe 00:06:50.964 19:05:09 -- target/filesystem.sh@70 -- # sleep 1 00:06:51.896 19:05:10 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:51.896 19:05:10 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:51.896 19:05:10 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:51.896 19:05:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.896 19:05:10 -- common/autotest_common.sh@10 -- # set +x 00:06:51.896 ************************************ 00:06:51.896 START TEST filesystem_ext4 00:06:51.896 ************************************ 00:06:51.896 19:05:10 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:51.896 19:05:10 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:51.896 19:05:10 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:51.896 19:05:10 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:51.896 19:05:10 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:51.896 19:05:10 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:51.896 19:05:10 -- common/autotest_common.sh@914 -- # local i=0 00:06:51.896 19:05:10 -- common/autotest_common.sh@915 -- # local force 00:06:51.896 19:05:10 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:51.896 19:05:10 -- common/autotest_common.sh@918 -- # force=-F 00:06:51.896 19:05:10 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:51.896 mke2fs 1.47.0 (5-Feb-2023) 00:06:51.896 Discarding device blocks: 0/522240 done 00:06:51.896 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:51.896 Filesystem UUID: 393f0580-485d-4805-ba46-68b8a2bc5afc 00:06:51.896 Superblock backups stored on blocks: 00:06:51.896 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:51.896 00:06:51.896 Allocating group tables: 0/64 done 00:06:51.896 Writing inode tables: 0/64 done 00:06:53.801 Creating journal (8192 blocks): done 00:06:53.801 Writing superblocks and filesystem accounting information: 0/64 done 00:06:53.801 00:06:53.801 19:05:12 -- common/autotest_common.sh@931 -- # return 0 00:06:53.801 19:05:12 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:00.357 19:05:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:00.357 19:05:18 -- target/filesystem.sh@25 -- # sync 00:07:00.357 19:05:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:00.357 19:05:18 -- target/filesystem.sh@27 -- # sync 00:07:00.357 19:05:18 -- target/filesystem.sh@29 -- # i=0 00:07:00.357 19:05:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:00.357 19:05:18 -- target/filesystem.sh@37 -- # kill -0 3341504 00:07:00.357 19:05:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:00.357 19:05:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:00.357 19:05:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:00.357 19:05:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:00.357 00:07:00.357 real 0m8.110s 00:07:00.357 user 0m0.028s 00:07:00.357 sys 0m0.062s 00:07:00.357 19:05:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:00.357 19:05:18 -- common/autotest_common.sh@10 -- # set +x 00:07:00.357 ************************************ 00:07:00.357 END TEST filesystem_ext4 00:07:00.357 ************************************ 00:07:00.357 19:05:18 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:00.357 19:05:18 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:00.357 19:05:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.357 19:05:18 -- common/autotest_common.sh@10 -- # set +x 00:07:00.357 ************************************ 00:07:00.357 START TEST filesystem_btrfs 00:07:00.357 ************************************ 00:07:00.357 19:05:18 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:00.357 19:05:18 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:00.357 19:05:18 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:00.357 19:05:18 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:00.357 19:05:18 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:00.357 19:05:18 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:00.357 19:05:18 -- common/autotest_common.sh@914 -- # local i=0 00:07:00.357 19:05:18 -- common/autotest_common.sh@915 -- # local force 00:07:00.357 19:05:18 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:00.357 19:05:18 -- common/autotest_common.sh@920 -- # force=-f 00:07:00.357 19:05:18 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:00.357 btrfs-progs v6.8.1 00:07:00.357 See https://btrfs.readthedocs.io for more information. 00:07:00.357 00:07:00.357 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:00.357 NOTE: several default settings have changed in version 5.15, please make sure 00:07:00.357 this does not affect your deployments: 00:07:00.357 - DUP for metadata (-m dup) 00:07:00.357 - enabled no-holes (-O no-holes) 00:07:00.357 - enabled free-space-tree (-R free-space-tree) 00:07:00.357 00:07:00.357 Label: (null) 00:07:00.357 UUID: 0582f849-4bec-4f2f-b1c1-20b38282fdd1 00:07:00.357 Node size: 16384 00:07:00.357 Sector size: 4096 (CPU page size: 4096) 00:07:00.357 Filesystem size: 510.00MiB 00:07:00.357 Block group profiles: 00:07:00.357 Data: single 8.00MiB 00:07:00.357 Metadata: DUP 32.00MiB 00:07:00.357 System: DUP 8.00MiB 00:07:00.357 SSD detected: yes 00:07:00.357 Zoned device: no 00:07:00.357 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:00.357 Checksum: crc32c 00:07:00.357 Number of devices: 1 00:07:00.357 Devices: 00:07:00.357 ID SIZE PATH 00:07:00.357 1 510.00MiB /dev/nvme0n1p1 00:07:00.357 00:07:00.357 19:05:18 -- common/autotest_common.sh@931 -- # return 0 00:07:00.357 19:05:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:01.290 19:05:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:01.290 19:05:19 -- target/filesystem.sh@25 -- # sync 00:07:01.290 19:05:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:01.290 19:05:19 -- target/filesystem.sh@27 -- # sync 00:07:01.290 19:05:19 -- target/filesystem.sh@29 -- # i=0 00:07:01.290 19:05:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:01.290 19:05:19 -- target/filesystem.sh@37 -- # kill -0 3341504 00:07:01.290 19:05:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:01.290 19:05:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:01.290 19:05:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:01.290 19:05:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:01.290 00:07:01.290 real 0m1.294s 00:07:01.290 user 0m0.017s 00:07:01.290 sys 0m0.107s 00:07:01.290 19:05:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.290 19:05:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.290 ************************************ 00:07:01.290 END TEST filesystem_btrfs 00:07:01.290 ************************************ 00:07:01.290 19:05:19 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:01.290 19:05:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:01.290 19:05:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.290 19:05:19 -- common/autotest_common.sh@10 -- # set +x 00:07:01.290 ************************************ 00:07:01.290 START TEST filesystem_xfs 00:07:01.290 ************************************ 00:07:01.290 19:05:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:01.290 19:05:19 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:01.290 19:05:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:01.290 19:05:19 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:01.290 19:05:19 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:01.290 19:05:19 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:01.290 19:05:19 -- common/autotest_common.sh@914 -- # local i=0 00:07:01.290 19:05:19 -- common/autotest_common.sh@915 -- # local force 00:07:01.290 19:05:19 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:01.290 19:05:19 -- common/autotest_common.sh@920 -- # force=-f 00:07:01.290 19:05:19 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:01.290 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:01.290 = sectsz=512 attr=2, projid32bit=1 00:07:01.290 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:01.290 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:01.290 data = bsize=4096 blocks=130560, imaxpct=25 00:07:01.290 = sunit=0 swidth=0 blks 00:07:01.290 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:01.290 log =internal log bsize=4096 blocks=16384, version=2 00:07:01.290 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:01.290 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:02.663 Discarding blocks...Done. 00:07:02.663 19:05:20 -- common/autotest_common.sh@931 -- # return 0 00:07:02.663 19:05:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.561 19:05:23 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.561 19:05:23 -- target/filesystem.sh@25 -- # sync 00:07:04.561 19:05:23 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.561 19:05:23 -- target/filesystem.sh@27 -- # sync 00:07:04.561 19:05:23 -- target/filesystem.sh@29 -- # i=0 00:07:04.561 19:05:23 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.561 19:05:23 -- target/filesystem.sh@37 -- # kill -0 3341504 00:07:04.561 19:05:23 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.561 19:05:23 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.561 19:05:23 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.561 19:05:23 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.561 00:07:04.561 real 0m3.367s 00:07:04.561 user 0m0.015s 00:07:04.561 sys 0m0.065s 00:07:04.561 19:05:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.561 19:05:23 -- common/autotest_common.sh@10 -- # set +x 00:07:04.561 ************************************ 00:07:04.561 END TEST filesystem_xfs 00:07:04.561 ************************************ 00:07:04.561 19:05:23 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:04.561 19:05:23 -- target/filesystem.sh@93 -- # sync 00:07:04.561 19:05:23 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:04.820 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:04.820 19:05:23 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:04.820 19:05:23 -- common/autotest_common.sh@1208 -- # local i=0 00:07:04.820 19:05:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:04.820 19:05:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:04.820 19:05:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:04.820 19:05:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:04.820 19:05:23 -- common/autotest_common.sh@1220 -- # return 0 00:07:04.820 19:05:23 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:04.820 19:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:04.820 19:05:23 -- common/autotest_common.sh@10 -- # set +x 00:07:04.820 19:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:04.820 19:05:23 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:04.820 19:05:23 -- target/filesystem.sh@101 -- # killprocess 3341504 00:07:04.820 19:05:23 -- common/autotest_common.sh@936 -- # '[' -z 3341504 ']' 00:07:04.820 19:05:23 -- common/autotest_common.sh@940 -- # kill -0 3341504 00:07:04.820 19:05:23 -- common/autotest_common.sh@941 -- # uname 00:07:04.820 19:05:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:04.820 19:05:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3341504 00:07:04.820 19:05:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:04.820 19:05:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:04.820 19:05:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3341504' 00:07:04.820 killing process with pid 3341504 00:07:04.820 19:05:23 -- common/autotest_common.sh@955 -- # kill 3341504 00:07:04.820 19:05:23 -- common/autotest_common.sh@960 -- # wait 3341504 00:07:05.388 19:05:23 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:05.388 00:07:05.388 real 0m19.838s 00:07:05.388 user 1m16.815s 00:07:05.388 sys 0m2.318s 00:07:05.388 19:05:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.388 19:05:23 -- common/autotest_common.sh@10 -- # set +x 00:07:05.388 ************************************ 00:07:05.388 END TEST nvmf_filesystem_no_in_capsule 00:07:05.388 ************************************ 00:07:05.388 19:05:23 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:05.388 19:05:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:05.388 19:05:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.388 19:05:23 -- common/autotest_common.sh@10 -- # set +x 00:07:05.388 ************************************ 00:07:05.388 START TEST nvmf_filesystem_in_capsule 00:07:05.388 ************************************ 00:07:05.388 19:05:23 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:05.388 19:05:23 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:05.388 19:05:23 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:05.388 19:05:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:05.388 19:05:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:05.388 19:05:23 -- common/autotest_common.sh@10 -- # set +x 00:07:05.388 19:05:23 -- nvmf/common.sh@469 -- # nvmfpid=3344083 00:07:05.388 19:05:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:05.388 19:05:23 -- nvmf/common.sh@470 -- # waitforlisten 3344083 00:07:05.388 19:05:23 -- common/autotest_common.sh@829 -- # '[' -z 3344083 ']' 00:07:05.388 19:05:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.388 19:05:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:05.388 19:05:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.388 19:05:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:05.388 19:05:23 -- common/autotest_common.sh@10 -- # set +x 00:07:05.388 [2024-11-18 19:05:23.933990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.388 [2024-11-18 19:05:23.934069] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:05.388 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.646 [2024-11-18 19:05:24.003415] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:05.646 [2024-11-18 19:05:24.122180] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.646 [2024-11-18 19:05:24.122344] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:05.646 [2024-11-18 19:05:24.122362] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:05.646 [2024-11-18 19:05:24.122375] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:05.646 [2024-11-18 19:05:24.123632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.646 [2024-11-18 19:05:24.123685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.646 [2024-11-18 19:05:24.123773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:05.646 [2024-11-18 19:05:24.123777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.579 19:05:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.579 19:05:24 -- common/autotest_common.sh@862 -- # return 0 00:07:06.579 19:05:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:06.579 19:05:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:06.579 19:05:24 -- common/autotest_common.sh@10 -- # set +x 00:07:06.579 19:05:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:06.579 19:05:25 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:06.579 19:05:25 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:06.579 19:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.579 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:07:06.579 [2024-11-18 19:05:25.012465] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:06.579 19:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.579 19:05:25 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:06.579 19:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.579 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:07:06.579 Malloc1 00:07:06.579 19:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.579 19:05:25 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:06.579 19:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.579 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:07:06.579 19:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.579 19:05:25 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:06.579 19:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.579 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:07:06.837 19:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.837 19:05:25 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:06.837 19:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.837 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:07:06.837 [2024-11-18 19:05:25.189029] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:06.837 19:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.837 19:05:25 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:06.837 19:05:25 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:06.837 19:05:25 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:06.837 19:05:25 -- common/autotest_common.sh@1369 -- # local bs 00:07:06.837 19:05:25 -- common/autotest_common.sh@1370 -- # local nb 00:07:06.837 19:05:25 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:06.837 19:05:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.837 19:05:25 -- common/autotest_common.sh@10 -- # set +x 00:07:06.837 19:05:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.837 19:05:25 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:06.837 { 00:07:06.837 "name": "Malloc1", 00:07:06.837 "aliases": [ 00:07:06.837 "0ac3dda4-4309-4cc0-bf07-a786ffc58f0b" 00:07:06.837 ], 00:07:06.837 "product_name": "Malloc disk", 00:07:06.837 "block_size": 512, 00:07:06.837 "num_blocks": 1048576, 00:07:06.837 "uuid": "0ac3dda4-4309-4cc0-bf07-a786ffc58f0b", 00:07:06.837 "assigned_rate_limits": { 00:07:06.837 "rw_ios_per_sec": 0, 00:07:06.837 "rw_mbytes_per_sec": 0, 00:07:06.837 "r_mbytes_per_sec": 0, 00:07:06.837 "w_mbytes_per_sec": 0 00:07:06.837 }, 00:07:06.837 "claimed": true, 00:07:06.837 "claim_type": "exclusive_write", 00:07:06.837 "zoned": false, 00:07:06.837 "supported_io_types": { 00:07:06.837 "read": true, 00:07:06.837 "write": true, 00:07:06.837 "unmap": true, 00:07:06.837 "write_zeroes": true, 00:07:06.837 "flush": true, 00:07:06.837 "reset": true, 00:07:06.837 "compare": false, 00:07:06.837 "compare_and_write": false, 00:07:06.837 "abort": true, 00:07:06.837 "nvme_admin": false, 00:07:06.837 "nvme_io": false 00:07:06.837 }, 00:07:06.837 "memory_domains": [ 00:07:06.837 { 00:07:06.838 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:06.838 "dma_device_type": 2 00:07:06.838 } 00:07:06.838 ], 00:07:06.838 "driver_specific": {} 00:07:06.838 } 00:07:06.838 ]' 00:07:06.838 19:05:25 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:06.838 19:05:25 -- common/autotest_common.sh@1372 -- # bs=512 00:07:06.838 19:05:25 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:06.838 19:05:25 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:06.838 19:05:25 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:06.838 19:05:25 -- common/autotest_common.sh@1377 -- # echo 512 00:07:06.838 19:05:25 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:06.838 19:05:25 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:07.403 19:05:25 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:07.403 19:05:25 -- common/autotest_common.sh@1187 -- # local i=0 00:07:07.403 19:05:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:07.403 19:05:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:07.403 19:05:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:09.301 19:05:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:09.301 19:05:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:09.301 19:05:27 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:09.301 19:05:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:09.301 19:05:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:09.301 19:05:27 -- common/autotest_common.sh@1197 -- # return 0 00:07:09.301 19:05:27 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:09.301 19:05:27 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:09.559 19:05:27 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:09.559 19:05:27 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:09.559 19:05:27 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:09.559 19:05:27 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:09.559 19:05:27 -- setup/common.sh@80 -- # echo 536870912 00:07:09.559 19:05:27 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:09.559 19:05:27 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:09.559 19:05:27 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:09.559 19:05:27 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:09.559 19:05:27 -- target/filesystem.sh@69 -- # partprobe 00:07:10.124 19:05:28 -- target/filesystem.sh@70 -- # sleep 1 00:07:11.057 19:05:29 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:11.057 19:05:29 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:11.057 19:05:29 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:11.057 19:05:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.057 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:07:11.057 ************************************ 00:07:11.057 START TEST filesystem_in_capsule_ext4 00:07:11.057 ************************************ 00:07:11.057 19:05:29 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:11.057 19:05:29 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:11.057 19:05:29 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:11.057 19:05:29 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:11.057 19:05:29 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:11.057 19:05:29 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:11.057 19:05:29 -- common/autotest_common.sh@914 -- # local i=0 00:07:11.057 19:05:29 -- common/autotest_common.sh@915 -- # local force 00:07:11.057 19:05:29 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:11.057 19:05:29 -- common/autotest_common.sh@918 -- # force=-F 00:07:11.057 19:05:29 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:11.057 mke2fs 1.47.0 (5-Feb-2023) 00:07:11.314 Discarding device blocks: 0/522240 done 00:07:11.314 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:11.314 Filesystem UUID: 27b21ae3-983e-410e-88f3-e8f5e7c05816 00:07:11.314 Superblock backups stored on blocks: 00:07:11.314 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:11.314 00:07:11.314 Allocating group tables: 0/64 done 00:07:11.314 Writing inode tables: 0/64 done 00:07:11.314 Creating journal (8192 blocks): done 00:07:11.314 Writing superblocks and filesystem accounting information: 0/64 done 00:07:11.314 00:07:11.314 19:05:29 -- common/autotest_common.sh@931 -- # return 0 00:07:11.314 19:05:29 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:17.868 19:05:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:17.868 19:05:35 -- target/filesystem.sh@25 -- # sync 00:07:17.868 19:05:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:17.868 19:05:35 -- target/filesystem.sh@27 -- # sync 00:07:17.868 19:05:35 -- target/filesystem.sh@29 -- # i=0 00:07:17.868 19:05:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:17.868 19:05:35 -- target/filesystem.sh@37 -- # kill -0 3344083 00:07:17.868 19:05:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:17.868 19:05:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:17.868 19:05:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:17.868 19:05:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:17.868 00:07:17.868 real 0m5.753s 00:07:17.868 user 0m0.009s 00:07:17.868 sys 0m0.063s 00:07:17.868 19:05:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.868 19:05:35 -- common/autotest_common.sh@10 -- # set +x 00:07:17.868 ************************************ 00:07:17.868 END TEST filesystem_in_capsule_ext4 00:07:17.868 ************************************ 00:07:17.868 19:05:35 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:17.868 19:05:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:17.868 19:05:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.868 19:05:35 -- common/autotest_common.sh@10 -- # set +x 00:07:17.868 ************************************ 00:07:17.868 START TEST filesystem_in_capsule_btrfs 00:07:17.868 ************************************ 00:07:17.868 19:05:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:17.868 19:05:35 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:17.868 19:05:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:17.868 19:05:35 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:17.868 19:05:35 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:17.868 19:05:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:17.868 19:05:35 -- common/autotest_common.sh@914 -- # local i=0 00:07:17.868 19:05:35 -- common/autotest_common.sh@915 -- # local force 00:07:17.868 19:05:35 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:17.868 19:05:35 -- common/autotest_common.sh@920 -- # force=-f 00:07:17.868 19:05:35 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:17.868 btrfs-progs v6.8.1 00:07:17.868 See https://btrfs.readthedocs.io for more information. 00:07:17.868 00:07:17.868 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:17.868 NOTE: several default settings have changed in version 5.15, please make sure 00:07:17.868 this does not affect your deployments: 00:07:17.868 - DUP for metadata (-m dup) 00:07:17.868 - enabled no-holes (-O no-holes) 00:07:17.868 - enabled free-space-tree (-R free-space-tree) 00:07:17.868 00:07:17.868 Label: (null) 00:07:17.868 UUID: 7ced2c77-3817-45fc-b6d1-673254f08d68 00:07:17.868 Node size: 16384 00:07:17.868 Sector size: 4096 (CPU page size: 4096) 00:07:17.868 Filesystem size: 510.00MiB 00:07:17.868 Block group profiles: 00:07:17.868 Data: single 8.00MiB 00:07:17.868 Metadata: DUP 32.00MiB 00:07:17.868 System: DUP 8.00MiB 00:07:17.868 SSD detected: yes 00:07:17.868 Zoned device: no 00:07:17.868 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:17.868 Checksum: crc32c 00:07:17.868 Number of devices: 1 00:07:17.868 Devices: 00:07:17.868 ID SIZE PATH 00:07:17.868 1 510.00MiB /dev/nvme0n1p1 00:07:17.868 00:07:17.868 19:05:35 -- common/autotest_common.sh@931 -- # return 0 00:07:17.868 19:05:35 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:17.868 19:05:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:17.868 19:05:35 -- target/filesystem.sh@25 -- # sync 00:07:17.868 19:05:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:17.868 19:05:35 -- target/filesystem.sh@27 -- # sync 00:07:17.868 19:05:35 -- target/filesystem.sh@29 -- # i=0 00:07:17.868 19:05:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:17.868 19:05:35 -- target/filesystem.sh@37 -- # kill -0 3344083 00:07:17.868 19:05:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:17.868 19:05:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:17.868 19:05:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:17.868 19:05:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:17.868 00:07:17.868 real 0m0.487s 00:07:17.868 user 0m0.021s 00:07:17.868 sys 0m0.087s 00:07:17.868 19:05:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.868 19:05:35 -- common/autotest_common.sh@10 -- # set +x 00:07:17.868 ************************************ 00:07:17.868 END TEST filesystem_in_capsule_btrfs 00:07:17.868 ************************************ 00:07:17.868 19:05:35 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:17.868 19:05:35 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:17.868 19:05:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.868 19:05:35 -- common/autotest_common.sh@10 -- # set +x 00:07:17.868 ************************************ 00:07:17.868 START TEST filesystem_in_capsule_xfs 00:07:17.868 ************************************ 00:07:17.868 19:05:35 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:17.868 19:05:35 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:17.868 19:05:35 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:17.868 19:05:35 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:17.868 19:05:35 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:17.868 19:05:35 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:17.868 19:05:35 -- common/autotest_common.sh@914 -- # local i=0 00:07:17.868 19:05:35 -- common/autotest_common.sh@915 -- # local force 00:07:17.868 19:05:35 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:17.868 19:05:35 -- common/autotest_common.sh@920 -- # force=-f 00:07:17.868 19:05:35 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:17.868 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:17.868 = sectsz=512 attr=2, projid32bit=1 00:07:17.868 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:17.868 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:17.868 data = bsize=4096 blocks=130560, imaxpct=25 00:07:17.868 = sunit=0 swidth=0 blks 00:07:17.868 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:17.868 log =internal log bsize=4096 blocks=16384, version=2 00:07:17.868 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:17.868 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:18.434 Discarding blocks...Done. 00:07:18.434 19:05:36 -- common/autotest_common.sh@931 -- # return 0 00:07:18.434 19:05:36 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.330 19:05:38 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.331 19:05:38 -- target/filesystem.sh@25 -- # sync 00:07:20.331 19:05:38 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.331 19:05:38 -- target/filesystem.sh@27 -- # sync 00:07:20.331 19:05:38 -- target/filesystem.sh@29 -- # i=0 00:07:20.331 19:05:38 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.331 19:05:38 -- target/filesystem.sh@37 -- # kill -0 3344083 00:07:20.331 19:05:38 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.331 19:05:38 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.331 19:05:38 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.331 19:05:38 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.331 00:07:20.331 real 0m2.771s 00:07:20.331 user 0m0.018s 00:07:20.331 sys 0m0.059s 00:07:20.331 19:05:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.331 19:05:38 -- common/autotest_common.sh@10 -- # set +x 00:07:20.331 ************************************ 00:07:20.331 END TEST filesystem_in_capsule_xfs 00:07:20.331 ************************************ 00:07:20.331 19:05:38 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:20.331 19:05:38 -- target/filesystem.sh@93 -- # sync 00:07:20.331 19:05:38 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:20.331 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:20.331 19:05:38 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:20.331 19:05:38 -- common/autotest_common.sh@1208 -- # local i=0 00:07:20.331 19:05:38 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:20.331 19:05:38 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:20.331 19:05:38 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:20.331 19:05:38 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:20.331 19:05:38 -- common/autotest_common.sh@1220 -- # return 0 00:07:20.331 19:05:38 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:20.331 19:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:20.331 19:05:38 -- common/autotest_common.sh@10 -- # set +x 00:07:20.331 19:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:20.331 19:05:38 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:20.331 19:05:38 -- target/filesystem.sh@101 -- # killprocess 3344083 00:07:20.331 19:05:38 -- common/autotest_common.sh@936 -- # '[' -z 3344083 ']' 00:07:20.331 19:05:38 -- common/autotest_common.sh@940 -- # kill -0 3344083 00:07:20.331 19:05:38 -- common/autotest_common.sh@941 -- # uname 00:07:20.331 19:05:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:20.331 19:05:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3344083 00:07:20.331 19:05:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:20.331 19:05:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:20.331 19:05:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3344083' 00:07:20.331 killing process with pid 3344083 00:07:20.331 19:05:38 -- common/autotest_common.sh@955 -- # kill 3344083 00:07:20.331 19:05:38 -- common/autotest_common.sh@960 -- # wait 3344083 00:07:20.897 19:05:39 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:20.897 00:07:20.897 real 0m15.498s 00:07:20.897 user 0m59.913s 00:07:20.897 sys 0m1.893s 00:07:20.897 19:05:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.897 19:05:39 -- common/autotest_common.sh@10 -- # set +x 00:07:20.897 ************************************ 00:07:20.897 END TEST nvmf_filesystem_in_capsule 00:07:20.897 ************************************ 00:07:20.897 19:05:39 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:20.897 19:05:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:20.897 19:05:39 -- nvmf/common.sh@116 -- # sync 00:07:20.897 19:05:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:20.897 19:05:39 -- nvmf/common.sh@119 -- # set +e 00:07:20.897 19:05:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:20.897 19:05:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:20.897 rmmod nvme_tcp 00:07:20.897 rmmod nvme_fabrics 00:07:20.897 rmmod nvme_keyring 00:07:20.897 19:05:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:20.897 19:05:39 -- nvmf/common.sh@123 -- # set -e 00:07:20.897 19:05:39 -- nvmf/common.sh@124 -- # return 0 00:07:20.897 19:05:39 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:20.897 19:05:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:20.897 19:05:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:20.897 19:05:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:20.897 19:05:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:20.897 19:05:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:20.897 19:05:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:20.897 19:05:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:20.897 19:05:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:23.429 19:05:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:23.430 00:07:23.430 real 0m39.885s 00:07:23.430 user 2m17.730s 00:07:23.430 sys 0m5.772s 00:07:23.430 19:05:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.430 19:05:41 -- common/autotest_common.sh@10 -- # set +x 00:07:23.430 ************************************ 00:07:23.430 END TEST nvmf_filesystem 00:07:23.430 ************************************ 00:07:23.430 19:05:41 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:23.430 19:05:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:23.430 19:05:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.430 19:05:41 -- common/autotest_common.sh@10 -- # set +x 00:07:23.430 ************************************ 00:07:23.430 START TEST nvmf_discovery 00:07:23.430 ************************************ 00:07:23.430 19:05:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:23.430 * Looking for test storage... 00:07:23.430 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:23.430 19:05:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:23.430 19:05:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:23.430 19:05:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:23.430 19:05:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:23.430 19:05:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:23.430 19:05:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:23.430 19:05:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:23.430 19:05:41 -- scripts/common.sh@335 -- # IFS=.-: 00:07:23.430 19:05:41 -- scripts/common.sh@335 -- # read -ra ver1 00:07:23.430 19:05:41 -- scripts/common.sh@336 -- # IFS=.-: 00:07:23.430 19:05:41 -- scripts/common.sh@336 -- # read -ra ver2 00:07:23.430 19:05:41 -- scripts/common.sh@337 -- # local 'op=<' 00:07:23.430 19:05:41 -- scripts/common.sh@339 -- # ver1_l=2 00:07:23.430 19:05:41 -- scripts/common.sh@340 -- # ver2_l=1 00:07:23.430 19:05:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:23.430 19:05:41 -- scripts/common.sh@343 -- # case "$op" in 00:07:23.430 19:05:41 -- scripts/common.sh@344 -- # : 1 00:07:23.430 19:05:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:23.430 19:05:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:23.430 19:05:41 -- scripts/common.sh@364 -- # decimal 1 00:07:23.430 19:05:41 -- scripts/common.sh@352 -- # local d=1 00:07:23.430 19:05:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:23.430 19:05:41 -- scripts/common.sh@354 -- # echo 1 00:07:23.430 19:05:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:23.430 19:05:41 -- scripts/common.sh@365 -- # decimal 2 00:07:23.430 19:05:41 -- scripts/common.sh@352 -- # local d=2 00:07:23.430 19:05:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:23.430 19:05:41 -- scripts/common.sh@354 -- # echo 2 00:07:23.430 19:05:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:23.430 19:05:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:23.430 19:05:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:23.430 19:05:41 -- scripts/common.sh@367 -- # return 0 00:07:23.430 19:05:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:23.430 19:05:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:23.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:23.430 --rc genhtml_branch_coverage=1 00:07:23.430 --rc genhtml_function_coverage=1 00:07:23.430 --rc genhtml_legend=1 00:07:23.430 --rc geninfo_all_blocks=1 00:07:23.430 --rc geninfo_unexecuted_blocks=1 00:07:23.430 00:07:23.430 ' 00:07:23.430 19:05:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:23.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:23.430 --rc genhtml_branch_coverage=1 00:07:23.430 --rc genhtml_function_coverage=1 00:07:23.430 --rc genhtml_legend=1 00:07:23.430 --rc geninfo_all_blocks=1 00:07:23.430 --rc geninfo_unexecuted_blocks=1 00:07:23.430 00:07:23.430 ' 00:07:23.430 19:05:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:23.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:23.430 --rc genhtml_branch_coverage=1 00:07:23.430 --rc genhtml_function_coverage=1 00:07:23.430 --rc genhtml_legend=1 00:07:23.430 --rc geninfo_all_blocks=1 00:07:23.430 --rc geninfo_unexecuted_blocks=1 00:07:23.430 00:07:23.430 ' 00:07:23.430 19:05:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:23.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:23.430 --rc genhtml_branch_coverage=1 00:07:23.430 --rc genhtml_function_coverage=1 00:07:23.430 --rc genhtml_legend=1 00:07:23.430 --rc geninfo_all_blocks=1 00:07:23.430 --rc geninfo_unexecuted_blocks=1 00:07:23.430 00:07:23.430 ' 00:07:23.430 19:05:41 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:23.430 19:05:41 -- nvmf/common.sh@7 -- # uname -s 00:07:23.430 19:05:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:23.430 19:05:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:23.430 19:05:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:23.430 19:05:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:23.430 19:05:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:23.430 19:05:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:23.430 19:05:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:23.430 19:05:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:23.430 19:05:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:23.430 19:05:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:23.430 19:05:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:23.430 19:05:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:23.430 19:05:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:23.430 19:05:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:23.430 19:05:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:23.430 19:05:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:23.430 19:05:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:23.430 19:05:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:23.430 19:05:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:23.430 19:05:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:23.430 19:05:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:23.431 19:05:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:23.431 19:05:41 -- paths/export.sh@5 -- # export PATH 00:07:23.431 19:05:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:23.431 19:05:41 -- nvmf/common.sh@46 -- # : 0 00:07:23.431 19:05:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:23.431 19:05:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:23.431 19:05:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:23.431 19:05:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:23.431 19:05:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:23.431 19:05:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:23.431 19:05:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:23.431 19:05:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:23.431 19:05:41 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:23.431 19:05:41 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:23.431 19:05:41 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:23.431 19:05:41 -- target/discovery.sh@15 -- # hash nvme 00:07:23.431 19:05:41 -- target/discovery.sh@20 -- # nvmftestinit 00:07:23.431 19:05:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:23.431 19:05:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:23.431 19:05:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:23.431 19:05:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:23.431 19:05:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:23.431 19:05:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:23.431 19:05:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:23.431 19:05:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:23.431 19:05:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:23.431 19:05:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:23.431 19:05:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:23.431 19:05:41 -- common/autotest_common.sh@10 -- # set +x 00:07:25.331 19:05:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:25.331 19:05:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:25.331 19:05:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:25.331 19:05:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:25.331 19:05:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:25.331 19:05:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:25.331 19:05:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:25.331 19:05:43 -- nvmf/common.sh@294 -- # net_devs=() 00:07:25.331 19:05:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:25.331 19:05:43 -- nvmf/common.sh@295 -- # e810=() 00:07:25.331 19:05:43 -- nvmf/common.sh@295 -- # local -ga e810 00:07:25.331 19:05:43 -- nvmf/common.sh@296 -- # x722=() 00:07:25.331 19:05:43 -- nvmf/common.sh@296 -- # local -ga x722 00:07:25.331 19:05:43 -- nvmf/common.sh@297 -- # mlx=() 00:07:25.331 19:05:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:25.331 19:05:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:25.331 19:05:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:25.332 19:05:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:25.332 19:05:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:25.332 19:05:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:25.332 19:05:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:25.332 19:05:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:25.332 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:25.332 19:05:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:25.332 19:05:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:25.332 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:25.332 19:05:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:25.332 19:05:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:25.332 19:05:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:25.332 19:05:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:25.332 19:05:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:25.332 19:05:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:25.332 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:25.332 19:05:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:25.332 19:05:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:25.332 19:05:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:25.332 19:05:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:25.332 19:05:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:25.332 19:05:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:25.332 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:25.332 19:05:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:25.332 19:05:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:25.332 19:05:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:25.332 19:05:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:25.332 19:05:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:25.332 19:05:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:25.332 19:05:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:25.332 19:05:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:25.332 19:05:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:25.332 19:05:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:25.332 19:05:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:25.332 19:05:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:25.332 19:05:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:25.332 19:05:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:25.332 19:05:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:25.332 19:05:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:25.332 19:05:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:25.332 19:05:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:25.332 19:05:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:25.332 19:05:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:25.332 19:05:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:25.332 19:05:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:25.332 19:05:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:25.332 19:05:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:25.332 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:25.332 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.383 ms 00:07:25.332 00:07:25.332 --- 10.0.0.2 ping statistics --- 00:07:25.332 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:25.332 rtt min/avg/max/mdev = 0.383/0.383/0.383/0.000 ms 00:07:25.332 19:05:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:25.332 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:25.332 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:07:25.332 00:07:25.332 --- 10.0.0.1 ping statistics --- 00:07:25.332 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:25.332 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:07:25.332 19:05:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:25.332 19:05:43 -- nvmf/common.sh@410 -- # return 0 00:07:25.332 19:05:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:25.332 19:05:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:25.332 19:05:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:25.332 19:05:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:25.332 19:05:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:25.332 19:05:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:25.332 19:05:43 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:25.332 19:05:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:25.332 19:05:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:25.332 19:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:25.332 19:05:43 -- nvmf/common.sh@469 -- # nvmfpid=3348161 00:07:25.332 19:05:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:25.332 19:05:43 -- nvmf/common.sh@470 -- # waitforlisten 3348161 00:07:25.332 19:05:43 -- common/autotest_common.sh@829 -- # '[' -z 3348161 ']' 00:07:25.332 19:05:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:25.332 19:05:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:25.332 19:05:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:25.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:25.332 19:05:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:25.332 19:05:43 -- common/autotest_common.sh@10 -- # set +x 00:07:25.590 [2024-11-18 19:05:43.979159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:25.591 [2024-11-18 19:05:43.979237] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:25.591 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.591 [2024-11-18 19:05:44.052685] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:25.591 [2024-11-18 19:05:44.171980] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:25.591 [2024-11-18 19:05:44.172140] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:25.591 [2024-11-18 19:05:44.172159] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:25.591 [2024-11-18 19:05:44.172175] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:25.591 [2024-11-18 19:05:44.172271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:25.591 [2024-11-18 19:05:44.172327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:25.591 [2024-11-18 19:05:44.172381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:25.591 [2024-11-18 19:05:44.172384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.524 19:05:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:26.524 19:05:45 -- common/autotest_common.sh@862 -- # return 0 00:07:26.524 19:05:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:26.524 19:05:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 19:05:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:26.524 19:05:45 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 [2024-11-18 19:05:45.052401] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@26 -- # seq 1 4 00:07:26.524 19:05:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:26.524 19:05:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 Null1 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 [2024-11-18 19:05:45.092770] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:26.524 19:05:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 Null2 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.524 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.524 19:05:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:26.524 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.524 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:26.782 19:05:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 Null3 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:26.782 19:05:45 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 Null4 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:26.782 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:26.782 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:26.782 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:26.782 19:05:45 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:27.040 00:07:27.040 Discovery Log Number of Records 6, Generation counter 6 00:07:27.040 =====Discovery Log Entry 0====== 00:07:27.040 trtype: tcp 00:07:27.040 adrfam: ipv4 00:07:27.040 subtype: current discovery subsystem 00:07:27.040 treq: not required 00:07:27.040 portid: 0 00:07:27.040 trsvcid: 4420 00:07:27.040 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:27.040 traddr: 10.0.0.2 00:07:27.040 eflags: explicit discovery connections, duplicate discovery information 00:07:27.040 sectype: none 00:07:27.040 =====Discovery Log Entry 1====== 00:07:27.040 trtype: tcp 00:07:27.040 adrfam: ipv4 00:07:27.040 subtype: nvme subsystem 00:07:27.040 treq: not required 00:07:27.040 portid: 0 00:07:27.040 trsvcid: 4420 00:07:27.040 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:27.040 traddr: 10.0.0.2 00:07:27.040 eflags: none 00:07:27.040 sectype: none 00:07:27.040 =====Discovery Log Entry 2====== 00:07:27.040 trtype: tcp 00:07:27.040 adrfam: ipv4 00:07:27.040 subtype: nvme subsystem 00:07:27.040 treq: not required 00:07:27.040 portid: 0 00:07:27.040 trsvcid: 4420 00:07:27.040 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:27.040 traddr: 10.0.0.2 00:07:27.040 eflags: none 00:07:27.040 sectype: none 00:07:27.040 =====Discovery Log Entry 3====== 00:07:27.040 trtype: tcp 00:07:27.040 adrfam: ipv4 00:07:27.040 subtype: nvme subsystem 00:07:27.040 treq: not required 00:07:27.040 portid: 0 00:07:27.040 trsvcid: 4420 00:07:27.040 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:27.040 traddr: 10.0.0.2 00:07:27.040 eflags: none 00:07:27.040 sectype: none 00:07:27.040 =====Discovery Log Entry 4====== 00:07:27.040 trtype: tcp 00:07:27.040 adrfam: ipv4 00:07:27.040 subtype: nvme subsystem 00:07:27.040 treq: not required 00:07:27.040 portid: 0 00:07:27.040 trsvcid: 4420 00:07:27.040 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:27.040 traddr: 10.0.0.2 00:07:27.040 eflags: none 00:07:27.040 sectype: none 00:07:27.040 =====Discovery Log Entry 5====== 00:07:27.040 trtype: tcp 00:07:27.040 adrfam: ipv4 00:07:27.040 subtype: discovery subsystem referral 00:07:27.040 treq: not required 00:07:27.040 portid: 0 00:07:27.040 trsvcid: 4430 00:07:27.040 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:27.040 traddr: 10.0.0.2 00:07:27.040 eflags: none 00:07:27.040 sectype: none 00:07:27.040 19:05:45 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:27.040 Perform nvmf subsystem discovery via RPC 00:07:27.040 19:05:45 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:27.040 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.040 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.040 [2024-11-18 19:05:45.425668] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:27.040 [ 00:07:27.040 { 00:07:27.040 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:27.040 "subtype": "Discovery", 00:07:27.040 "listen_addresses": [ 00:07:27.040 { 00:07:27.040 "transport": "TCP", 00:07:27.040 "trtype": "TCP", 00:07:27.040 "adrfam": "IPv4", 00:07:27.040 "traddr": "10.0.0.2", 00:07:27.040 "trsvcid": "4420" 00:07:27.040 } 00:07:27.040 ], 00:07:27.040 "allow_any_host": true, 00:07:27.040 "hosts": [] 00:07:27.040 }, 00:07:27.040 { 00:07:27.040 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:27.040 "subtype": "NVMe", 00:07:27.040 "listen_addresses": [ 00:07:27.040 { 00:07:27.040 "transport": "TCP", 00:07:27.040 "trtype": "TCP", 00:07:27.040 "adrfam": "IPv4", 00:07:27.040 "traddr": "10.0.0.2", 00:07:27.040 "trsvcid": "4420" 00:07:27.040 } 00:07:27.040 ], 00:07:27.040 "allow_any_host": true, 00:07:27.040 "hosts": [], 00:07:27.040 "serial_number": "SPDK00000000000001", 00:07:27.040 "model_number": "SPDK bdev Controller", 00:07:27.040 "max_namespaces": 32, 00:07:27.040 "min_cntlid": 1, 00:07:27.040 "max_cntlid": 65519, 00:07:27.040 "namespaces": [ 00:07:27.040 { 00:07:27.041 "nsid": 1, 00:07:27.041 "bdev_name": "Null1", 00:07:27.041 "name": "Null1", 00:07:27.041 "nguid": "B59CC1CF13AA4362A2126C401FF5A36F", 00:07:27.041 "uuid": "b59cc1cf-13aa-4362-a212-6c401ff5a36f" 00:07:27.041 } 00:07:27.041 ] 00:07:27.041 }, 00:07:27.041 { 00:07:27.041 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:27.041 "subtype": "NVMe", 00:07:27.041 "listen_addresses": [ 00:07:27.041 { 00:07:27.041 "transport": "TCP", 00:07:27.041 "trtype": "TCP", 00:07:27.041 "adrfam": "IPv4", 00:07:27.041 "traddr": "10.0.0.2", 00:07:27.041 "trsvcid": "4420" 00:07:27.041 } 00:07:27.041 ], 00:07:27.041 "allow_any_host": true, 00:07:27.041 "hosts": [], 00:07:27.041 "serial_number": "SPDK00000000000002", 00:07:27.041 "model_number": "SPDK bdev Controller", 00:07:27.041 "max_namespaces": 32, 00:07:27.041 "min_cntlid": 1, 00:07:27.041 "max_cntlid": 65519, 00:07:27.041 "namespaces": [ 00:07:27.041 { 00:07:27.041 "nsid": 1, 00:07:27.041 "bdev_name": "Null2", 00:07:27.041 "name": "Null2", 00:07:27.041 "nguid": "B12CF771A4434E2786697A693A9A8FB1", 00:07:27.041 "uuid": "b12cf771-a443-4e27-8669-7a693a9a8fb1" 00:07:27.041 } 00:07:27.041 ] 00:07:27.041 }, 00:07:27.041 { 00:07:27.041 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:27.041 "subtype": "NVMe", 00:07:27.041 "listen_addresses": [ 00:07:27.041 { 00:07:27.041 "transport": "TCP", 00:07:27.041 "trtype": "TCP", 00:07:27.041 "adrfam": "IPv4", 00:07:27.041 "traddr": "10.0.0.2", 00:07:27.041 "trsvcid": "4420" 00:07:27.041 } 00:07:27.041 ], 00:07:27.041 "allow_any_host": true, 00:07:27.041 "hosts": [], 00:07:27.041 "serial_number": "SPDK00000000000003", 00:07:27.041 "model_number": "SPDK bdev Controller", 00:07:27.041 "max_namespaces": 32, 00:07:27.041 "min_cntlid": 1, 00:07:27.041 "max_cntlid": 65519, 00:07:27.041 "namespaces": [ 00:07:27.041 { 00:07:27.041 "nsid": 1, 00:07:27.041 "bdev_name": "Null3", 00:07:27.041 "name": "Null3", 00:07:27.041 "nguid": "10D09821BB99429B8AEC4A6C3243D290", 00:07:27.041 "uuid": "10d09821-bb99-429b-8aec-4a6c3243d290" 00:07:27.041 } 00:07:27.041 ] 00:07:27.041 }, 00:07:27.041 { 00:07:27.041 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:27.041 "subtype": "NVMe", 00:07:27.041 "listen_addresses": [ 00:07:27.041 { 00:07:27.041 "transport": "TCP", 00:07:27.041 "trtype": "TCP", 00:07:27.041 "adrfam": "IPv4", 00:07:27.041 "traddr": "10.0.0.2", 00:07:27.041 "trsvcid": "4420" 00:07:27.041 } 00:07:27.041 ], 00:07:27.041 "allow_any_host": true, 00:07:27.041 "hosts": [], 00:07:27.041 "serial_number": "SPDK00000000000004", 00:07:27.041 "model_number": "SPDK bdev Controller", 00:07:27.041 "max_namespaces": 32, 00:07:27.041 "min_cntlid": 1, 00:07:27.041 "max_cntlid": 65519, 00:07:27.041 "namespaces": [ 00:07:27.041 { 00:07:27.041 "nsid": 1, 00:07:27.041 "bdev_name": "Null4", 00:07:27.041 "name": "Null4", 00:07:27.041 "nguid": "BC6DEDCAFE8848E5A229C7980B8B3F4E", 00:07:27.041 "uuid": "bc6dedca-fe88-48e5-a229-c7980b8b3f4e" 00:07:27.041 } 00:07:27.041 ] 00:07:27.041 } 00:07:27.041 ] 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@42 -- # seq 1 4 00:07:27.041 19:05:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:27.041 19:05:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:27.041 19:05:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:27.041 19:05:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:27.041 19:05:45 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:27.041 19:05:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.041 19:05:45 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:27.041 19:05:45 -- common/autotest_common.sh@10 -- # set +x 00:07:27.041 19:05:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.041 19:05:45 -- target/discovery.sh@49 -- # check_bdevs= 00:07:27.041 19:05:45 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:27.041 19:05:45 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:27.041 19:05:45 -- target/discovery.sh@57 -- # nvmftestfini 00:07:27.041 19:05:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:27.041 19:05:45 -- nvmf/common.sh@116 -- # sync 00:07:27.041 19:05:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:27.041 19:05:45 -- nvmf/common.sh@119 -- # set +e 00:07:27.041 19:05:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:27.041 19:05:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:27.041 rmmod nvme_tcp 00:07:27.041 rmmod nvme_fabrics 00:07:27.041 rmmod nvme_keyring 00:07:27.041 19:05:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:27.041 19:05:45 -- nvmf/common.sh@123 -- # set -e 00:07:27.041 19:05:45 -- nvmf/common.sh@124 -- # return 0 00:07:27.041 19:05:45 -- nvmf/common.sh@477 -- # '[' -n 3348161 ']' 00:07:27.041 19:05:45 -- nvmf/common.sh@478 -- # killprocess 3348161 00:07:27.041 19:05:45 -- common/autotest_common.sh@936 -- # '[' -z 3348161 ']' 00:07:27.041 19:05:45 -- common/autotest_common.sh@940 -- # kill -0 3348161 00:07:27.041 19:05:45 -- common/autotest_common.sh@941 -- # uname 00:07:27.041 19:05:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:27.041 19:05:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3348161 00:07:27.041 19:05:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:27.041 19:05:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:27.041 19:05:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3348161' 00:07:27.041 killing process with pid 3348161 00:07:27.041 19:05:45 -- common/autotest_common.sh@955 -- # kill 3348161 00:07:27.041 [2024-11-18 19:05:45.634757] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:27.041 19:05:45 -- common/autotest_common.sh@960 -- # wait 3348161 00:07:27.300 19:05:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:27.300 19:05:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:27.300 19:05:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:27.300 19:05:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:27.300 19:05:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:27.300 19:05:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:27.300 19:05:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:27.300 19:05:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.866 19:05:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:29.866 00:07:29.866 real 0m6.413s 00:07:29.866 user 0m8.006s 00:07:29.866 sys 0m1.870s 00:07:29.866 19:05:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:29.866 19:05:47 -- common/autotest_common.sh@10 -- # set +x 00:07:29.866 ************************************ 00:07:29.866 END TEST nvmf_discovery 00:07:29.866 ************************************ 00:07:29.866 19:05:47 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:29.866 19:05:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:29.866 19:05:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.866 19:05:47 -- common/autotest_common.sh@10 -- # set +x 00:07:29.866 ************************************ 00:07:29.866 START TEST nvmf_referrals 00:07:29.866 ************************************ 00:07:29.866 19:05:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:29.866 * Looking for test storage... 00:07:29.866 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:29.866 19:05:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:29.866 19:05:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:29.866 19:05:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:29.866 19:05:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:29.866 19:05:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:29.866 19:05:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:29.866 19:05:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:29.866 19:05:48 -- scripts/common.sh@335 -- # IFS=.-: 00:07:29.866 19:05:48 -- scripts/common.sh@335 -- # read -ra ver1 00:07:29.866 19:05:48 -- scripts/common.sh@336 -- # IFS=.-: 00:07:29.866 19:05:48 -- scripts/common.sh@336 -- # read -ra ver2 00:07:29.866 19:05:48 -- scripts/common.sh@337 -- # local 'op=<' 00:07:29.866 19:05:48 -- scripts/common.sh@339 -- # ver1_l=2 00:07:29.866 19:05:48 -- scripts/common.sh@340 -- # ver2_l=1 00:07:29.866 19:05:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:29.866 19:05:48 -- scripts/common.sh@343 -- # case "$op" in 00:07:29.866 19:05:48 -- scripts/common.sh@344 -- # : 1 00:07:29.866 19:05:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:29.866 19:05:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:29.866 19:05:48 -- scripts/common.sh@364 -- # decimal 1 00:07:29.866 19:05:48 -- scripts/common.sh@352 -- # local d=1 00:07:29.866 19:05:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:29.866 19:05:48 -- scripts/common.sh@354 -- # echo 1 00:07:29.866 19:05:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:29.866 19:05:48 -- scripts/common.sh@365 -- # decimal 2 00:07:29.866 19:05:48 -- scripts/common.sh@352 -- # local d=2 00:07:29.866 19:05:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:29.866 19:05:48 -- scripts/common.sh@354 -- # echo 2 00:07:29.866 19:05:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:29.866 19:05:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:29.866 19:05:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:29.866 19:05:48 -- scripts/common.sh@367 -- # return 0 00:07:29.866 19:05:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:29.866 19:05:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:29.866 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.866 --rc genhtml_branch_coverage=1 00:07:29.866 --rc genhtml_function_coverage=1 00:07:29.866 --rc genhtml_legend=1 00:07:29.866 --rc geninfo_all_blocks=1 00:07:29.866 --rc geninfo_unexecuted_blocks=1 00:07:29.866 00:07:29.866 ' 00:07:29.866 19:05:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:29.866 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.866 --rc genhtml_branch_coverage=1 00:07:29.866 --rc genhtml_function_coverage=1 00:07:29.866 --rc genhtml_legend=1 00:07:29.866 --rc geninfo_all_blocks=1 00:07:29.866 --rc geninfo_unexecuted_blocks=1 00:07:29.866 00:07:29.866 ' 00:07:29.866 19:05:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:29.866 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.866 --rc genhtml_branch_coverage=1 00:07:29.866 --rc genhtml_function_coverage=1 00:07:29.866 --rc genhtml_legend=1 00:07:29.866 --rc geninfo_all_blocks=1 00:07:29.866 --rc geninfo_unexecuted_blocks=1 00:07:29.866 00:07:29.866 ' 00:07:29.866 19:05:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:29.866 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:29.866 --rc genhtml_branch_coverage=1 00:07:29.866 --rc genhtml_function_coverage=1 00:07:29.866 --rc genhtml_legend=1 00:07:29.866 --rc geninfo_all_blocks=1 00:07:29.866 --rc geninfo_unexecuted_blocks=1 00:07:29.866 00:07:29.866 ' 00:07:29.866 19:05:48 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:29.866 19:05:48 -- nvmf/common.sh@7 -- # uname -s 00:07:29.866 19:05:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:29.866 19:05:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:29.866 19:05:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:29.866 19:05:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:29.866 19:05:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:29.866 19:05:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:29.866 19:05:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:29.866 19:05:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:29.866 19:05:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:29.866 19:05:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:29.866 19:05:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.866 19:05:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:29.866 19:05:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:29.866 19:05:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:29.866 19:05:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:29.866 19:05:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:29.866 19:05:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:29.866 19:05:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:29.866 19:05:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:29.866 19:05:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.866 19:05:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.866 19:05:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.866 19:05:48 -- paths/export.sh@5 -- # export PATH 00:07:29.866 19:05:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:29.866 19:05:48 -- nvmf/common.sh@46 -- # : 0 00:07:29.866 19:05:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:29.866 19:05:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:29.866 19:05:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:29.866 19:05:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:29.866 19:05:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:29.867 19:05:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:29.867 19:05:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:29.867 19:05:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:29.867 19:05:48 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:29.867 19:05:48 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:29.867 19:05:48 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:29.867 19:05:48 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:29.867 19:05:48 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:29.867 19:05:48 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:29.867 19:05:48 -- target/referrals.sh@37 -- # nvmftestinit 00:07:29.867 19:05:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:29.867 19:05:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:29.867 19:05:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:29.867 19:05:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:29.867 19:05:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:29.867 19:05:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:29.867 19:05:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:29.867 19:05:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:29.867 19:05:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:29.867 19:05:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:29.867 19:05:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:29.867 19:05:48 -- common/autotest_common.sh@10 -- # set +x 00:07:31.839 19:05:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:31.839 19:05:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:31.839 19:05:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:31.839 19:05:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:31.839 19:05:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:31.839 19:05:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:31.839 19:05:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:31.839 19:05:50 -- nvmf/common.sh@294 -- # net_devs=() 00:07:31.839 19:05:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:31.839 19:05:50 -- nvmf/common.sh@295 -- # e810=() 00:07:31.839 19:05:50 -- nvmf/common.sh@295 -- # local -ga e810 00:07:31.839 19:05:50 -- nvmf/common.sh@296 -- # x722=() 00:07:31.839 19:05:50 -- nvmf/common.sh@296 -- # local -ga x722 00:07:31.839 19:05:50 -- nvmf/common.sh@297 -- # mlx=() 00:07:31.839 19:05:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:31.839 19:05:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:31.839 19:05:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:31.839 19:05:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:31.839 19:05:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:31.839 19:05:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.839 19:05:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:31.839 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:31.839 19:05:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:31.839 19:05:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:31.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:31.839 19:05:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:31.839 19:05:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.839 19:05:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.839 19:05:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.839 19:05:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.839 19:05:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:31.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:31.839 19:05:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.839 19:05:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:31.839 19:05:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:31.839 19:05:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:31.839 19:05:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:31.839 19:05:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:31.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:31.839 19:05:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:31.839 19:05:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:31.839 19:05:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:31.839 19:05:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:31.839 19:05:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:31.839 19:05:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:31.839 19:05:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:31.839 19:05:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:31.839 19:05:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:31.839 19:05:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:31.839 19:05:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:31.839 19:05:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:31.839 19:05:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:31.839 19:05:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:31.839 19:05:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:31.839 19:05:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:31.839 19:05:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:31.839 19:05:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:32.098 19:05:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:32.098 19:05:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:32.098 19:05:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:32.098 19:05:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:32.098 19:05:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:32.098 19:05:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:32.098 19:05:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:32.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:32.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:07:32.098 00:07:32.098 --- 10.0.0.2 ping statistics --- 00:07:32.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:32.098 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:07:32.098 19:05:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:32.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:32.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:07:32.098 00:07:32.098 --- 10.0.0.1 ping statistics --- 00:07:32.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:32.098 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:07:32.098 19:05:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:32.098 19:05:50 -- nvmf/common.sh@410 -- # return 0 00:07:32.098 19:05:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:32.098 19:05:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:32.098 19:05:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:32.098 19:05:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:32.098 19:05:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:32.098 19:05:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:32.098 19:05:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:32.098 19:05:50 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:32.098 19:05:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:32.098 19:05:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:32.098 19:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:32.098 19:05:50 -- nvmf/common.sh@469 -- # nvmfpid=3350402 00:07:32.098 19:05:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:32.098 19:05:50 -- nvmf/common.sh@470 -- # waitforlisten 3350402 00:07:32.098 19:05:50 -- common/autotest_common.sh@829 -- # '[' -z 3350402 ']' 00:07:32.098 19:05:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:32.098 19:05:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:32.098 19:05:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:32.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:32.098 19:05:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:32.098 19:05:50 -- common/autotest_common.sh@10 -- # set +x 00:07:32.098 [2024-11-18 19:05:50.582702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:32.098 [2024-11-18 19:05:50.582782] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:32.098 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.098 [2024-11-18 19:05:50.653573] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:32.357 [2024-11-18 19:05:50.772770] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:32.357 [2024-11-18 19:05:50.772933] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:32.357 [2024-11-18 19:05:50.772953] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:32.357 [2024-11-18 19:05:50.772967] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:32.357 [2024-11-18 19:05:50.773056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:32.357 [2024-11-18 19:05:50.773111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:32.357 [2024-11-18 19:05:50.773162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:32.357 [2024-11-18 19:05:50.773165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:33.291 19:05:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:33.291 19:05:51 -- common/autotest_common.sh@862 -- # return 0 00:07:33.291 19:05:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:33.291 19:05:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 19:05:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:33.291 19:05:51 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 [2024-11-18 19:05:51.590219] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 [2024-11-18 19:05:51.602443] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 19:05:51 -- target/referrals.sh@48 -- # jq length 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:33.291 19:05:51 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:33.291 19:05:51 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:33.291 19:05:51 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:33.291 19:05:51 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:33.291 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.291 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.291 19:05:51 -- target/referrals.sh@21 -- # sort 00:07:33.291 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:33.291 19:05:51 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:33.291 19:05:51 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:33.291 19:05:51 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:33.291 19:05:51 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:33.292 19:05:51 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:33.292 19:05:51 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:33.292 19:05:51 -- target/referrals.sh@26 -- # sort 00:07:33.292 19:05:51 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:33.292 19:05:51 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:33.292 19:05:51 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:33.292 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.292 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.292 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.292 19:05:51 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:33.292 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.292 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.550 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.550 19:05:51 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:33.550 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.550 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.550 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.550 19:05:51 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:33.550 19:05:51 -- target/referrals.sh@56 -- # jq length 00:07:33.550 19:05:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.550 19:05:51 -- common/autotest_common.sh@10 -- # set +x 00:07:33.550 19:05:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.550 19:05:51 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:33.550 19:05:51 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:33.550 19:05:51 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:33.550 19:05:51 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:33.550 19:05:51 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:33.550 19:05:51 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:33.550 19:05:51 -- target/referrals.sh@26 -- # sort 00:07:33.808 19:05:52 -- target/referrals.sh@26 -- # echo 00:07:33.808 19:05:52 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:33.808 19:05:52 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:33.808 19:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.808 19:05:52 -- common/autotest_common.sh@10 -- # set +x 00:07:33.808 19:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.808 19:05:52 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:33.808 19:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.808 19:05:52 -- common/autotest_common.sh@10 -- # set +x 00:07:33.808 19:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.808 19:05:52 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:33.808 19:05:52 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:33.808 19:05:52 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:33.808 19:05:52 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:33.808 19:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:33.808 19:05:52 -- common/autotest_common.sh@10 -- # set +x 00:07:33.808 19:05:52 -- target/referrals.sh@21 -- # sort 00:07:33.808 19:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:33.808 19:05:52 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:33.808 19:05:52 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:33.808 19:05:52 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:33.808 19:05:52 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:33.808 19:05:52 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:33.808 19:05:52 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:33.808 19:05:52 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:33.808 19:05:52 -- target/referrals.sh@26 -- # sort 00:07:34.066 19:05:52 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:34.066 19:05:52 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:34.066 19:05:52 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:34.066 19:05:52 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:34.066 19:05:52 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:34.066 19:05:52 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:34.066 19:05:52 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:34.066 19:05:52 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:34.066 19:05:52 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:34.066 19:05:52 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:34.066 19:05:52 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:34.066 19:05:52 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:34.066 19:05:52 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:34.325 19:05:52 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:34.325 19:05:52 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:34.325 19:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.325 19:05:52 -- common/autotest_common.sh@10 -- # set +x 00:07:34.325 19:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.325 19:05:52 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:34.325 19:05:52 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:34.325 19:05:52 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:34.325 19:05:52 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:34.325 19:05:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.325 19:05:52 -- common/autotest_common.sh@10 -- # set +x 00:07:34.325 19:05:52 -- target/referrals.sh@21 -- # sort 00:07:34.325 19:05:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.325 19:05:52 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:34.325 19:05:52 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:34.325 19:05:52 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:34.325 19:05:52 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:34.325 19:05:52 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:34.325 19:05:52 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:34.325 19:05:52 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:34.325 19:05:52 -- target/referrals.sh@26 -- # sort 00:07:34.583 19:05:52 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:34.583 19:05:52 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:34.583 19:05:52 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:34.583 19:05:52 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:34.583 19:05:52 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:34.583 19:05:52 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:34.583 19:05:52 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:34.583 19:05:53 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:34.583 19:05:53 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:34.583 19:05:53 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:34.583 19:05:53 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:34.583 19:05:53 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:34.583 19:05:53 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:34.841 19:05:53 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:34.841 19:05:53 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:34.841 19:05:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.841 19:05:53 -- common/autotest_common.sh@10 -- # set +x 00:07:34.841 19:05:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.841 19:05:53 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:34.841 19:05:53 -- target/referrals.sh@82 -- # jq length 00:07:34.841 19:05:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.841 19:05:53 -- common/autotest_common.sh@10 -- # set +x 00:07:34.841 19:05:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.841 19:05:53 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:34.841 19:05:53 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:34.841 19:05:53 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:34.841 19:05:53 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:34.841 19:05:53 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:34.841 19:05:53 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:34.841 19:05:53 -- target/referrals.sh@26 -- # sort 00:07:35.099 19:05:53 -- target/referrals.sh@26 -- # echo 00:07:35.099 19:05:53 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:35.099 19:05:53 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:35.099 19:05:53 -- target/referrals.sh@86 -- # nvmftestfini 00:07:35.099 19:05:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:35.099 19:05:53 -- nvmf/common.sh@116 -- # sync 00:07:35.099 19:05:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:35.099 19:05:53 -- nvmf/common.sh@119 -- # set +e 00:07:35.099 19:05:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:35.099 19:05:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:35.099 rmmod nvme_tcp 00:07:35.099 rmmod nvme_fabrics 00:07:35.099 rmmod nvme_keyring 00:07:35.099 19:05:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:35.099 19:05:53 -- nvmf/common.sh@123 -- # set -e 00:07:35.099 19:05:53 -- nvmf/common.sh@124 -- # return 0 00:07:35.099 19:05:53 -- nvmf/common.sh@477 -- # '[' -n 3350402 ']' 00:07:35.099 19:05:53 -- nvmf/common.sh@478 -- # killprocess 3350402 00:07:35.099 19:05:53 -- common/autotest_common.sh@936 -- # '[' -z 3350402 ']' 00:07:35.099 19:05:53 -- common/autotest_common.sh@940 -- # kill -0 3350402 00:07:35.099 19:05:53 -- common/autotest_common.sh@941 -- # uname 00:07:35.099 19:05:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:35.099 19:05:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3350402 00:07:35.099 19:05:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:35.099 19:05:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:35.099 19:05:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3350402' 00:07:35.099 killing process with pid 3350402 00:07:35.099 19:05:53 -- common/autotest_common.sh@955 -- # kill 3350402 00:07:35.099 19:05:53 -- common/autotest_common.sh@960 -- # wait 3350402 00:07:35.357 19:05:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:35.357 19:05:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:35.357 19:05:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:35.357 19:05:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:35.357 19:05:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:35.357 19:05:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:35.357 19:05:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:35.357 19:05:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:37.891 19:05:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:37.891 00:07:37.891 real 0m7.961s 00:07:37.891 user 0m13.992s 00:07:37.891 sys 0m2.343s 00:07:37.891 19:05:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.891 19:05:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.891 ************************************ 00:07:37.891 END TEST nvmf_referrals 00:07:37.891 ************************************ 00:07:37.891 19:05:55 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:37.891 19:05:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:37.891 19:05:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.891 19:05:55 -- common/autotest_common.sh@10 -- # set +x 00:07:37.891 ************************************ 00:07:37.891 START TEST nvmf_connect_disconnect 00:07:37.891 ************************************ 00:07:37.891 19:05:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:37.891 * Looking for test storage... 00:07:37.891 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:37.891 19:05:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:37.891 19:05:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:37.891 19:05:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:37.891 19:05:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:37.891 19:05:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:37.891 19:05:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:37.891 19:05:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:37.891 19:05:56 -- scripts/common.sh@335 -- # IFS=.-: 00:07:37.891 19:05:56 -- scripts/common.sh@335 -- # read -ra ver1 00:07:37.891 19:05:56 -- scripts/common.sh@336 -- # IFS=.-: 00:07:37.891 19:05:56 -- scripts/common.sh@336 -- # read -ra ver2 00:07:37.891 19:05:56 -- scripts/common.sh@337 -- # local 'op=<' 00:07:37.891 19:05:56 -- scripts/common.sh@339 -- # ver1_l=2 00:07:37.891 19:05:56 -- scripts/common.sh@340 -- # ver2_l=1 00:07:37.891 19:05:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:37.891 19:05:56 -- scripts/common.sh@343 -- # case "$op" in 00:07:37.891 19:05:56 -- scripts/common.sh@344 -- # : 1 00:07:37.891 19:05:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:37.891 19:05:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:37.891 19:05:56 -- scripts/common.sh@364 -- # decimal 1 00:07:37.891 19:05:56 -- scripts/common.sh@352 -- # local d=1 00:07:37.891 19:05:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:37.891 19:05:56 -- scripts/common.sh@354 -- # echo 1 00:07:37.891 19:05:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:37.891 19:05:56 -- scripts/common.sh@365 -- # decimal 2 00:07:37.891 19:05:56 -- scripts/common.sh@352 -- # local d=2 00:07:37.891 19:05:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:37.891 19:05:56 -- scripts/common.sh@354 -- # echo 2 00:07:37.891 19:05:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:37.891 19:05:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:37.891 19:05:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:37.891 19:05:56 -- scripts/common.sh@367 -- # return 0 00:07:37.891 19:05:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:37.891 19:05:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:37.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.891 --rc genhtml_branch_coverage=1 00:07:37.891 --rc genhtml_function_coverage=1 00:07:37.891 --rc genhtml_legend=1 00:07:37.891 --rc geninfo_all_blocks=1 00:07:37.891 --rc geninfo_unexecuted_blocks=1 00:07:37.891 00:07:37.891 ' 00:07:37.891 19:05:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:37.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.891 --rc genhtml_branch_coverage=1 00:07:37.891 --rc genhtml_function_coverage=1 00:07:37.891 --rc genhtml_legend=1 00:07:37.891 --rc geninfo_all_blocks=1 00:07:37.891 --rc geninfo_unexecuted_blocks=1 00:07:37.891 00:07:37.891 ' 00:07:37.891 19:05:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:37.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.891 --rc genhtml_branch_coverage=1 00:07:37.891 --rc genhtml_function_coverage=1 00:07:37.891 --rc genhtml_legend=1 00:07:37.891 --rc geninfo_all_blocks=1 00:07:37.891 --rc geninfo_unexecuted_blocks=1 00:07:37.891 00:07:37.891 ' 00:07:37.891 19:05:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:37.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:37.891 --rc genhtml_branch_coverage=1 00:07:37.891 --rc genhtml_function_coverage=1 00:07:37.891 --rc genhtml_legend=1 00:07:37.891 --rc geninfo_all_blocks=1 00:07:37.891 --rc geninfo_unexecuted_blocks=1 00:07:37.891 00:07:37.891 ' 00:07:37.891 19:05:56 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:37.891 19:05:56 -- nvmf/common.sh@7 -- # uname -s 00:07:37.891 19:05:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:37.891 19:05:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:37.891 19:05:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:37.891 19:05:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:37.891 19:05:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:37.891 19:05:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:37.891 19:05:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:37.891 19:05:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:37.891 19:05:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:37.891 19:05:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:37.891 19:05:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:37.891 19:05:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:37.891 19:05:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:37.891 19:05:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:37.891 19:05:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:37.891 19:05:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:37.891 19:05:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:37.891 19:05:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:37.891 19:05:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:37.891 19:05:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.891 19:05:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.892 19:05:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.892 19:05:56 -- paths/export.sh@5 -- # export PATH 00:07:37.892 19:05:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.892 19:05:56 -- nvmf/common.sh@46 -- # : 0 00:07:37.892 19:05:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:37.892 19:05:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:37.892 19:05:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:37.892 19:05:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:37.892 19:05:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:37.892 19:05:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:37.892 19:05:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:37.892 19:05:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:37.892 19:05:56 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:37.892 19:05:56 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:37.892 19:05:56 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:37.892 19:05:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:37.892 19:05:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:37.892 19:05:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:37.892 19:05:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:37.892 19:05:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:37.892 19:05:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.892 19:05:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.892 19:05:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:37.892 19:05:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:37.892 19:05:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:37.892 19:05:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:37.892 19:05:56 -- common/autotest_common.sh@10 -- # set +x 00:07:39.793 19:05:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:39.793 19:05:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:39.793 19:05:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:39.793 19:05:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:39.793 19:05:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:39.793 19:05:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:39.793 19:05:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:39.793 19:05:58 -- nvmf/common.sh@294 -- # net_devs=() 00:07:39.793 19:05:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:39.793 19:05:58 -- nvmf/common.sh@295 -- # e810=() 00:07:39.793 19:05:58 -- nvmf/common.sh@295 -- # local -ga e810 00:07:39.793 19:05:58 -- nvmf/common.sh@296 -- # x722=() 00:07:39.793 19:05:58 -- nvmf/common.sh@296 -- # local -ga x722 00:07:39.793 19:05:58 -- nvmf/common.sh@297 -- # mlx=() 00:07:39.793 19:05:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:39.793 19:05:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:39.793 19:05:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:39.793 19:05:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:39.793 19:05:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:39.794 19:05:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:39.794 19:05:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:39.794 19:05:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:39.794 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:39.794 19:05:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:39.794 19:05:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:39.794 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:39.794 19:05:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:39.794 19:05:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:39.794 19:05:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:39.794 19:05:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:39.794 19:05:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:39.794 19:05:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:39.794 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:39.794 19:05:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:39.794 19:05:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:39.794 19:05:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:39.794 19:05:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:39.794 19:05:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:39.794 19:05:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:39.794 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:39.794 19:05:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:39.794 19:05:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:39.794 19:05:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:39.794 19:05:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:39.794 19:05:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:39.794 19:05:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:39.794 19:05:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:39.794 19:05:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:39.794 19:05:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:39.794 19:05:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:39.794 19:05:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:39.794 19:05:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:39.794 19:05:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:39.794 19:05:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:39.794 19:05:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:39.794 19:05:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:39.794 19:05:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:39.794 19:05:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:39.794 19:05:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:39.794 19:05:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:39.794 19:05:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:39.794 19:05:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:39.794 19:05:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:39.794 19:05:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:39.794 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:39.794 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.328 ms 00:07:39.794 00:07:39.794 --- 10.0.0.2 ping statistics --- 00:07:39.794 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:39.794 rtt min/avg/max/mdev = 0.328/0.328/0.328/0.000 ms 00:07:39.794 19:05:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:39.794 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:39.794 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:07:39.794 00:07:39.794 --- 10.0.0.1 ping statistics --- 00:07:39.794 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:39.794 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:07:39.794 19:05:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:39.794 19:05:58 -- nvmf/common.sh@410 -- # return 0 00:07:39.794 19:05:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:39.794 19:05:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:39.794 19:05:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:39.794 19:05:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:39.794 19:05:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:39.794 19:05:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:39.794 19:05:58 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:39.794 19:05:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:39.794 19:05:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:39.794 19:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:39.794 19:05:58 -- nvmf/common.sh@469 -- # nvmfpid=3352770 00:07:39.794 19:05:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:39.794 19:05:58 -- nvmf/common.sh@470 -- # waitforlisten 3352770 00:07:39.794 19:05:58 -- common/autotest_common.sh@829 -- # '[' -z 3352770 ']' 00:07:39.794 19:05:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:39.794 19:05:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:39.794 19:05:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:39.794 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:39.794 19:05:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:39.794 19:05:58 -- common/autotest_common.sh@10 -- # set +x 00:07:39.794 [2024-11-18 19:05:58.363527] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:39.794 [2024-11-18 19:05:58.363620] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:40.053 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.053 [2024-11-18 19:05:58.438280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:40.053 [2024-11-18 19:05:58.550629] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:40.053 [2024-11-18 19:05:58.550800] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:40.053 [2024-11-18 19:05:58.550817] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:40.053 [2024-11-18 19:05:58.550831] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:40.053 [2024-11-18 19:05:58.550885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:40.053 [2024-11-18 19:05:58.550976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:40.053 [2024-11-18 19:05:58.550979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.053 [2024-11-18 19:05:58.550912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:40.985 19:05:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:40.985 19:05:59 -- common/autotest_common.sh@862 -- # return 0 00:07:40.985 19:05:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:40.985 19:05:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:40.985 19:05:59 -- common/autotest_common.sh@10 -- # set +x 00:07:40.985 19:05:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:40.985 19:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.985 19:05:59 -- common/autotest_common.sh@10 -- # set +x 00:07:40.985 [2024-11-18 19:05:59.432456] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:40.985 19:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:40.985 19:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.985 19:05:59 -- common/autotest_common.sh@10 -- # set +x 00:07:40.985 19:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:40.985 19:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.985 19:05:59 -- common/autotest_common.sh@10 -- # set +x 00:07:40.985 19:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:40.985 19:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.985 19:05:59 -- common/autotest_common.sh@10 -- # set +x 00:07:40.985 19:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:40.985 19:05:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.985 19:05:59 -- common/autotest_common.sh@10 -- # set +x 00:07:40.985 [2024-11-18 19:05:59.484424] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:40.985 19:05:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:40.985 19:05:59 -- target/connect_disconnect.sh@34 -- # set +x 00:07:43.512 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:46.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:50.463 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:52.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.535 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:57.431 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:59.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:01.855 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.910 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.869 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:22.859 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.909 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.858 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.333 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.784 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.739 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.266 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.161 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.208 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.106 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.632 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.155 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.054 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.608 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.131 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.030 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.933 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.984 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.510 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.407 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.933 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.460 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.015 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.911 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.960 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.486 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.383 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.911 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.856 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.280 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.192 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.716 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.704 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.261 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.785 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.682 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.682 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.208 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.262 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.632 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.530 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.595 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.016 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.440 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.966 19:09:52 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:33.966 19:09:52 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:33.966 19:09:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:33.966 19:09:52 -- nvmf/common.sh@116 -- # sync 00:11:33.966 19:09:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:33.966 19:09:52 -- nvmf/common.sh@119 -- # set +e 00:11:33.966 19:09:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:33.966 19:09:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:33.966 rmmod nvme_tcp 00:11:33.966 rmmod nvme_fabrics 00:11:33.966 rmmod nvme_keyring 00:11:33.966 19:09:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:33.966 19:09:52 -- nvmf/common.sh@123 -- # set -e 00:11:33.966 19:09:52 -- nvmf/common.sh@124 -- # return 0 00:11:33.966 19:09:52 -- nvmf/common.sh@477 -- # '[' -n 3352770 ']' 00:11:33.966 19:09:52 -- nvmf/common.sh@478 -- # killprocess 3352770 00:11:33.966 19:09:52 -- common/autotest_common.sh@936 -- # '[' -z 3352770 ']' 00:11:33.966 19:09:52 -- common/autotest_common.sh@940 -- # kill -0 3352770 00:11:33.966 19:09:52 -- common/autotest_common.sh@941 -- # uname 00:11:33.966 19:09:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:33.966 19:09:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3352770 00:11:33.966 19:09:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:33.966 19:09:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:33.966 19:09:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3352770' 00:11:33.966 killing process with pid 3352770 00:11:33.966 19:09:52 -- common/autotest_common.sh@955 -- # kill 3352770 00:11:33.966 19:09:52 -- common/autotest_common.sh@960 -- # wait 3352770 00:11:34.224 19:09:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:34.224 19:09:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:34.224 19:09:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:34.224 19:09:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:34.224 19:09:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:34.224 19:09:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:34.224 19:09:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:34.224 19:09:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:36.756 19:09:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:36.756 00:11:36.756 real 3m58.793s 00:11:36.756 user 15m11.053s 00:11:36.756 sys 0m34.323s 00:11:36.756 19:09:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:36.756 19:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:36.757 ************************************ 00:11:36.757 END TEST nvmf_connect_disconnect 00:11:36.757 ************************************ 00:11:36.757 19:09:54 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:36.757 19:09:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:36.757 19:09:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:36.757 19:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:36.757 ************************************ 00:11:36.757 START TEST nvmf_multitarget 00:11:36.757 ************************************ 00:11:36.757 19:09:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:36.757 * Looking for test storage... 00:11:36.757 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:36.757 19:09:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:36.757 19:09:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:36.757 19:09:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:36.757 19:09:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:36.757 19:09:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:36.757 19:09:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:36.757 19:09:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:36.757 19:09:54 -- scripts/common.sh@335 -- # IFS=.-: 00:11:36.757 19:09:54 -- scripts/common.sh@335 -- # read -ra ver1 00:11:36.757 19:09:54 -- scripts/common.sh@336 -- # IFS=.-: 00:11:36.757 19:09:54 -- scripts/common.sh@336 -- # read -ra ver2 00:11:36.757 19:09:54 -- scripts/common.sh@337 -- # local 'op=<' 00:11:36.757 19:09:54 -- scripts/common.sh@339 -- # ver1_l=2 00:11:36.757 19:09:54 -- scripts/common.sh@340 -- # ver2_l=1 00:11:36.757 19:09:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:36.757 19:09:54 -- scripts/common.sh@343 -- # case "$op" in 00:11:36.757 19:09:54 -- scripts/common.sh@344 -- # : 1 00:11:36.757 19:09:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:36.757 19:09:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:36.757 19:09:54 -- scripts/common.sh@364 -- # decimal 1 00:11:36.757 19:09:54 -- scripts/common.sh@352 -- # local d=1 00:11:36.757 19:09:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:36.757 19:09:54 -- scripts/common.sh@354 -- # echo 1 00:11:36.757 19:09:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:36.757 19:09:54 -- scripts/common.sh@365 -- # decimal 2 00:11:36.757 19:09:54 -- scripts/common.sh@352 -- # local d=2 00:11:36.757 19:09:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:36.757 19:09:54 -- scripts/common.sh@354 -- # echo 2 00:11:36.757 19:09:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:36.757 19:09:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:36.757 19:09:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:36.757 19:09:54 -- scripts/common.sh@367 -- # return 0 00:11:36.757 19:09:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:36.757 19:09:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:36.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.757 --rc genhtml_branch_coverage=1 00:11:36.757 --rc genhtml_function_coverage=1 00:11:36.757 --rc genhtml_legend=1 00:11:36.757 --rc geninfo_all_blocks=1 00:11:36.757 --rc geninfo_unexecuted_blocks=1 00:11:36.757 00:11:36.757 ' 00:11:36.757 19:09:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:36.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.757 --rc genhtml_branch_coverage=1 00:11:36.757 --rc genhtml_function_coverage=1 00:11:36.757 --rc genhtml_legend=1 00:11:36.757 --rc geninfo_all_blocks=1 00:11:36.757 --rc geninfo_unexecuted_blocks=1 00:11:36.757 00:11:36.757 ' 00:11:36.757 19:09:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:36.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.757 --rc genhtml_branch_coverage=1 00:11:36.757 --rc genhtml_function_coverage=1 00:11:36.757 --rc genhtml_legend=1 00:11:36.757 --rc geninfo_all_blocks=1 00:11:36.757 --rc geninfo_unexecuted_blocks=1 00:11:36.757 00:11:36.757 ' 00:11:36.757 19:09:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:36.757 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.757 --rc genhtml_branch_coverage=1 00:11:36.757 --rc genhtml_function_coverage=1 00:11:36.757 --rc genhtml_legend=1 00:11:36.757 --rc geninfo_all_blocks=1 00:11:36.757 --rc geninfo_unexecuted_blocks=1 00:11:36.757 00:11:36.757 ' 00:11:36.757 19:09:54 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:36.757 19:09:54 -- nvmf/common.sh@7 -- # uname -s 00:11:36.757 19:09:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:36.757 19:09:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:36.757 19:09:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:36.757 19:09:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:36.757 19:09:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:36.757 19:09:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:36.757 19:09:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:36.757 19:09:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:36.757 19:09:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:36.757 19:09:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:36.757 19:09:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:36.757 19:09:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:36.757 19:09:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:36.757 19:09:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:36.757 19:09:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:36.757 19:09:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:36.757 19:09:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:36.757 19:09:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:36.757 19:09:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:36.757 19:09:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.757 19:09:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.757 19:09:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.757 19:09:54 -- paths/export.sh@5 -- # export PATH 00:11:36.757 19:09:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.757 19:09:54 -- nvmf/common.sh@46 -- # : 0 00:11:36.757 19:09:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:36.757 19:09:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:36.757 19:09:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:36.757 19:09:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:36.757 19:09:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:36.757 19:09:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:36.757 19:09:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:36.757 19:09:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:36.757 19:09:54 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:36.757 19:09:54 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:36.757 19:09:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:36.757 19:09:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:36.757 19:09:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:36.757 19:09:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:36.757 19:09:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:36.757 19:09:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:36.757 19:09:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:36.757 19:09:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:36.757 19:09:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:36.757 19:09:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:36.757 19:09:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:36.757 19:09:54 -- common/autotest_common.sh@10 -- # set +x 00:11:38.658 19:09:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:38.658 19:09:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:38.658 19:09:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:38.658 19:09:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:38.658 19:09:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:38.658 19:09:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:38.658 19:09:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:38.658 19:09:56 -- nvmf/common.sh@294 -- # net_devs=() 00:11:38.658 19:09:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:38.658 19:09:56 -- nvmf/common.sh@295 -- # e810=() 00:11:38.658 19:09:56 -- nvmf/common.sh@295 -- # local -ga e810 00:11:38.658 19:09:56 -- nvmf/common.sh@296 -- # x722=() 00:11:38.658 19:09:56 -- nvmf/common.sh@296 -- # local -ga x722 00:11:38.658 19:09:56 -- nvmf/common.sh@297 -- # mlx=() 00:11:38.658 19:09:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:38.658 19:09:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:38.658 19:09:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:38.658 19:09:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:38.658 19:09:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:38.658 19:09:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:38.658 19:09:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:38.658 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:38.658 19:09:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:38.658 19:09:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:38.658 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:38.658 19:09:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:38.658 19:09:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:38.658 19:09:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:38.658 19:09:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.658 19:09:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:38.658 19:09:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.658 19:09:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:38.658 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:38.658 19:09:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.658 19:09:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:38.658 19:09:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:38.658 19:09:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:38.658 19:09:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:38.658 19:09:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:38.658 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:38.658 19:09:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:38.658 19:09:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:38.658 19:09:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:38.658 19:09:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:38.658 19:09:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:38.658 19:09:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:38.658 19:09:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:38.658 19:09:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:38.658 19:09:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:38.658 19:09:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:38.658 19:09:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:38.658 19:09:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:38.658 19:09:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:38.658 19:09:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:38.658 19:09:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:38.658 19:09:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:38.658 19:09:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:38.658 19:09:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:38.658 19:09:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:38.658 19:09:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:38.658 19:09:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:38.658 19:09:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:38.658 19:09:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:38.658 19:09:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:38.658 19:09:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:38.658 19:09:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:38.658 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:38.658 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.319 ms 00:11:38.658 00:11:38.658 --- 10.0.0.2 ping statistics --- 00:11:38.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:38.658 rtt min/avg/max/mdev = 0.319/0.319/0.319/0.000 ms 00:11:38.658 19:09:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:38.658 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:38.658 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:11:38.658 00:11:38.658 --- 10.0.0.1 ping statistics --- 00:11:38.658 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:38.658 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:11:38.658 19:09:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:38.658 19:09:57 -- nvmf/common.sh@410 -- # return 0 00:11:38.658 19:09:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:38.658 19:09:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:38.658 19:09:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:38.658 19:09:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:38.658 19:09:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:38.658 19:09:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:38.658 19:09:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:38.658 19:09:57 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:38.658 19:09:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:38.658 19:09:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:38.658 19:09:57 -- common/autotest_common.sh@10 -- # set +x 00:11:38.658 19:09:57 -- nvmf/common.sh@469 -- # nvmfpid=3385670 00:11:38.658 19:09:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:38.658 19:09:57 -- nvmf/common.sh@470 -- # waitforlisten 3385670 00:11:38.658 19:09:57 -- common/autotest_common.sh@829 -- # '[' -z 3385670 ']' 00:11:38.658 19:09:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:38.658 19:09:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:38.658 19:09:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:38.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:38.658 19:09:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:38.658 19:09:57 -- common/autotest_common.sh@10 -- # set +x 00:11:38.658 [2024-11-18 19:09:57.204768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:38.658 [2024-11-18 19:09:57.204843] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:38.658 EAL: No free 2048 kB hugepages reported on node 1 00:11:38.916 [2024-11-18 19:09:57.277196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:38.916 [2024-11-18 19:09:57.394733] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:38.916 [2024-11-18 19:09:57.394886] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:38.916 [2024-11-18 19:09:57.394919] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:38.916 [2024-11-18 19:09:57.394932] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:38.916 [2024-11-18 19:09:57.394986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:38.916 [2024-11-18 19:09:57.395039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:38.916 [2024-11-18 19:09:57.395042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:38.916 [2024-11-18 19:09:57.395013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:39.847 19:09:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:39.847 19:09:58 -- common/autotest_common.sh@862 -- # return 0 00:11:39.847 19:09:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:39.847 19:09:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:39.847 19:09:58 -- common/autotest_common.sh@10 -- # set +x 00:11:39.847 19:09:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:39.847 19:09:58 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:39.847 19:09:58 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:39.847 19:09:58 -- target/multitarget.sh@21 -- # jq length 00:11:39.847 19:09:58 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:39.847 19:09:58 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:40.104 "nvmf_tgt_1" 00:11:40.104 19:09:58 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:40.104 "nvmf_tgt_2" 00:11:40.104 19:09:58 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:40.104 19:09:58 -- target/multitarget.sh@28 -- # jq length 00:11:40.362 19:09:58 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:40.362 19:09:58 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:40.362 true 00:11:40.362 19:09:58 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:40.362 true 00:11:40.362 19:09:58 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:40.362 19:09:58 -- target/multitarget.sh@35 -- # jq length 00:11:40.619 19:09:59 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:40.619 19:09:59 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:40.619 19:09:59 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:40.619 19:09:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:40.619 19:09:59 -- nvmf/common.sh@116 -- # sync 00:11:40.619 19:09:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:40.619 19:09:59 -- nvmf/common.sh@119 -- # set +e 00:11:40.619 19:09:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:40.619 19:09:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:40.619 rmmod nvme_tcp 00:11:40.619 rmmod nvme_fabrics 00:11:40.619 rmmod nvme_keyring 00:11:40.619 19:09:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:40.619 19:09:59 -- nvmf/common.sh@123 -- # set -e 00:11:40.619 19:09:59 -- nvmf/common.sh@124 -- # return 0 00:11:40.619 19:09:59 -- nvmf/common.sh@477 -- # '[' -n 3385670 ']' 00:11:40.619 19:09:59 -- nvmf/common.sh@478 -- # killprocess 3385670 00:11:40.619 19:09:59 -- common/autotest_common.sh@936 -- # '[' -z 3385670 ']' 00:11:40.619 19:09:59 -- common/autotest_common.sh@940 -- # kill -0 3385670 00:11:40.619 19:09:59 -- common/autotest_common.sh@941 -- # uname 00:11:40.619 19:09:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:40.619 19:09:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3385670 00:11:40.619 19:09:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:40.619 19:09:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:40.619 19:09:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3385670' 00:11:40.619 killing process with pid 3385670 00:11:40.619 19:09:59 -- common/autotest_common.sh@955 -- # kill 3385670 00:11:40.619 19:09:59 -- common/autotest_common.sh@960 -- # wait 3385670 00:11:40.877 19:09:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:40.877 19:09:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:40.877 19:09:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:40.877 19:09:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:40.877 19:09:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:40.877 19:09:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:40.877 19:09:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:40.877 19:09:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:43.406 19:10:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:43.406 00:11:43.406 real 0m6.723s 00:11:43.406 user 0m9.956s 00:11:43.406 sys 0m2.042s 00:11:43.406 19:10:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:43.406 19:10:01 -- common/autotest_common.sh@10 -- # set +x 00:11:43.406 ************************************ 00:11:43.406 END TEST nvmf_multitarget 00:11:43.406 ************************************ 00:11:43.406 19:10:01 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:43.406 19:10:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:43.406 19:10:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:43.406 19:10:01 -- common/autotest_common.sh@10 -- # set +x 00:11:43.406 ************************************ 00:11:43.406 START TEST nvmf_rpc 00:11:43.406 ************************************ 00:11:43.406 19:10:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:43.406 * Looking for test storage... 00:11:43.406 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:43.406 19:10:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:43.406 19:10:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:43.406 19:10:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:43.406 19:10:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:43.406 19:10:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:43.406 19:10:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:43.406 19:10:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:43.406 19:10:01 -- scripts/common.sh@335 -- # IFS=.-: 00:11:43.406 19:10:01 -- scripts/common.sh@335 -- # read -ra ver1 00:11:43.406 19:10:01 -- scripts/common.sh@336 -- # IFS=.-: 00:11:43.407 19:10:01 -- scripts/common.sh@336 -- # read -ra ver2 00:11:43.407 19:10:01 -- scripts/common.sh@337 -- # local 'op=<' 00:11:43.407 19:10:01 -- scripts/common.sh@339 -- # ver1_l=2 00:11:43.407 19:10:01 -- scripts/common.sh@340 -- # ver2_l=1 00:11:43.407 19:10:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:43.407 19:10:01 -- scripts/common.sh@343 -- # case "$op" in 00:11:43.407 19:10:01 -- scripts/common.sh@344 -- # : 1 00:11:43.407 19:10:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:43.407 19:10:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:43.407 19:10:01 -- scripts/common.sh@364 -- # decimal 1 00:11:43.407 19:10:01 -- scripts/common.sh@352 -- # local d=1 00:11:43.407 19:10:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:43.407 19:10:01 -- scripts/common.sh@354 -- # echo 1 00:11:43.407 19:10:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:43.407 19:10:01 -- scripts/common.sh@365 -- # decimal 2 00:11:43.407 19:10:01 -- scripts/common.sh@352 -- # local d=2 00:11:43.407 19:10:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:43.407 19:10:01 -- scripts/common.sh@354 -- # echo 2 00:11:43.407 19:10:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:43.407 19:10:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:43.407 19:10:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:43.407 19:10:01 -- scripts/common.sh@367 -- # return 0 00:11:43.407 19:10:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:43.407 19:10:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:43.407 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.407 --rc genhtml_branch_coverage=1 00:11:43.407 --rc genhtml_function_coverage=1 00:11:43.407 --rc genhtml_legend=1 00:11:43.407 --rc geninfo_all_blocks=1 00:11:43.407 --rc geninfo_unexecuted_blocks=1 00:11:43.407 00:11:43.407 ' 00:11:43.407 19:10:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:43.407 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.407 --rc genhtml_branch_coverage=1 00:11:43.407 --rc genhtml_function_coverage=1 00:11:43.407 --rc genhtml_legend=1 00:11:43.407 --rc geninfo_all_blocks=1 00:11:43.407 --rc geninfo_unexecuted_blocks=1 00:11:43.407 00:11:43.407 ' 00:11:43.407 19:10:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:43.407 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.407 --rc genhtml_branch_coverage=1 00:11:43.407 --rc genhtml_function_coverage=1 00:11:43.407 --rc genhtml_legend=1 00:11:43.407 --rc geninfo_all_blocks=1 00:11:43.407 --rc geninfo_unexecuted_blocks=1 00:11:43.407 00:11:43.407 ' 00:11:43.407 19:10:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:43.407 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:43.407 --rc genhtml_branch_coverage=1 00:11:43.407 --rc genhtml_function_coverage=1 00:11:43.407 --rc genhtml_legend=1 00:11:43.407 --rc geninfo_all_blocks=1 00:11:43.407 --rc geninfo_unexecuted_blocks=1 00:11:43.407 00:11:43.407 ' 00:11:43.407 19:10:01 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:43.407 19:10:01 -- nvmf/common.sh@7 -- # uname -s 00:11:43.407 19:10:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:43.407 19:10:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:43.407 19:10:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:43.407 19:10:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:43.407 19:10:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:43.407 19:10:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:43.407 19:10:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:43.407 19:10:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:43.407 19:10:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:43.407 19:10:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:43.407 19:10:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:43.407 19:10:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:43.407 19:10:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:43.407 19:10:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:43.407 19:10:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:43.407 19:10:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:43.407 19:10:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:43.407 19:10:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:43.407 19:10:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:43.407 19:10:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.407 19:10:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.407 19:10:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.407 19:10:01 -- paths/export.sh@5 -- # export PATH 00:11:43.407 19:10:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:43.407 19:10:01 -- nvmf/common.sh@46 -- # : 0 00:11:43.407 19:10:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:43.407 19:10:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:43.407 19:10:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:43.407 19:10:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:43.407 19:10:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:43.407 19:10:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:43.407 19:10:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:43.407 19:10:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:43.407 19:10:01 -- target/rpc.sh@11 -- # loops=5 00:11:43.407 19:10:01 -- target/rpc.sh@23 -- # nvmftestinit 00:11:43.407 19:10:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:43.407 19:10:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:43.407 19:10:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:43.407 19:10:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:43.407 19:10:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:43.407 19:10:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:43.407 19:10:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:43.407 19:10:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:43.407 19:10:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:43.407 19:10:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:43.407 19:10:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:43.407 19:10:01 -- common/autotest_common.sh@10 -- # set +x 00:11:45.307 19:10:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:45.307 19:10:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:45.307 19:10:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:45.307 19:10:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:45.307 19:10:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:45.307 19:10:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:45.307 19:10:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:45.307 19:10:03 -- nvmf/common.sh@294 -- # net_devs=() 00:11:45.307 19:10:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:45.307 19:10:03 -- nvmf/common.sh@295 -- # e810=() 00:11:45.307 19:10:03 -- nvmf/common.sh@295 -- # local -ga e810 00:11:45.307 19:10:03 -- nvmf/common.sh@296 -- # x722=() 00:11:45.307 19:10:03 -- nvmf/common.sh@296 -- # local -ga x722 00:11:45.307 19:10:03 -- nvmf/common.sh@297 -- # mlx=() 00:11:45.307 19:10:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:45.307 19:10:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:45.307 19:10:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:45.307 19:10:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:45.307 19:10:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:45.307 19:10:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:45.307 19:10:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:45.307 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:45.307 19:10:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:45.307 19:10:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:45.307 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:45.307 19:10:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:45.307 19:10:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:45.307 19:10:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.307 19:10:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:45.307 19:10:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.307 19:10:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:45.307 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:45.307 19:10:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.307 19:10:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:45.307 19:10:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:45.307 19:10:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:45.307 19:10:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:45.307 19:10:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:45.307 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:45.307 19:10:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:45.307 19:10:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:45.307 19:10:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:45.307 19:10:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:45.307 19:10:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:45.307 19:10:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:45.307 19:10:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:45.307 19:10:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:45.307 19:10:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:45.307 19:10:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:45.307 19:10:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:45.307 19:10:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:45.307 19:10:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:45.307 19:10:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:45.307 19:10:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:45.307 19:10:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:45.307 19:10:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:45.307 19:10:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:45.307 19:10:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:45.307 19:10:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:45.307 19:10:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:45.307 19:10:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:45.307 19:10:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:45.307 19:10:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:45.307 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:45.307 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.318 ms 00:11:45.307 00:11:45.307 --- 10.0.0.2 ping statistics --- 00:11:45.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.307 rtt min/avg/max/mdev = 0.318/0.318/0.318/0.000 ms 00:11:45.307 19:10:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:45.307 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:45.307 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:11:45.307 00:11:45.307 --- 10.0.0.1 ping statistics --- 00:11:45.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:45.307 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:11:45.307 19:10:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:45.307 19:10:03 -- nvmf/common.sh@410 -- # return 0 00:11:45.307 19:10:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:45.307 19:10:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:45.307 19:10:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:45.307 19:10:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:45.307 19:10:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:45.307 19:10:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:45.308 19:10:03 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:45.308 19:10:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:45.308 19:10:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:45.308 19:10:03 -- common/autotest_common.sh@10 -- # set +x 00:11:45.308 19:10:03 -- nvmf/common.sh@469 -- # nvmfpid=3387914 00:11:45.308 19:10:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:45.308 19:10:03 -- nvmf/common.sh@470 -- # waitforlisten 3387914 00:11:45.308 19:10:03 -- common/autotest_common.sh@829 -- # '[' -z 3387914 ']' 00:11:45.308 19:10:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:45.308 19:10:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:45.308 19:10:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:45.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:45.308 19:10:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:45.308 19:10:03 -- common/autotest_common.sh@10 -- # set +x 00:11:45.308 [2024-11-18 19:10:03.899874] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:45.308 [2024-11-18 19:10:03.899972] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:45.565 EAL: No free 2048 kB hugepages reported on node 1 00:11:45.565 [2024-11-18 19:10:03.967229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:45.565 [2024-11-18 19:10:04.074940] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:45.565 [2024-11-18 19:10:04.075105] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:45.565 [2024-11-18 19:10:04.075139] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:45.565 [2024-11-18 19:10:04.075152] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:45.565 [2024-11-18 19:10:04.075206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:45.565 [2024-11-18 19:10:04.075257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:45.565 [2024-11-18 19:10:04.075306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:45.565 [2024-11-18 19:10:04.075312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:46.498 19:10:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:46.498 19:10:04 -- common/autotest_common.sh@862 -- # return 0 00:11:46.498 19:10:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:46.498 19:10:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:46.498 19:10:04 -- common/autotest_common.sh@10 -- # set +x 00:11:46.498 19:10:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:46.498 19:10:04 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:46.498 19:10:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.498 19:10:04 -- common/autotest_common.sh@10 -- # set +x 00:11:46.498 19:10:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.498 19:10:04 -- target/rpc.sh@26 -- # stats='{ 00:11:46.498 "tick_rate": 2700000000, 00:11:46.498 "poll_groups": [ 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_0", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [] 00:11:46.498 }, 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_1", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [] 00:11:46.498 }, 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_2", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [] 00:11:46.498 }, 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_3", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [] 00:11:46.498 } 00:11:46.498 ] 00:11:46.498 }' 00:11:46.498 19:10:04 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:46.498 19:10:04 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:46.498 19:10:04 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:46.498 19:10:04 -- target/rpc.sh@15 -- # wc -l 00:11:46.498 19:10:05 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:46.498 19:10:05 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:46.498 19:10:05 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:46.498 19:10:05 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:46.498 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.498 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.498 [2024-11-18 19:10:05.051738] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:46.498 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.498 19:10:05 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:46.498 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.498 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.498 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.498 19:10:05 -- target/rpc.sh@33 -- # stats='{ 00:11:46.498 "tick_rate": 2700000000, 00:11:46.498 "poll_groups": [ 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_0", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [ 00:11:46.498 { 00:11:46.498 "trtype": "TCP" 00:11:46.498 } 00:11:46.498 ] 00:11:46.498 }, 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_1", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [ 00:11:46.498 { 00:11:46.498 "trtype": "TCP" 00:11:46.498 } 00:11:46.498 ] 00:11:46.498 }, 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_2", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [ 00:11:46.498 { 00:11:46.498 "trtype": "TCP" 00:11:46.498 } 00:11:46.498 ] 00:11:46.498 }, 00:11:46.498 { 00:11:46.498 "name": "nvmf_tgt_poll_group_3", 00:11:46.498 "admin_qpairs": 0, 00:11:46.498 "io_qpairs": 0, 00:11:46.498 "current_admin_qpairs": 0, 00:11:46.498 "current_io_qpairs": 0, 00:11:46.498 "pending_bdev_io": 0, 00:11:46.498 "completed_nvme_io": 0, 00:11:46.498 "transports": [ 00:11:46.498 { 00:11:46.498 "trtype": "TCP" 00:11:46.498 } 00:11:46.498 ] 00:11:46.498 } 00:11:46.498 ] 00:11:46.498 }' 00:11:46.498 19:10:05 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:46.498 19:10:05 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:46.498 19:10:05 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:46.498 19:10:05 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:46.757 19:10:05 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:46.757 19:10:05 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:46.757 19:10:05 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:46.757 19:10:05 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:46.757 19:10:05 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:46.757 19:10:05 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:46.757 19:10:05 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:46.757 19:10:05 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:46.757 19:10:05 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:46.757 19:10:05 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:46.757 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.757 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.757 Malloc1 00:11:46.757 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.757 19:10:05 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:46.757 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.757 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.757 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.757 19:10:05 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:46.757 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.757 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.757 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.757 19:10:05 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:46.757 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.757 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.757 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.757 19:10:05 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:46.757 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.757 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.757 [2024-11-18 19:10:05.208603] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:46.757 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.757 19:10:05 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:46.757 19:10:05 -- common/autotest_common.sh@650 -- # local es=0 00:11:46.757 19:10:05 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:46.757 19:10:05 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:46.757 19:10:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:46.757 19:10:05 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:46.757 19:10:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:46.757 19:10:05 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:46.757 19:10:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:46.757 19:10:05 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:46.757 19:10:05 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:46.757 19:10:05 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:46.757 [2024-11-18 19:10:05.231048] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:46.757 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:46.757 could not add new controller: failed to write to nvme-fabrics device 00:11:46.757 19:10:05 -- common/autotest_common.sh@653 -- # es=1 00:11:46.757 19:10:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:46.757 19:10:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:46.757 19:10:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:46.757 19:10:05 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:46.757 19:10:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:46.757 19:10:05 -- common/autotest_common.sh@10 -- # set +x 00:11:46.757 19:10:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:46.757 19:10:05 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:47.370 19:10:05 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:47.370 19:10:05 -- common/autotest_common.sh@1187 -- # local i=0 00:11:47.370 19:10:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:47.370 19:10:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:47.370 19:10:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:49.268 19:10:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:49.268 19:10:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:49.268 19:10:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:49.526 19:10:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:49.527 19:10:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:49.527 19:10:07 -- common/autotest_common.sh@1197 -- # return 0 00:11:49.527 19:10:07 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:49.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.527 19:10:07 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:49.527 19:10:07 -- common/autotest_common.sh@1208 -- # local i=0 00:11:49.527 19:10:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:49.527 19:10:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:49.527 19:10:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:49.527 19:10:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:49.527 19:10:07 -- common/autotest_common.sh@1220 -- # return 0 00:11:49.527 19:10:07 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:49.527 19:10:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.527 19:10:07 -- common/autotest_common.sh@10 -- # set +x 00:11:49.527 19:10:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.527 19:10:08 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:49.527 19:10:08 -- common/autotest_common.sh@650 -- # local es=0 00:11:49.527 19:10:08 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:49.527 19:10:08 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:49.527 19:10:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.527 19:10:08 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:49.527 19:10:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.527 19:10:08 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:49.527 19:10:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.527 19:10:08 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:49.527 19:10:08 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:49.527 19:10:08 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:49.527 [2024-11-18 19:10:08.024088] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:49.527 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:49.527 could not add new controller: failed to write to nvme-fabrics device 00:11:49.527 19:10:08 -- common/autotest_common.sh@653 -- # es=1 00:11:49.527 19:10:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:49.527 19:10:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:49.527 19:10:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:49.527 19:10:08 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:49.527 19:10:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:49.527 19:10:08 -- common/autotest_common.sh@10 -- # set +x 00:11:49.527 19:10:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:49.527 19:10:08 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.461 19:10:08 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:50.461 19:10:08 -- common/autotest_common.sh@1187 -- # local i=0 00:11:50.461 19:10:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:50.461 19:10:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:50.461 19:10:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:52.357 19:10:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:52.357 19:10:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:52.357 19:10:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:52.357 19:10:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:52.357 19:10:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:52.357 19:10:10 -- common/autotest_common.sh@1197 -- # return 0 00:11:52.357 19:10:10 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:52.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.357 19:10:10 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:52.357 19:10:10 -- common/autotest_common.sh@1208 -- # local i=0 00:11:52.357 19:10:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:52.357 19:10:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.357 19:10:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:52.357 19:10:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.357 19:10:10 -- common/autotest_common.sh@1220 -- # return 0 00:11:52.357 19:10:10 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:52.357 19:10:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.357 19:10:10 -- common/autotest_common.sh@10 -- # set +x 00:11:52.357 19:10:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.357 19:10:10 -- target/rpc.sh@81 -- # seq 1 5 00:11:52.357 19:10:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:52.357 19:10:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:52.357 19:10:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.357 19:10:10 -- common/autotest_common.sh@10 -- # set +x 00:11:52.357 19:10:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.357 19:10:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:52.357 19:10:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.357 19:10:10 -- common/autotest_common.sh@10 -- # set +x 00:11:52.357 [2024-11-18 19:10:10.886152] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:52.357 19:10:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.357 19:10:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:52.357 19:10:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.357 19:10:10 -- common/autotest_common.sh@10 -- # set +x 00:11:52.357 19:10:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.357 19:10:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:52.357 19:10:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:52.357 19:10:10 -- common/autotest_common.sh@10 -- # set +x 00:11:52.357 19:10:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:52.358 19:10:10 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:53.291 19:10:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:53.291 19:10:11 -- common/autotest_common.sh@1187 -- # local i=0 00:11:53.291 19:10:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:53.291 19:10:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:53.291 19:10:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:55.191 19:10:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:55.191 19:10:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:55.191 19:10:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:55.191 19:10:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:55.191 19:10:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:55.191 19:10:13 -- common/autotest_common.sh@1197 -- # return 0 00:11:55.191 19:10:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:55.191 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.191 19:10:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:55.191 19:10:13 -- common/autotest_common.sh@1208 -- # local i=0 00:11:55.191 19:10:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:55.191 19:10:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.191 19:10:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:55.191 19:10:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:55.191 19:10:13 -- common/autotest_common.sh@1220 -- # return 0 00:11:55.191 19:10:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:55.191 19:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.191 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:11:55.191 19:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.191 19:10:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:55.191 19:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.191 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:11:55.191 19:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.191 19:10:13 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:55.191 19:10:13 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:55.191 19:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.191 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:11:55.191 19:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.191 19:10:13 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:55.191 19:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.191 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:11:55.191 [2024-11-18 19:10:13.719729] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:55.191 19:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.191 19:10:13 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:55.191 19:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.191 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:11:55.191 19:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.191 19:10:13 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:55.191 19:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.191 19:10:13 -- common/autotest_common.sh@10 -- # set +x 00:11:55.191 19:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.191 19:10:13 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:55.757 19:10:14 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:55.757 19:10:14 -- common/autotest_common.sh@1187 -- # local i=0 00:11:55.757 19:10:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:55.757 19:10:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:55.757 19:10:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:58.283 19:10:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:58.283 19:10:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:58.283 19:10:16 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:58.283 19:10:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:58.283 19:10:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:58.283 19:10:16 -- common/autotest_common.sh@1197 -- # return 0 00:11:58.283 19:10:16 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:58.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.283 19:10:16 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:58.283 19:10:16 -- common/autotest_common.sh@1208 -- # local i=0 00:11:58.283 19:10:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:58.283 19:10:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.283 19:10:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:58.283 19:10:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.283 19:10:16 -- common/autotest_common.sh@1220 -- # return 0 00:11:58.283 19:10:16 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:58.283 19:10:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.283 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.283 19:10:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.283 19:10:16 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:58.283 19:10:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.283 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.283 19:10:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.283 19:10:16 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:58.283 19:10:16 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:58.283 19:10:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.283 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.283 19:10:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.283 19:10:16 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:58.283 19:10:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.283 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.283 [2024-11-18 19:10:16.499580] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:58.283 19:10:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.283 19:10:16 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:58.283 19:10:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.283 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.283 19:10:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.283 19:10:16 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:58.283 19:10:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.283 19:10:16 -- common/autotest_common.sh@10 -- # set +x 00:11:58.283 19:10:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.283 19:10:16 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.541 19:10:17 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:58.541 19:10:17 -- common/autotest_common.sh@1187 -- # local i=0 00:11:58.541 19:10:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:58.541 19:10:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:58.541 19:10:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:01.066 19:10:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:01.066 19:10:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:01.066 19:10:19 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:01.066 19:10:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:01.066 19:10:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:01.066 19:10:19 -- common/autotest_common.sh@1197 -- # return 0 00:12:01.066 19:10:19 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:01.066 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.066 19:10:19 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:01.066 19:10:19 -- common/autotest_common.sh@1208 -- # local i=0 00:12:01.066 19:10:19 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:01.066 19:10:19 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.066 19:10:19 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:01.066 19:10:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:01.066 19:10:19 -- common/autotest_common.sh@1220 -- # return 0 00:12:01.066 19:10:19 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:01.066 19:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.066 19:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:01.066 19:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.066 19:10:19 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:01.066 19:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.066 19:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:01.066 19:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.066 19:10:19 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:01.066 19:10:19 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:01.066 19:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.066 19:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:01.066 19:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.066 19:10:19 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.066 19:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.066 19:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:01.066 [2024-11-18 19:10:19.279562] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.066 19:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.066 19:10:19 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:01.066 19:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.066 19:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:01.066 19:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.066 19:10:19 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:01.066 19:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.066 19:10:19 -- common/autotest_common.sh@10 -- # set +x 00:12:01.066 19:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.066 19:10:19 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.630 19:10:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:01.630 19:10:19 -- common/autotest_common.sh@1187 -- # local i=0 00:12:01.630 19:10:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:01.630 19:10:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:01.630 19:10:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:03.528 19:10:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:03.528 19:10:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:03.528 19:10:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:03.528 19:10:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:03.528 19:10:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:03.528 19:10:22 -- common/autotest_common.sh@1197 -- # return 0 00:12:03.528 19:10:22 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:03.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.528 19:10:22 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:03.528 19:10:22 -- common/autotest_common.sh@1208 -- # local i=0 00:12:03.528 19:10:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:03.528 19:10:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.528 19:10:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:03.528 19:10:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:03.528 19:10:22 -- common/autotest_common.sh@1220 -- # return 0 00:12:03.528 19:10:22 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:03.528 19:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.528 19:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:03.528 19:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.528 19:10:22 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:03.528 19:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.528 19:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:03.528 19:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.528 19:10:22 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:03.528 19:10:22 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:03.528 19:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.528 19:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:03.528 19:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.528 19:10:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:03.528 19:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.528 19:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:03.528 [2024-11-18 19:10:22.115702] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:03.528 19:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.528 19:10:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:03.528 19:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.528 19:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:03.528 19:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.528 19:10:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:03.528 19:10:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:03.528 19:10:22 -- common/autotest_common.sh@10 -- # set +x 00:12:03.786 19:10:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:03.786 19:10:22 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.352 19:10:22 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.352 19:10:22 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.352 19:10:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.352 19:10:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.352 19:10:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:06.251 19:10:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:06.251 19:10:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:06.251 19:10:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:06.251 19:10:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:06.251 19:10:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:06.251 19:10:24 -- common/autotest_common.sh@1197 -- # return 0 00:12:06.251 19:10:24 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:06.509 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.509 19:10:24 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:06.509 19:10:24 -- common/autotest_common.sh@1208 -- # local i=0 00:12:06.509 19:10:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:06.509 19:10:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.509 19:10:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:06.509 19:10:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.509 19:10:24 -- common/autotest_common.sh@1220 -- # return 0 00:12:06.509 19:10:24 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:06.509 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.509 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.509 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.509 19:10:24 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.509 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.509 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.509 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.509 19:10:24 -- target/rpc.sh@99 -- # seq 1 5 00:12:06.509 19:10:24 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.509 19:10:24 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.509 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.509 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.509 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.509 19:10:24 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.509 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.509 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 [2024-11-18 19:10:24.951199] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.510 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:24 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.510 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:24 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:24 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.510 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:24 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:24 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.510 19:10:24 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.510 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:24 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.510 19:10:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:24 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 [2024-11-18 19:10:24.999257] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.510 19:10:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 [2024-11-18 19:10:25.047434] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.510 19:10:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 [2024-11-18 19:10:25.095615] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.510 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.510 19:10:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.510 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.510 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:06.769 19:10:25 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 [2024-11-18 19:10:25.143788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:06.769 19:10:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.769 19:10:25 -- common/autotest_common.sh@10 -- # set +x 00:12:06.769 19:10:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.769 19:10:25 -- target/rpc.sh@110 -- # stats='{ 00:12:06.769 "tick_rate": 2700000000, 00:12:06.769 "poll_groups": [ 00:12:06.769 { 00:12:06.769 "name": "nvmf_tgt_poll_group_0", 00:12:06.769 "admin_qpairs": 2, 00:12:06.769 "io_qpairs": 84, 00:12:06.769 "current_admin_qpairs": 0, 00:12:06.769 "current_io_qpairs": 0, 00:12:06.769 "pending_bdev_io": 0, 00:12:06.769 "completed_nvme_io": 185, 00:12:06.769 "transports": [ 00:12:06.769 { 00:12:06.769 "trtype": "TCP" 00:12:06.769 } 00:12:06.769 ] 00:12:06.769 }, 00:12:06.769 { 00:12:06.769 "name": "nvmf_tgt_poll_group_1", 00:12:06.769 "admin_qpairs": 2, 00:12:06.769 "io_qpairs": 84, 00:12:06.769 "current_admin_qpairs": 0, 00:12:06.769 "current_io_qpairs": 0, 00:12:06.769 "pending_bdev_io": 0, 00:12:06.769 "completed_nvme_io": 231, 00:12:06.769 "transports": [ 00:12:06.769 { 00:12:06.769 "trtype": "TCP" 00:12:06.769 } 00:12:06.769 ] 00:12:06.769 }, 00:12:06.769 { 00:12:06.769 "name": "nvmf_tgt_poll_group_2", 00:12:06.769 "admin_qpairs": 1, 00:12:06.769 "io_qpairs": 84, 00:12:06.769 "current_admin_qpairs": 0, 00:12:06.769 "current_io_qpairs": 0, 00:12:06.769 "pending_bdev_io": 0, 00:12:06.769 "completed_nvme_io": 182, 00:12:06.769 "transports": [ 00:12:06.769 { 00:12:06.769 "trtype": "TCP" 00:12:06.769 } 00:12:06.769 ] 00:12:06.769 }, 00:12:06.769 { 00:12:06.769 "name": "nvmf_tgt_poll_group_3", 00:12:06.769 "admin_qpairs": 2, 00:12:06.769 "io_qpairs": 84, 00:12:06.769 "current_admin_qpairs": 0, 00:12:06.769 "current_io_qpairs": 0, 00:12:06.769 "pending_bdev_io": 0, 00:12:06.769 "completed_nvme_io": 88, 00:12:06.769 "transports": [ 00:12:06.769 { 00:12:06.769 "trtype": "TCP" 00:12:06.769 } 00:12:06.769 ] 00:12:06.769 } 00:12:06.769 ] 00:12:06.769 }' 00:12:06.769 19:10:25 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:06.769 19:10:25 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:06.769 19:10:25 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:06.769 19:10:25 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:06.769 19:10:25 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:06.769 19:10:25 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:06.769 19:10:25 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:06.769 19:10:25 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:06.769 19:10:25 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:06.769 19:10:25 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:06.769 19:10:25 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:06.769 19:10:25 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:06.769 19:10:25 -- target/rpc.sh@123 -- # nvmftestfini 00:12:06.769 19:10:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:06.769 19:10:25 -- nvmf/common.sh@116 -- # sync 00:12:06.769 19:10:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:06.769 19:10:25 -- nvmf/common.sh@119 -- # set +e 00:12:06.769 19:10:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:06.769 19:10:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:06.769 rmmod nvme_tcp 00:12:06.769 rmmod nvme_fabrics 00:12:06.769 rmmod nvme_keyring 00:12:06.769 19:10:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:06.769 19:10:25 -- nvmf/common.sh@123 -- # set -e 00:12:06.769 19:10:25 -- nvmf/common.sh@124 -- # return 0 00:12:06.769 19:10:25 -- nvmf/common.sh@477 -- # '[' -n 3387914 ']' 00:12:06.769 19:10:25 -- nvmf/common.sh@478 -- # killprocess 3387914 00:12:06.769 19:10:25 -- common/autotest_common.sh@936 -- # '[' -z 3387914 ']' 00:12:06.769 19:10:25 -- common/autotest_common.sh@940 -- # kill -0 3387914 00:12:06.769 19:10:25 -- common/autotest_common.sh@941 -- # uname 00:12:06.769 19:10:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:06.769 19:10:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3387914 00:12:07.028 19:10:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:07.028 19:10:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:07.028 19:10:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3387914' 00:12:07.028 killing process with pid 3387914 00:12:07.028 19:10:25 -- common/autotest_common.sh@955 -- # kill 3387914 00:12:07.028 19:10:25 -- common/autotest_common.sh@960 -- # wait 3387914 00:12:07.286 19:10:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:07.286 19:10:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:07.286 19:10:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:07.286 19:10:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:07.286 19:10:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:07.286 19:10:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:07.286 19:10:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:07.286 19:10:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.189 19:10:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:09.189 00:12:09.189 real 0m26.196s 00:12:09.189 user 1m25.785s 00:12:09.189 sys 0m4.262s 00:12:09.189 19:10:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:09.189 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:12:09.189 ************************************ 00:12:09.189 END TEST nvmf_rpc 00:12:09.189 ************************************ 00:12:09.189 19:10:27 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:09.189 19:10:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:09.190 19:10:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:09.190 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:12:09.190 ************************************ 00:12:09.190 START TEST nvmf_invalid 00:12:09.190 ************************************ 00:12:09.190 19:10:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:09.448 * Looking for test storage... 00:12:09.448 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:09.448 19:10:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:09.448 19:10:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:09.448 19:10:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:09.448 19:10:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:09.448 19:10:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:09.448 19:10:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:09.448 19:10:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:09.448 19:10:27 -- scripts/common.sh@335 -- # IFS=.-: 00:12:09.448 19:10:27 -- scripts/common.sh@335 -- # read -ra ver1 00:12:09.448 19:10:27 -- scripts/common.sh@336 -- # IFS=.-: 00:12:09.448 19:10:27 -- scripts/common.sh@336 -- # read -ra ver2 00:12:09.448 19:10:27 -- scripts/common.sh@337 -- # local 'op=<' 00:12:09.448 19:10:27 -- scripts/common.sh@339 -- # ver1_l=2 00:12:09.448 19:10:27 -- scripts/common.sh@340 -- # ver2_l=1 00:12:09.448 19:10:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:09.448 19:10:27 -- scripts/common.sh@343 -- # case "$op" in 00:12:09.448 19:10:27 -- scripts/common.sh@344 -- # : 1 00:12:09.448 19:10:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:09.448 19:10:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:09.448 19:10:27 -- scripts/common.sh@364 -- # decimal 1 00:12:09.448 19:10:27 -- scripts/common.sh@352 -- # local d=1 00:12:09.448 19:10:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:09.448 19:10:27 -- scripts/common.sh@354 -- # echo 1 00:12:09.448 19:10:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:09.449 19:10:27 -- scripts/common.sh@365 -- # decimal 2 00:12:09.449 19:10:27 -- scripts/common.sh@352 -- # local d=2 00:12:09.449 19:10:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:09.449 19:10:27 -- scripts/common.sh@354 -- # echo 2 00:12:09.449 19:10:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:09.449 19:10:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:09.449 19:10:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:09.449 19:10:27 -- scripts/common.sh@367 -- # return 0 00:12:09.449 19:10:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:09.449 19:10:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:09.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.449 --rc genhtml_branch_coverage=1 00:12:09.449 --rc genhtml_function_coverage=1 00:12:09.449 --rc genhtml_legend=1 00:12:09.449 --rc geninfo_all_blocks=1 00:12:09.449 --rc geninfo_unexecuted_blocks=1 00:12:09.449 00:12:09.449 ' 00:12:09.449 19:10:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:09.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.449 --rc genhtml_branch_coverage=1 00:12:09.449 --rc genhtml_function_coverage=1 00:12:09.449 --rc genhtml_legend=1 00:12:09.449 --rc geninfo_all_blocks=1 00:12:09.449 --rc geninfo_unexecuted_blocks=1 00:12:09.449 00:12:09.449 ' 00:12:09.449 19:10:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:09.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.449 --rc genhtml_branch_coverage=1 00:12:09.449 --rc genhtml_function_coverage=1 00:12:09.449 --rc genhtml_legend=1 00:12:09.449 --rc geninfo_all_blocks=1 00:12:09.449 --rc geninfo_unexecuted_blocks=1 00:12:09.449 00:12:09.449 ' 00:12:09.449 19:10:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:09.449 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:09.449 --rc genhtml_branch_coverage=1 00:12:09.449 --rc genhtml_function_coverage=1 00:12:09.449 --rc genhtml_legend=1 00:12:09.449 --rc geninfo_all_blocks=1 00:12:09.449 --rc geninfo_unexecuted_blocks=1 00:12:09.449 00:12:09.449 ' 00:12:09.449 19:10:27 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:09.449 19:10:27 -- nvmf/common.sh@7 -- # uname -s 00:12:09.449 19:10:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:09.449 19:10:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:09.449 19:10:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:09.449 19:10:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:09.449 19:10:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:09.449 19:10:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:09.449 19:10:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:09.449 19:10:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:09.449 19:10:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:09.449 19:10:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:09.449 19:10:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.449 19:10:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:09.449 19:10:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:09.449 19:10:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:09.449 19:10:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:09.449 19:10:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:09.449 19:10:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:09.449 19:10:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:09.449 19:10:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:09.449 19:10:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.449 19:10:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.449 19:10:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.449 19:10:27 -- paths/export.sh@5 -- # export PATH 00:12:09.449 19:10:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:09.449 19:10:27 -- nvmf/common.sh@46 -- # : 0 00:12:09.449 19:10:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:09.449 19:10:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:09.449 19:10:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:09.449 19:10:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:09.449 19:10:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:09.449 19:10:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:09.449 19:10:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:09.449 19:10:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:09.449 19:10:27 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:09.449 19:10:27 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:09.449 19:10:27 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:09.449 19:10:27 -- target/invalid.sh@14 -- # target=foobar 00:12:09.449 19:10:27 -- target/invalid.sh@16 -- # RANDOM=0 00:12:09.449 19:10:27 -- target/invalid.sh@34 -- # nvmftestinit 00:12:09.449 19:10:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:09.449 19:10:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:09.449 19:10:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:09.449 19:10:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:09.449 19:10:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:09.449 19:10:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:09.449 19:10:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:09.449 19:10:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:09.449 19:10:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:09.449 19:10:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:09.449 19:10:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:09.449 19:10:27 -- common/autotest_common.sh@10 -- # set +x 00:12:11.349 19:10:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.349 19:10:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:11.349 19:10:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:11.349 19:10:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:11.349 19:10:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:11.349 19:10:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:11.349 19:10:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:11.349 19:10:29 -- nvmf/common.sh@294 -- # net_devs=() 00:12:11.349 19:10:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:11.349 19:10:29 -- nvmf/common.sh@295 -- # e810=() 00:12:11.349 19:10:29 -- nvmf/common.sh@295 -- # local -ga e810 00:12:11.349 19:10:29 -- nvmf/common.sh@296 -- # x722=() 00:12:11.349 19:10:29 -- nvmf/common.sh@296 -- # local -ga x722 00:12:11.349 19:10:29 -- nvmf/common.sh@297 -- # mlx=() 00:12:11.349 19:10:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:11.349 19:10:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.349 19:10:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.349 19:10:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.349 19:10:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.350 19:10:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:11.350 19:10:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:11.350 19:10:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:11.350 19:10:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.350 19:10:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:11.350 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:11.350 19:10:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:11.350 19:10:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:11.350 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:11.350 19:10:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:11.350 19:10:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.350 19:10:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.350 19:10:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.350 19:10:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.350 19:10:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:11.350 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:11.350 19:10:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.350 19:10:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:11.350 19:10:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.350 19:10:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:11.350 19:10:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.350 19:10:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:11.350 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:11.350 19:10:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.350 19:10:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:11.350 19:10:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:11.350 19:10:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:11.350 19:10:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:11.350 19:10:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:11.350 19:10:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:11.350 19:10:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:11.350 19:10:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:11.350 19:10:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:11.350 19:10:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:11.350 19:10:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:11.350 19:10:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:11.350 19:10:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:11.350 19:10:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:11.350 19:10:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:11.350 19:10:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:11.350 19:10:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:11.608 19:10:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:11.608 19:10:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:11.608 19:10:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:11.608 19:10:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:11.608 19:10:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:11.608 19:10:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:11.608 19:10:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:11.608 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:11.608 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:12:11.608 00:12:11.608 --- 10.0.0.2 ping statistics --- 00:12:11.608 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.608 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:12:11.608 19:10:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:11.608 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:11.608 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:12:11.608 00:12:11.608 --- 10.0.0.1 ping statistics --- 00:12:11.608 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:11.608 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:12:11.608 19:10:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:11.608 19:10:30 -- nvmf/common.sh@410 -- # return 0 00:12:11.608 19:10:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:11.608 19:10:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:11.608 19:10:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:11.608 19:10:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:11.608 19:10:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:11.608 19:10:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:11.608 19:10:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:11.608 19:10:30 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:11.608 19:10:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:11.608 19:10:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:11.608 19:10:30 -- common/autotest_common.sh@10 -- # set +x 00:12:11.608 19:10:30 -- nvmf/common.sh@469 -- # nvmfpid=3392630 00:12:11.608 19:10:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:11.609 19:10:30 -- nvmf/common.sh@470 -- # waitforlisten 3392630 00:12:11.609 19:10:30 -- common/autotest_common.sh@829 -- # '[' -z 3392630 ']' 00:12:11.609 19:10:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:11.609 19:10:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:11.609 19:10:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:11.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:11.609 19:10:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:11.609 19:10:30 -- common/autotest_common.sh@10 -- # set +x 00:12:11.609 [2024-11-18 19:10:30.124496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:11.609 [2024-11-18 19:10:30.124572] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:11.609 EAL: No free 2048 kB hugepages reported on node 1 00:12:11.609 [2024-11-18 19:10:30.195845] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:11.867 [2024-11-18 19:10:30.319425] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:11.867 [2024-11-18 19:10:30.319596] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:11.867 [2024-11-18 19:10:30.319625] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:11.868 [2024-11-18 19:10:30.319641] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:11.868 [2024-11-18 19:10:30.319718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:11.868 [2024-11-18 19:10:30.319787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:11.868 [2024-11-18 19:10:30.319840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:11.868 [2024-11-18 19:10:30.319843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:12.800 19:10:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:12.800 19:10:31 -- common/autotest_common.sh@862 -- # return 0 00:12:12.800 19:10:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:12.800 19:10:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:12.800 19:10:31 -- common/autotest_common.sh@10 -- # set +x 00:12:12.800 19:10:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:12.800 19:10:31 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:12.800 19:10:31 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode10292 00:12:13.058 [2024-11-18 19:10:31.462165] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:13.058 19:10:31 -- target/invalid.sh@40 -- # out='request: 00:12:13.058 { 00:12:13.058 "nqn": "nqn.2016-06.io.spdk:cnode10292", 00:12:13.058 "tgt_name": "foobar", 00:12:13.058 "method": "nvmf_create_subsystem", 00:12:13.058 "req_id": 1 00:12:13.058 } 00:12:13.058 Got JSON-RPC error response 00:12:13.058 response: 00:12:13.058 { 00:12:13.058 "code": -32603, 00:12:13.058 "message": "Unable to find target foobar" 00:12:13.058 }' 00:12:13.058 19:10:31 -- target/invalid.sh@41 -- # [[ request: 00:12:13.058 { 00:12:13.058 "nqn": "nqn.2016-06.io.spdk:cnode10292", 00:12:13.058 "tgt_name": "foobar", 00:12:13.058 "method": "nvmf_create_subsystem", 00:12:13.058 "req_id": 1 00:12:13.058 } 00:12:13.058 Got JSON-RPC error response 00:12:13.058 response: 00:12:13.058 { 00:12:13.058 "code": -32603, 00:12:13.058 "message": "Unable to find target foobar" 00:12:13.058 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:13.058 19:10:31 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:13.058 19:10:31 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode7132 00:12:13.315 [2024-11-18 19:10:31.763151] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7132: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:13.315 19:10:31 -- target/invalid.sh@45 -- # out='request: 00:12:13.315 { 00:12:13.315 "nqn": "nqn.2016-06.io.spdk:cnode7132", 00:12:13.315 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:13.315 "method": "nvmf_create_subsystem", 00:12:13.315 "req_id": 1 00:12:13.315 } 00:12:13.315 Got JSON-RPC error response 00:12:13.315 response: 00:12:13.315 { 00:12:13.315 "code": -32602, 00:12:13.315 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:13.315 }' 00:12:13.315 19:10:31 -- target/invalid.sh@46 -- # [[ request: 00:12:13.315 { 00:12:13.316 "nqn": "nqn.2016-06.io.spdk:cnode7132", 00:12:13.316 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:13.316 "method": "nvmf_create_subsystem", 00:12:13.316 "req_id": 1 00:12:13.316 } 00:12:13.316 Got JSON-RPC error response 00:12:13.316 response: 00:12:13.316 { 00:12:13.316 "code": -32602, 00:12:13.316 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:13.316 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:13.316 19:10:31 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:13.316 19:10:31 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode301 00:12:13.574 [2024-11-18 19:10:32.019971] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode301: invalid model number 'SPDK_Controller' 00:12:13.574 19:10:32 -- target/invalid.sh@50 -- # out='request: 00:12:13.574 { 00:12:13.574 "nqn": "nqn.2016-06.io.spdk:cnode301", 00:12:13.574 "model_number": "SPDK_Controller\u001f", 00:12:13.574 "method": "nvmf_create_subsystem", 00:12:13.574 "req_id": 1 00:12:13.574 } 00:12:13.574 Got JSON-RPC error response 00:12:13.574 response: 00:12:13.574 { 00:12:13.574 "code": -32602, 00:12:13.574 "message": "Invalid MN SPDK_Controller\u001f" 00:12:13.574 }' 00:12:13.574 19:10:32 -- target/invalid.sh@51 -- # [[ request: 00:12:13.574 { 00:12:13.574 "nqn": "nqn.2016-06.io.spdk:cnode301", 00:12:13.574 "model_number": "SPDK_Controller\u001f", 00:12:13.574 "method": "nvmf_create_subsystem", 00:12:13.574 "req_id": 1 00:12:13.574 } 00:12:13.574 Got JSON-RPC error response 00:12:13.574 response: 00:12:13.574 { 00:12:13.574 "code": -32602, 00:12:13.574 "message": "Invalid MN SPDK_Controller\u001f" 00:12:13.574 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:13.574 19:10:32 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:13.574 19:10:32 -- target/invalid.sh@19 -- # local length=21 ll 00:12:13.574 19:10:32 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:13.574 19:10:32 -- target/invalid.sh@21 -- # local chars 00:12:13.574 19:10:32 -- target/invalid.sh@22 -- # local string 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # printf %x 42 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # string+='*' 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # printf %x 111 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # string+=o 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # printf %x 104 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x68' 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # string+=h 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # printf %x 65 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # string+=A 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # printf %x 89 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # string+=Y 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.574 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.574 19:10:32 -- target/invalid.sh@25 -- # printf %x 69 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=E 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 115 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=s 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 70 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=F 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 92 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+='\' 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 96 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+='`' 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 118 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=v 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 123 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+='{' 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 36 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x24' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+='$' 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 64 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=@ 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 119 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=w 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 126 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+='~' 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 120 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=x 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 56 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=8 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 38 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+='&' 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 43 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=+ 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # printf %x 103 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:13.575 19:10:32 -- target/invalid.sh@25 -- # string+=g 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.575 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.575 19:10:32 -- target/invalid.sh@28 -- # [[ * == \- ]] 00:12:13.575 19:10:32 -- target/invalid.sh@31 -- # echo '*ohAYEsF\`v{$@w~x8&+g' 00:12:13.575 19:10:32 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '*ohAYEsF\`v{$@w~x8&+g' nqn.2016-06.io.spdk:cnode26870 00:12:13.833 [2024-11-18 19:10:32.328972] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26870: invalid serial number '*ohAYEsF\`v{$@w~x8&+g' 00:12:13.833 19:10:32 -- target/invalid.sh@54 -- # out='request: 00:12:13.833 { 00:12:13.833 "nqn": "nqn.2016-06.io.spdk:cnode26870", 00:12:13.833 "serial_number": "*ohAYEsF\\`v{$@w~x8&+g", 00:12:13.833 "method": "nvmf_create_subsystem", 00:12:13.833 "req_id": 1 00:12:13.833 } 00:12:13.833 Got JSON-RPC error response 00:12:13.833 response: 00:12:13.833 { 00:12:13.833 "code": -32602, 00:12:13.833 "message": "Invalid SN *ohAYEsF\\`v{$@w~x8&+g" 00:12:13.833 }' 00:12:13.833 19:10:32 -- target/invalid.sh@55 -- # [[ request: 00:12:13.833 { 00:12:13.833 "nqn": "nqn.2016-06.io.spdk:cnode26870", 00:12:13.834 "serial_number": "*ohAYEsF\\`v{$@w~x8&+g", 00:12:13.834 "method": "nvmf_create_subsystem", 00:12:13.834 "req_id": 1 00:12:13.834 } 00:12:13.834 Got JSON-RPC error response 00:12:13.834 response: 00:12:13.834 { 00:12:13.834 "code": -32602, 00:12:13.834 "message": "Invalid SN *ohAYEsF\\`v{$@w~x8&+g" 00:12:13.834 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:13.834 19:10:32 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:13.834 19:10:32 -- target/invalid.sh@19 -- # local length=41 ll 00:12:13.834 19:10:32 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:13.834 19:10:32 -- target/invalid.sh@21 -- # local chars 00:12:13.834 19:10:32 -- target/invalid.sh@22 -- # local string 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 71 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=G 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 92 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+='\' 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 84 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=T 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 34 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+='"' 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 87 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=W 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 117 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=u 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 77 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=M 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 46 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=. 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 76 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=L 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 62 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+='>' 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 82 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=R 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 35 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+='#' 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 57 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=9 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 38 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+='&' 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 44 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=, 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 117 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=u 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 64 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=@ 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 75 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=K 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 114 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=r 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 87 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=W 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 92 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+='\' 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 113 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=q 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 116 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # string+=t 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:13.834 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:13.834 19:10:32 -- target/invalid.sh@25 -- # printf %x 82 00:12:13.835 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:14.092 19:10:32 -- target/invalid.sh@25 -- # string+=R 00:12:14.092 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.092 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.092 19:10:32 -- target/invalid.sh@25 -- # printf %x 72 00:12:14.092 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:14.092 19:10:32 -- target/invalid.sh@25 -- # string+=H 00:12:14.092 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.092 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 95 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=_ 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 115 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=s 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 123 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+='{' 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 109 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=m 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 78 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=N 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 106 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=j 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 119 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=w 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 71 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=G 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 117 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=u 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 124 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+='|' 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 39 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=\' 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 111 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=o 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 88 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=X 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 63 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+='?' 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 122 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=z 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # printf %x 113 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:14.093 19:10:32 -- target/invalid.sh@25 -- # string+=q 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.093 19:10:32 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.093 19:10:32 -- target/invalid.sh@28 -- # [[ G == \- ]] 00:12:14.093 19:10:32 -- target/invalid.sh@31 -- # echo 'G\T"WuM.L>R#9&,u@KrW\qtRH_s{mNjwGu|'\''oX?zq' 00:12:14.093 19:10:32 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'G\T"WuM.L>R#9&,u@KrW\qtRH_s{mNjwGu|'\''oX?zq' nqn.2016-06.io.spdk:cnode3544 00:12:14.351 [2024-11-18 19:10:32.722252] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3544: invalid model number 'G\T"WuM.L>R#9&,u@KrW\qtRH_s{mNjwGu|'oX?zq' 00:12:14.351 19:10:32 -- target/invalid.sh@58 -- # out='request: 00:12:14.351 { 00:12:14.351 "nqn": "nqn.2016-06.io.spdk:cnode3544", 00:12:14.351 "model_number": "G\\T\"WuM.L>R#9&,u@KrW\\qtRH_s{mNjwGu|'\''oX?zq", 00:12:14.351 "method": "nvmf_create_subsystem", 00:12:14.351 "req_id": 1 00:12:14.351 } 00:12:14.351 Got JSON-RPC error response 00:12:14.351 response: 00:12:14.351 { 00:12:14.351 "code": -32602, 00:12:14.351 "message": "Invalid MN G\\T\"WuM.L>R#9&,u@KrW\\qtRH_s{mNjwGu|'\''oX?zq" 00:12:14.351 }' 00:12:14.351 19:10:32 -- target/invalid.sh@59 -- # [[ request: 00:12:14.351 { 00:12:14.351 "nqn": "nqn.2016-06.io.spdk:cnode3544", 00:12:14.351 "model_number": "G\\T\"WuM.L>R#9&,u@KrW\\qtRH_s{mNjwGu|'oX?zq", 00:12:14.351 "method": "nvmf_create_subsystem", 00:12:14.351 "req_id": 1 00:12:14.351 } 00:12:14.351 Got JSON-RPC error response 00:12:14.351 response: 00:12:14.351 { 00:12:14.351 "code": -32602, 00:12:14.351 "message": "Invalid MN G\\T\"WuM.L>R#9&,u@KrW\\qtRH_s{mNjwGu|'oX?zq" 00:12:14.351 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:14.351 19:10:32 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:14.608 [2024-11-18 19:10:32.979179] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:14.608 19:10:33 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:14.866 19:10:33 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:14.866 19:10:33 -- target/invalid.sh@67 -- # echo '' 00:12:14.866 19:10:33 -- target/invalid.sh@67 -- # head -n 1 00:12:14.866 19:10:33 -- target/invalid.sh@67 -- # IP= 00:12:14.866 19:10:33 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:15.124 [2024-11-18 19:10:33.517099] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:15.124 19:10:33 -- target/invalid.sh@69 -- # out='request: 00:12:15.124 { 00:12:15.124 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:15.124 "listen_address": { 00:12:15.124 "trtype": "tcp", 00:12:15.124 "traddr": "", 00:12:15.124 "trsvcid": "4421" 00:12:15.124 }, 00:12:15.124 "method": "nvmf_subsystem_remove_listener", 00:12:15.124 "req_id": 1 00:12:15.124 } 00:12:15.124 Got JSON-RPC error response 00:12:15.124 response: 00:12:15.124 { 00:12:15.124 "code": -32602, 00:12:15.124 "message": "Invalid parameters" 00:12:15.124 }' 00:12:15.124 19:10:33 -- target/invalid.sh@70 -- # [[ request: 00:12:15.124 { 00:12:15.124 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:15.124 "listen_address": { 00:12:15.124 "trtype": "tcp", 00:12:15.124 "traddr": "", 00:12:15.124 "trsvcid": "4421" 00:12:15.124 }, 00:12:15.124 "method": "nvmf_subsystem_remove_listener", 00:12:15.124 "req_id": 1 00:12:15.124 } 00:12:15.124 Got JSON-RPC error response 00:12:15.124 response: 00:12:15.124 { 00:12:15.124 "code": -32602, 00:12:15.124 "message": "Invalid parameters" 00:12:15.124 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:15.124 19:10:33 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14967 -i 0 00:12:15.382 [2024-11-18 19:10:33.773897] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14967: invalid cntlid range [0-65519] 00:12:15.382 19:10:33 -- target/invalid.sh@73 -- # out='request: 00:12:15.382 { 00:12:15.382 "nqn": "nqn.2016-06.io.spdk:cnode14967", 00:12:15.382 "min_cntlid": 0, 00:12:15.382 "method": "nvmf_create_subsystem", 00:12:15.382 "req_id": 1 00:12:15.382 } 00:12:15.382 Got JSON-RPC error response 00:12:15.382 response: 00:12:15.382 { 00:12:15.382 "code": -32602, 00:12:15.382 "message": "Invalid cntlid range [0-65519]" 00:12:15.382 }' 00:12:15.382 19:10:33 -- target/invalid.sh@74 -- # [[ request: 00:12:15.382 { 00:12:15.382 "nqn": "nqn.2016-06.io.spdk:cnode14967", 00:12:15.382 "min_cntlid": 0, 00:12:15.382 "method": "nvmf_create_subsystem", 00:12:15.382 "req_id": 1 00:12:15.382 } 00:12:15.382 Got JSON-RPC error response 00:12:15.382 response: 00:12:15.382 { 00:12:15.382 "code": -32602, 00:12:15.382 "message": "Invalid cntlid range [0-65519]" 00:12:15.382 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:15.382 19:10:33 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22588 -i 65520 00:12:15.639 [2024-11-18 19:10:34.022693] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22588: invalid cntlid range [65520-65519] 00:12:15.639 19:10:34 -- target/invalid.sh@75 -- # out='request: 00:12:15.639 { 00:12:15.639 "nqn": "nqn.2016-06.io.spdk:cnode22588", 00:12:15.639 "min_cntlid": 65520, 00:12:15.639 "method": "nvmf_create_subsystem", 00:12:15.639 "req_id": 1 00:12:15.639 } 00:12:15.639 Got JSON-RPC error response 00:12:15.639 response: 00:12:15.639 { 00:12:15.639 "code": -32602, 00:12:15.639 "message": "Invalid cntlid range [65520-65519]" 00:12:15.639 }' 00:12:15.639 19:10:34 -- target/invalid.sh@76 -- # [[ request: 00:12:15.639 { 00:12:15.639 "nqn": "nqn.2016-06.io.spdk:cnode22588", 00:12:15.639 "min_cntlid": 65520, 00:12:15.639 "method": "nvmf_create_subsystem", 00:12:15.639 "req_id": 1 00:12:15.639 } 00:12:15.639 Got JSON-RPC error response 00:12:15.639 response: 00:12:15.639 { 00:12:15.639 "code": -32602, 00:12:15.639 "message": "Invalid cntlid range [65520-65519]" 00:12:15.639 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:15.639 19:10:34 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27786 -I 0 00:12:15.897 [2024-11-18 19:10:34.279538] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27786: invalid cntlid range [1-0] 00:12:15.897 19:10:34 -- target/invalid.sh@77 -- # out='request: 00:12:15.897 { 00:12:15.897 "nqn": "nqn.2016-06.io.spdk:cnode27786", 00:12:15.897 "max_cntlid": 0, 00:12:15.897 "method": "nvmf_create_subsystem", 00:12:15.897 "req_id": 1 00:12:15.897 } 00:12:15.897 Got JSON-RPC error response 00:12:15.897 response: 00:12:15.897 { 00:12:15.897 "code": -32602, 00:12:15.897 "message": "Invalid cntlid range [1-0]" 00:12:15.897 }' 00:12:15.897 19:10:34 -- target/invalid.sh@78 -- # [[ request: 00:12:15.897 { 00:12:15.897 "nqn": "nqn.2016-06.io.spdk:cnode27786", 00:12:15.897 "max_cntlid": 0, 00:12:15.897 "method": "nvmf_create_subsystem", 00:12:15.897 "req_id": 1 00:12:15.897 } 00:12:15.897 Got JSON-RPC error response 00:12:15.897 response: 00:12:15.897 { 00:12:15.897 "code": -32602, 00:12:15.897 "message": "Invalid cntlid range [1-0]" 00:12:15.897 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:15.897 19:10:34 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24123 -I 65520 00:12:16.155 [2024-11-18 19:10:34.536410] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24123: invalid cntlid range [1-65520] 00:12:16.155 19:10:34 -- target/invalid.sh@79 -- # out='request: 00:12:16.155 { 00:12:16.155 "nqn": "nqn.2016-06.io.spdk:cnode24123", 00:12:16.155 "max_cntlid": 65520, 00:12:16.155 "method": "nvmf_create_subsystem", 00:12:16.155 "req_id": 1 00:12:16.155 } 00:12:16.155 Got JSON-RPC error response 00:12:16.155 response: 00:12:16.155 { 00:12:16.155 "code": -32602, 00:12:16.155 "message": "Invalid cntlid range [1-65520]" 00:12:16.155 }' 00:12:16.155 19:10:34 -- target/invalid.sh@80 -- # [[ request: 00:12:16.155 { 00:12:16.155 "nqn": "nqn.2016-06.io.spdk:cnode24123", 00:12:16.155 "max_cntlid": 65520, 00:12:16.155 "method": "nvmf_create_subsystem", 00:12:16.155 "req_id": 1 00:12:16.155 } 00:12:16.155 Got JSON-RPC error response 00:12:16.155 response: 00:12:16.155 { 00:12:16.155 "code": -32602, 00:12:16.155 "message": "Invalid cntlid range [1-65520]" 00:12:16.155 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:16.155 19:10:34 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode16807 -i 6 -I 5 00:12:16.412 [2024-11-18 19:10:34.805368] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16807: invalid cntlid range [6-5] 00:12:16.412 19:10:34 -- target/invalid.sh@83 -- # out='request: 00:12:16.412 { 00:12:16.412 "nqn": "nqn.2016-06.io.spdk:cnode16807", 00:12:16.412 "min_cntlid": 6, 00:12:16.412 "max_cntlid": 5, 00:12:16.412 "method": "nvmf_create_subsystem", 00:12:16.412 "req_id": 1 00:12:16.412 } 00:12:16.412 Got JSON-RPC error response 00:12:16.412 response: 00:12:16.412 { 00:12:16.412 "code": -32602, 00:12:16.412 "message": "Invalid cntlid range [6-5]" 00:12:16.412 }' 00:12:16.412 19:10:34 -- target/invalid.sh@84 -- # [[ request: 00:12:16.412 { 00:12:16.412 "nqn": "nqn.2016-06.io.spdk:cnode16807", 00:12:16.412 "min_cntlid": 6, 00:12:16.412 "max_cntlid": 5, 00:12:16.412 "method": "nvmf_create_subsystem", 00:12:16.412 "req_id": 1 00:12:16.412 } 00:12:16.412 Got JSON-RPC error response 00:12:16.412 response: 00:12:16.413 { 00:12:16.413 "code": -32602, 00:12:16.413 "message": "Invalid cntlid range [6-5]" 00:12:16.413 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:16.413 19:10:34 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:16.413 19:10:34 -- target/invalid.sh@87 -- # out='request: 00:12:16.413 { 00:12:16.413 "name": "foobar", 00:12:16.413 "method": "nvmf_delete_target", 00:12:16.413 "req_id": 1 00:12:16.413 } 00:12:16.413 Got JSON-RPC error response 00:12:16.413 response: 00:12:16.413 { 00:12:16.413 "code": -32602, 00:12:16.413 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:16.413 }' 00:12:16.413 19:10:34 -- target/invalid.sh@88 -- # [[ request: 00:12:16.413 { 00:12:16.413 "name": "foobar", 00:12:16.413 "method": "nvmf_delete_target", 00:12:16.413 "req_id": 1 00:12:16.413 } 00:12:16.413 Got JSON-RPC error response 00:12:16.413 response: 00:12:16.413 { 00:12:16.413 "code": -32602, 00:12:16.413 "message": "The specified target doesn't exist, cannot delete it." 00:12:16.413 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:16.413 19:10:34 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:16.413 19:10:34 -- target/invalid.sh@91 -- # nvmftestfini 00:12:16.413 19:10:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:16.413 19:10:34 -- nvmf/common.sh@116 -- # sync 00:12:16.413 19:10:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:16.413 19:10:34 -- nvmf/common.sh@119 -- # set +e 00:12:16.413 19:10:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:16.413 19:10:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:16.413 rmmod nvme_tcp 00:12:16.413 rmmod nvme_fabrics 00:12:16.413 rmmod nvme_keyring 00:12:16.413 19:10:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:16.413 19:10:34 -- nvmf/common.sh@123 -- # set -e 00:12:16.413 19:10:34 -- nvmf/common.sh@124 -- # return 0 00:12:16.413 19:10:34 -- nvmf/common.sh@477 -- # '[' -n 3392630 ']' 00:12:16.413 19:10:34 -- nvmf/common.sh@478 -- # killprocess 3392630 00:12:16.413 19:10:34 -- common/autotest_common.sh@936 -- # '[' -z 3392630 ']' 00:12:16.413 19:10:34 -- common/autotest_common.sh@940 -- # kill -0 3392630 00:12:16.413 19:10:34 -- common/autotest_common.sh@941 -- # uname 00:12:16.413 19:10:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:16.413 19:10:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3392630 00:12:16.706 19:10:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:16.706 19:10:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:16.706 19:10:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3392630' 00:12:16.706 killing process with pid 3392630 00:12:16.706 19:10:35 -- common/autotest_common.sh@955 -- # kill 3392630 00:12:16.706 19:10:35 -- common/autotest_common.sh@960 -- # wait 3392630 00:12:16.991 19:10:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:16.991 19:10:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:16.991 19:10:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:16.991 19:10:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:16.991 19:10:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:16.991 19:10:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:16.991 19:10:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:16.991 19:10:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:18.894 19:10:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:18.894 00:12:18.894 real 0m9.600s 00:12:18.894 user 0m23.946s 00:12:18.894 sys 0m2.431s 00:12:18.894 19:10:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:18.894 19:10:37 -- common/autotest_common.sh@10 -- # set +x 00:12:18.894 ************************************ 00:12:18.894 END TEST nvmf_invalid 00:12:18.894 ************************************ 00:12:18.894 19:10:37 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:18.894 19:10:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:18.894 19:10:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:18.894 19:10:37 -- common/autotest_common.sh@10 -- # set +x 00:12:18.894 ************************************ 00:12:18.894 START TEST nvmf_abort 00:12:18.894 ************************************ 00:12:18.894 19:10:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:18.894 * Looking for test storage... 00:12:18.894 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:18.894 19:10:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:18.894 19:10:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:18.894 19:10:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:19.152 19:10:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:19.152 19:10:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:19.152 19:10:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:19.152 19:10:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:19.152 19:10:37 -- scripts/common.sh@335 -- # IFS=.-: 00:12:19.152 19:10:37 -- scripts/common.sh@335 -- # read -ra ver1 00:12:19.152 19:10:37 -- scripts/common.sh@336 -- # IFS=.-: 00:12:19.152 19:10:37 -- scripts/common.sh@336 -- # read -ra ver2 00:12:19.152 19:10:37 -- scripts/common.sh@337 -- # local 'op=<' 00:12:19.152 19:10:37 -- scripts/common.sh@339 -- # ver1_l=2 00:12:19.152 19:10:37 -- scripts/common.sh@340 -- # ver2_l=1 00:12:19.152 19:10:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:19.152 19:10:37 -- scripts/common.sh@343 -- # case "$op" in 00:12:19.152 19:10:37 -- scripts/common.sh@344 -- # : 1 00:12:19.152 19:10:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:19.152 19:10:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:19.152 19:10:37 -- scripts/common.sh@364 -- # decimal 1 00:12:19.152 19:10:37 -- scripts/common.sh@352 -- # local d=1 00:12:19.152 19:10:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:19.152 19:10:37 -- scripts/common.sh@354 -- # echo 1 00:12:19.152 19:10:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:19.152 19:10:37 -- scripts/common.sh@365 -- # decimal 2 00:12:19.152 19:10:37 -- scripts/common.sh@352 -- # local d=2 00:12:19.152 19:10:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:19.152 19:10:37 -- scripts/common.sh@354 -- # echo 2 00:12:19.152 19:10:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:19.152 19:10:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:19.152 19:10:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:19.152 19:10:37 -- scripts/common.sh@367 -- # return 0 00:12:19.152 19:10:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:19.152 19:10:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:19.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.152 --rc genhtml_branch_coverage=1 00:12:19.152 --rc genhtml_function_coverage=1 00:12:19.152 --rc genhtml_legend=1 00:12:19.152 --rc geninfo_all_blocks=1 00:12:19.152 --rc geninfo_unexecuted_blocks=1 00:12:19.152 00:12:19.152 ' 00:12:19.152 19:10:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:19.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.152 --rc genhtml_branch_coverage=1 00:12:19.152 --rc genhtml_function_coverage=1 00:12:19.152 --rc genhtml_legend=1 00:12:19.152 --rc geninfo_all_blocks=1 00:12:19.152 --rc geninfo_unexecuted_blocks=1 00:12:19.152 00:12:19.152 ' 00:12:19.152 19:10:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:19.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.152 --rc genhtml_branch_coverage=1 00:12:19.152 --rc genhtml_function_coverage=1 00:12:19.152 --rc genhtml_legend=1 00:12:19.152 --rc geninfo_all_blocks=1 00:12:19.152 --rc geninfo_unexecuted_blocks=1 00:12:19.152 00:12:19.152 ' 00:12:19.152 19:10:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:19.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:19.152 --rc genhtml_branch_coverage=1 00:12:19.152 --rc genhtml_function_coverage=1 00:12:19.152 --rc genhtml_legend=1 00:12:19.152 --rc geninfo_all_blocks=1 00:12:19.152 --rc geninfo_unexecuted_blocks=1 00:12:19.152 00:12:19.152 ' 00:12:19.152 19:10:37 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:19.152 19:10:37 -- nvmf/common.sh@7 -- # uname -s 00:12:19.152 19:10:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:19.152 19:10:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:19.152 19:10:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:19.152 19:10:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:19.152 19:10:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:19.152 19:10:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:19.152 19:10:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:19.152 19:10:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:19.152 19:10:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:19.152 19:10:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:19.152 19:10:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:19.152 19:10:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:19.152 19:10:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:19.152 19:10:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:19.152 19:10:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:19.152 19:10:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:19.152 19:10:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:19.152 19:10:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:19.152 19:10:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:19.153 19:10:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.153 19:10:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.153 19:10:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.153 19:10:37 -- paths/export.sh@5 -- # export PATH 00:12:19.153 19:10:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:19.153 19:10:37 -- nvmf/common.sh@46 -- # : 0 00:12:19.153 19:10:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:19.153 19:10:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:19.153 19:10:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:19.153 19:10:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:19.153 19:10:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:19.153 19:10:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:19.153 19:10:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:19.153 19:10:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:19.153 19:10:37 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:19.153 19:10:37 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:19.153 19:10:37 -- target/abort.sh@14 -- # nvmftestinit 00:12:19.153 19:10:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:19.153 19:10:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:19.153 19:10:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:19.153 19:10:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:19.153 19:10:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:19.153 19:10:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:19.153 19:10:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:19.153 19:10:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:19.153 19:10:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:19.153 19:10:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:19.153 19:10:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:19.153 19:10:37 -- common/autotest_common.sh@10 -- # set +x 00:12:21.054 19:10:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:21.054 19:10:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:21.054 19:10:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:21.054 19:10:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:21.054 19:10:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:21.054 19:10:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:21.054 19:10:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:21.054 19:10:39 -- nvmf/common.sh@294 -- # net_devs=() 00:12:21.054 19:10:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:21.054 19:10:39 -- nvmf/common.sh@295 -- # e810=() 00:12:21.054 19:10:39 -- nvmf/common.sh@295 -- # local -ga e810 00:12:21.054 19:10:39 -- nvmf/common.sh@296 -- # x722=() 00:12:21.054 19:10:39 -- nvmf/common.sh@296 -- # local -ga x722 00:12:21.054 19:10:39 -- nvmf/common.sh@297 -- # mlx=() 00:12:21.054 19:10:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:21.054 19:10:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:21.054 19:10:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:21.054 19:10:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:21.054 19:10:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:21.054 19:10:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:21.054 19:10:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:21.054 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:21.054 19:10:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:21.054 19:10:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:21.054 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:21.054 19:10:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:21.054 19:10:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:21.054 19:10:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:21.054 19:10:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:21.054 19:10:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:21.054 19:10:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:21.054 19:10:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:21.054 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:21.054 19:10:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:21.054 19:10:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:21.055 19:10:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:21.055 19:10:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:21.055 19:10:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:21.055 19:10:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:21.055 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:21.055 19:10:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:21.055 19:10:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:21.055 19:10:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:21.055 19:10:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:21.055 19:10:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:21.055 19:10:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:21.055 19:10:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:21.055 19:10:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:21.055 19:10:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:21.055 19:10:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:21.055 19:10:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:21.055 19:10:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:21.055 19:10:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:21.055 19:10:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:21.055 19:10:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:21.055 19:10:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:21.055 19:10:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:21.055 19:10:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:21.055 19:10:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:21.313 19:10:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:21.313 19:10:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:21.314 19:10:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:21.314 19:10:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:21.314 19:10:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:21.314 19:10:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:21.314 19:10:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:21.314 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:21.314 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.281 ms 00:12:21.314 00:12:21.314 --- 10.0.0.2 ping statistics --- 00:12:21.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:21.314 rtt min/avg/max/mdev = 0.281/0.281/0.281/0.000 ms 00:12:21.314 19:10:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:21.314 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:21.314 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:12:21.314 00:12:21.314 --- 10.0.0.1 ping statistics --- 00:12:21.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:21.314 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:12:21.314 19:10:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:21.314 19:10:39 -- nvmf/common.sh@410 -- # return 0 00:12:21.314 19:10:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:21.314 19:10:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:21.314 19:10:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:21.314 19:10:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:21.314 19:10:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:21.314 19:10:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:21.314 19:10:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:21.314 19:10:39 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:21.314 19:10:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:21.314 19:10:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:21.314 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:12:21.314 19:10:39 -- nvmf/common.sh@469 -- # nvmfpid=3395440 00:12:21.314 19:10:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:21.314 19:10:39 -- nvmf/common.sh@470 -- # waitforlisten 3395440 00:12:21.314 19:10:39 -- common/autotest_common.sh@829 -- # '[' -z 3395440 ']' 00:12:21.314 19:10:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:21.314 19:10:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:21.314 19:10:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:21.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:21.314 19:10:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:21.314 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:12:21.314 [2024-11-18 19:10:39.840275] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:21.314 [2024-11-18 19:10:39.840347] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:21.314 EAL: No free 2048 kB hugepages reported on node 1 00:12:21.314 [2024-11-18 19:10:39.910346] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:21.572 [2024-11-18 19:10:40.036482] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:21.572 [2024-11-18 19:10:40.036666] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:21.572 [2024-11-18 19:10:40.036688] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:21.572 [2024-11-18 19:10:40.036703] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:21.572 [2024-11-18 19:10:40.036801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:21.572 [2024-11-18 19:10:40.036857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:21.572 [2024-11-18 19:10:40.036860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:22.505 19:10:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:22.505 19:10:40 -- common/autotest_common.sh@862 -- # return 0 00:12:22.505 19:10:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:22.505 19:10:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 19:10:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:22.505 19:10:40 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:22.505 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 [2024-11-18 19:10:40.934735] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:22.505 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:40 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:22.505 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 Malloc0 00:12:22.505 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:40 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:22.505 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 Delay0 00:12:22.505 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:40 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:22.505 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:40 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:22.505 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:40 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:22.505 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 [2024-11-18 19:10:41.001280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:22.505 19:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:41 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:22.505 19:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.505 19:10:41 -- common/autotest_common.sh@10 -- # set +x 00:12:22.505 19:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.505 19:10:41 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:22.505 EAL: No free 2048 kB hugepages reported on node 1 00:12:22.763 [2024-11-18 19:10:41.147955] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:24.662 Initializing NVMe Controllers 00:12:24.662 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:24.662 controller IO queue size 128 less than required 00:12:24.662 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:24.662 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:24.662 Initialization complete. Launching workers. 00:12:24.662 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34045 00:12:24.662 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34106, failed to submit 62 00:12:24.662 success 34045, unsuccess 61, failed 0 00:12:24.662 19:10:43 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:24.662 19:10:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.662 19:10:43 -- common/autotest_common.sh@10 -- # set +x 00:12:24.920 19:10:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.920 19:10:43 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:24.920 19:10:43 -- target/abort.sh@38 -- # nvmftestfini 00:12:24.920 19:10:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:24.920 19:10:43 -- nvmf/common.sh@116 -- # sync 00:12:24.920 19:10:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:24.920 19:10:43 -- nvmf/common.sh@119 -- # set +e 00:12:24.920 19:10:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:24.920 19:10:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:24.920 rmmod nvme_tcp 00:12:24.920 rmmod nvme_fabrics 00:12:24.920 rmmod nvme_keyring 00:12:24.920 19:10:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:24.920 19:10:43 -- nvmf/common.sh@123 -- # set -e 00:12:24.920 19:10:43 -- nvmf/common.sh@124 -- # return 0 00:12:24.920 19:10:43 -- nvmf/common.sh@477 -- # '[' -n 3395440 ']' 00:12:24.920 19:10:43 -- nvmf/common.sh@478 -- # killprocess 3395440 00:12:24.920 19:10:43 -- common/autotest_common.sh@936 -- # '[' -z 3395440 ']' 00:12:24.920 19:10:43 -- common/autotest_common.sh@940 -- # kill -0 3395440 00:12:24.920 19:10:43 -- common/autotest_common.sh@941 -- # uname 00:12:24.920 19:10:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:24.920 19:10:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3395440 00:12:24.920 19:10:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:24.920 19:10:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:24.920 19:10:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3395440' 00:12:24.920 killing process with pid 3395440 00:12:24.920 19:10:43 -- common/autotest_common.sh@955 -- # kill 3395440 00:12:24.920 19:10:43 -- common/autotest_common.sh@960 -- # wait 3395440 00:12:25.179 19:10:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:25.179 19:10:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:25.179 19:10:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:25.179 19:10:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:25.179 19:10:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:25.179 19:10:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.179 19:10:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:25.179 19:10:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.713 19:10:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:27.713 00:12:27.713 real 0m8.334s 00:12:27.713 user 0m13.542s 00:12:27.713 sys 0m2.635s 00:12:27.713 19:10:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:27.713 19:10:45 -- common/autotest_common.sh@10 -- # set +x 00:12:27.713 ************************************ 00:12:27.713 END TEST nvmf_abort 00:12:27.713 ************************************ 00:12:27.713 19:10:45 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:27.713 19:10:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:27.713 19:10:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:27.713 19:10:45 -- common/autotest_common.sh@10 -- # set +x 00:12:27.713 ************************************ 00:12:27.713 START TEST nvmf_ns_hotplug_stress 00:12:27.713 ************************************ 00:12:27.713 19:10:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:27.713 * Looking for test storage... 00:12:27.713 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:27.713 19:10:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:27.713 19:10:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:27.713 19:10:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:27.713 19:10:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:27.713 19:10:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:27.713 19:10:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:27.713 19:10:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:27.713 19:10:45 -- scripts/common.sh@335 -- # IFS=.-: 00:12:27.713 19:10:45 -- scripts/common.sh@335 -- # read -ra ver1 00:12:27.713 19:10:45 -- scripts/common.sh@336 -- # IFS=.-: 00:12:27.713 19:10:45 -- scripts/common.sh@336 -- # read -ra ver2 00:12:27.713 19:10:45 -- scripts/common.sh@337 -- # local 'op=<' 00:12:27.713 19:10:45 -- scripts/common.sh@339 -- # ver1_l=2 00:12:27.713 19:10:45 -- scripts/common.sh@340 -- # ver2_l=1 00:12:27.713 19:10:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:27.713 19:10:45 -- scripts/common.sh@343 -- # case "$op" in 00:12:27.713 19:10:45 -- scripts/common.sh@344 -- # : 1 00:12:27.713 19:10:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:27.713 19:10:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:27.713 19:10:45 -- scripts/common.sh@364 -- # decimal 1 00:12:27.713 19:10:45 -- scripts/common.sh@352 -- # local d=1 00:12:27.713 19:10:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:27.713 19:10:45 -- scripts/common.sh@354 -- # echo 1 00:12:27.713 19:10:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:27.713 19:10:45 -- scripts/common.sh@365 -- # decimal 2 00:12:27.713 19:10:45 -- scripts/common.sh@352 -- # local d=2 00:12:27.713 19:10:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:27.713 19:10:45 -- scripts/common.sh@354 -- # echo 2 00:12:27.713 19:10:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:27.713 19:10:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:27.713 19:10:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:27.713 19:10:45 -- scripts/common.sh@367 -- # return 0 00:12:27.713 19:10:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:27.713 19:10:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:27.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.714 --rc genhtml_branch_coverage=1 00:12:27.714 --rc genhtml_function_coverage=1 00:12:27.714 --rc genhtml_legend=1 00:12:27.714 --rc geninfo_all_blocks=1 00:12:27.714 --rc geninfo_unexecuted_blocks=1 00:12:27.714 00:12:27.714 ' 00:12:27.714 19:10:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:27.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.714 --rc genhtml_branch_coverage=1 00:12:27.714 --rc genhtml_function_coverage=1 00:12:27.714 --rc genhtml_legend=1 00:12:27.714 --rc geninfo_all_blocks=1 00:12:27.714 --rc geninfo_unexecuted_blocks=1 00:12:27.714 00:12:27.714 ' 00:12:27.714 19:10:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:27.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.714 --rc genhtml_branch_coverage=1 00:12:27.714 --rc genhtml_function_coverage=1 00:12:27.714 --rc genhtml_legend=1 00:12:27.714 --rc geninfo_all_blocks=1 00:12:27.714 --rc geninfo_unexecuted_blocks=1 00:12:27.714 00:12:27.714 ' 00:12:27.714 19:10:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:27.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.714 --rc genhtml_branch_coverage=1 00:12:27.714 --rc genhtml_function_coverage=1 00:12:27.714 --rc genhtml_legend=1 00:12:27.714 --rc geninfo_all_blocks=1 00:12:27.714 --rc geninfo_unexecuted_blocks=1 00:12:27.714 00:12:27.714 ' 00:12:27.714 19:10:45 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:27.714 19:10:45 -- nvmf/common.sh@7 -- # uname -s 00:12:27.714 19:10:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:27.714 19:10:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:27.714 19:10:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:27.714 19:10:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:27.714 19:10:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:27.714 19:10:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:27.714 19:10:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:27.714 19:10:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:27.714 19:10:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:27.714 19:10:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:27.714 19:10:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:27.714 19:10:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:27.714 19:10:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:27.714 19:10:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:27.714 19:10:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:27.714 19:10:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:27.714 19:10:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:27.714 19:10:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:27.714 19:10:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:27.714 19:10:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.714 19:10:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.714 19:10:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.714 19:10:45 -- paths/export.sh@5 -- # export PATH 00:12:27.714 19:10:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.714 19:10:45 -- nvmf/common.sh@46 -- # : 0 00:12:27.714 19:10:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:27.714 19:10:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:27.714 19:10:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:27.714 19:10:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:27.714 19:10:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:27.714 19:10:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:27.714 19:10:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:27.714 19:10:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:27.714 19:10:45 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:27.714 19:10:45 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:27.714 19:10:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:27.714 19:10:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:27.714 19:10:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:27.714 19:10:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:27.714 19:10:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:27.714 19:10:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.714 19:10:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:27.714 19:10:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.714 19:10:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:27.714 19:10:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:27.714 19:10:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:27.714 19:10:45 -- common/autotest_common.sh@10 -- # set +x 00:12:29.629 19:10:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:29.629 19:10:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:29.629 19:10:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:29.629 19:10:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:29.629 19:10:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:29.629 19:10:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:29.629 19:10:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:29.629 19:10:47 -- nvmf/common.sh@294 -- # net_devs=() 00:12:29.629 19:10:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:29.629 19:10:47 -- nvmf/common.sh@295 -- # e810=() 00:12:29.629 19:10:47 -- nvmf/common.sh@295 -- # local -ga e810 00:12:29.629 19:10:47 -- nvmf/common.sh@296 -- # x722=() 00:12:29.629 19:10:47 -- nvmf/common.sh@296 -- # local -ga x722 00:12:29.629 19:10:47 -- nvmf/common.sh@297 -- # mlx=() 00:12:29.629 19:10:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:29.629 19:10:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:29.629 19:10:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:29.629 19:10:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:29.629 19:10:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:29.629 19:10:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:29.629 19:10:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:29.629 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:29.629 19:10:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:29.629 19:10:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:29.629 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:29.629 19:10:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:29.629 19:10:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:29.629 19:10:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:29.629 19:10:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:29.629 19:10:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:29.629 19:10:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:29.629 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:29.629 19:10:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:29.629 19:10:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:29.629 19:10:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:29.629 19:10:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:29.629 19:10:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:29.629 19:10:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:29.629 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:29.629 19:10:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:29.629 19:10:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:29.629 19:10:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:29.629 19:10:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:29.629 19:10:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:29.629 19:10:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:29.629 19:10:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:29.629 19:10:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:29.629 19:10:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:29.629 19:10:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:29.629 19:10:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:29.629 19:10:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:29.629 19:10:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:29.629 19:10:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:29.629 19:10:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:29.629 19:10:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:29.629 19:10:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:29.629 19:10:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:29.629 19:10:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:29.629 19:10:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:29.629 19:10:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:29.629 19:10:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:29.630 19:10:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:29.630 19:10:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:29.630 19:10:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:29.630 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:29.630 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:12:29.630 00:12:29.630 --- 10.0.0.2 ping statistics --- 00:12:29.630 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:29.630 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:12:29.630 19:10:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:29.630 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:29.630 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:12:29.630 00:12:29.630 --- 10.0.0.1 ping statistics --- 00:12:29.630 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:29.630 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:12:29.630 19:10:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:29.630 19:10:48 -- nvmf/common.sh@410 -- # return 0 00:12:29.630 19:10:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:29.630 19:10:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:29.630 19:10:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:29.630 19:10:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:29.630 19:10:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:29.630 19:10:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:29.630 19:10:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:29.630 19:10:48 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:29.630 19:10:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:29.630 19:10:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:29.630 19:10:48 -- common/autotest_common.sh@10 -- # set +x 00:12:29.630 19:10:48 -- nvmf/common.sh@469 -- # nvmfpid=3397825 00:12:29.630 19:10:48 -- nvmf/common.sh@470 -- # waitforlisten 3397825 00:12:29.630 19:10:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:29.630 19:10:48 -- common/autotest_common.sh@829 -- # '[' -z 3397825 ']' 00:12:29.630 19:10:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:29.630 19:10:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:29.630 19:10:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:29.630 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:29.630 19:10:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:29.630 19:10:48 -- common/autotest_common.sh@10 -- # set +x 00:12:29.630 [2024-11-18 19:10:48.155885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:29.630 [2024-11-18 19:10:48.155964] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:29.630 EAL: No free 2048 kB hugepages reported on node 1 00:12:29.630 [2024-11-18 19:10:48.228175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:29.888 [2024-11-18 19:10:48.348468] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:29.888 [2024-11-18 19:10:48.348644] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:29.888 [2024-11-18 19:10:48.348666] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:29.888 [2024-11-18 19:10:48.348690] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:29.888 [2024-11-18 19:10:48.348747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:29.888 [2024-11-18 19:10:48.348816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:29.888 [2024-11-18 19:10:48.348820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:30.820 19:10:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:30.820 19:10:49 -- common/autotest_common.sh@862 -- # return 0 00:12:30.820 19:10:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:30.820 19:10:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:30.820 19:10:49 -- common/autotest_common.sh@10 -- # set +x 00:12:30.820 19:10:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:30.820 19:10:49 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:30.820 19:10:49 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:30.820 [2024-11-18 19:10:49.410189] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:31.076 19:10:49 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:31.334 19:10:49 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:31.334 [2024-11-18 19:10:49.905050] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:31.334 19:10:49 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:31.592 19:10:50 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:31.850 Malloc0 00:12:32.108 19:10:50 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:32.108 Delay0 00:12:32.366 19:10:50 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.366 19:10:50 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:32.624 NULL1 00:12:32.624 19:10:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:32.883 19:10:51 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3398264 00:12:32.883 19:10:51 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:32.883 19:10:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:32.883 19:10:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.883 EAL: No free 2048 kB hugepages reported on node 1 00:12:34.257 Read completed with error (sct=0, sc=11) 00:12:34.257 19:10:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.514 19:10:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:34.515 19:10:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:34.772 true 00:12:34.772 19:10:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:34.772 19:10:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.337 19:10:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.903 19:10:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:35.903 19:10:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:35.903 true 00:12:35.903 19:10:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:35.903 19:10:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.161 19:10:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.418 19:10:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:36.418 19:10:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:36.675 true 00:12:36.675 19:10:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:36.675 19:10:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.933 19:10:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.190 19:10:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:37.191 19:10:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:37.449 true 00:12:37.449 19:10:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:37.449 19:10:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.821 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.821 19:10:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.821 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.821 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.821 19:10:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:38.821 19:10:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:39.079 true 00:12:39.079 19:10:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:39.079 19:10:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.336 19:10:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.594 19:10:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:39.594 19:10:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:39.852 true 00:12:39.852 19:10:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:39.852 19:10:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.783 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:40.784 19:10:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.784 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:40.784 19:10:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:40.784 19:10:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:41.040 true 00:12:41.298 19:10:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:41.298 19:10:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.298 19:10:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.555 19:11:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:41.555 19:11:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:41.813 true 00:12:41.813 19:11:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:41.813 19:11:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.745 19:11:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.003 19:11:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:43.003 19:11:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:43.261 true 00:12:43.261 19:11:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:43.261 19:11:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.519 19:11:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.777 19:11:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:43.777 19:11:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:44.035 true 00:12:44.035 19:11:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:44.035 19:11:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.025 19:11:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.026 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:45.026 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:45.283 19:11:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:45.283 19:11:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:45.541 true 00:12:45.541 19:11:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:45.541 19:11:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.798 19:11:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.055 19:11:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:46.056 19:11:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:46.313 true 00:12:46.313 19:11:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:46.313 19:11:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.246 19:11:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.504 19:11:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:47.504 19:11:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:47.761 true 00:12:47.761 19:11:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:47.761 19:11:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.019 19:11:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.277 19:11:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:48.277 19:11:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:48.535 true 00:12:48.535 19:11:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:48.535 19:11:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.793 19:11:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.051 19:11:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:49.051 19:11:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:49.051 true 00:12:49.308 19:11:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:49.308 19:11:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.239 19:11:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.239 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.497 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.497 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.497 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.497 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.497 19:11:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:50.497 19:11:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:50.754 true 00:12:50.754 19:11:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:50.754 19:11:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.687 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:51.687 19:11:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.945 19:11:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:51.945 19:11:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:52.203 true 00:12:52.203 19:11:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:52.203 19:11:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.461 19:11:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.718 19:11:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:52.718 19:11:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:52.975 true 00:12:52.975 19:11:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:52.975 19:11:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.232 19:11:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.488 19:11:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:53.488 19:11:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:53.745 true 00:12:53.745 19:11:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:53.745 19:11:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.678 19:11:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.937 19:11:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:54.937 19:11:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:55.195 true 00:12:55.195 19:11:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:55.195 19:11:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.452 19:11:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.710 19:11:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:55.710 19:11:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:55.968 true 00:12:55.968 19:11:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:55.968 19:11:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.226 19:11:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.484 19:11:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:56.484 19:11:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:56.741 true 00:12:56.741 19:11:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:56.741 19:11:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.675 19:11:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.934 19:11:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:57.934 19:11:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:58.192 true 00:12:58.192 19:11:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:58.192 19:11:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.449 19:11:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.707 19:11:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:58.707 19:11:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:58.964 true 00:12:58.964 19:11:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:58.964 19:11:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.223 19:11:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.480 19:11:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:59.480 19:11:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:59.738 true 00:12:59.738 19:11:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:12:59.738 19:11:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.671 19:11:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.928 19:11:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:00.928 19:11:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:01.185 true 00:13:01.185 19:11:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:13:01.185 19:11:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.443 19:11:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.701 19:11:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:01.701 19:11:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:01.959 true 00:13:01.959 19:11:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:13:01.959 19:11:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.216 19:11:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.474 19:11:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:02.474 19:11:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:02.732 true 00:13:02.732 19:11:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:13:02.732 19:11:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.665 Initializing NVMe Controllers 00:13:03.665 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:03.665 Controller IO queue size 128, less than required. 00:13:03.665 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:03.665 Controller IO queue size 128, less than required. 00:13:03.665 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:03.665 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:03.665 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:03.665 Initialization complete. Launching workers. 00:13:03.665 ======================================================== 00:13:03.665 Latency(us) 00:13:03.665 Device Information : IOPS MiB/s Average min max 00:13:03.665 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 891.75 0.44 69757.98 3115.00 1087865.36 00:13:03.665 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10930.69 5.34 11710.13 1635.97 363834.70 00:13:03.665 ======================================================== 00:13:03.665 Total : 11822.44 5.77 16088.61 1635.97 1087865.36 00:13:03.665 00:13:03.665 19:11:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.923 19:11:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:03.923 19:11:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:04.181 true 00:13:04.181 19:11:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3398264 00:13:04.181 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3398264) - No such process 00:13:04.181 19:11:22 -- target/ns_hotplug_stress.sh@53 -- # wait 3398264 00:13:04.181 19:11:22 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.438 19:11:23 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:04.696 19:11:23 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:04.696 19:11:23 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:04.696 19:11:23 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:04.696 19:11:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:04.696 19:11:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:04.955 null0 00:13:04.955 19:11:23 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:04.955 19:11:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:04.955 19:11:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:05.212 null1 00:13:05.212 19:11:23 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.212 19:11:23 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.212 19:11:23 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:05.470 null2 00:13:05.470 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.470 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.470 19:11:24 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:05.728 null3 00:13:05.728 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.728 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.728 19:11:24 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:05.986 null4 00:13:05.986 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.986 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.986 19:11:24 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:06.243 null5 00:13:06.243 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.243 19:11:24 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.243 19:11:24 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:06.501 null6 00:13:06.501 19:11:25 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.501 19:11:25 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.501 19:11:25 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:06.759 null7 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.759 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@66 -- # wait 3402550 3402552 3402554 3402557 3402559 3402561 3402563 3402565 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:06.760 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.018 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:07.018 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.018 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.277 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.277 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.277 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.277 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.277 19:11:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.536 19:11:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:07.794 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.055 19:11:26 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.350 19:11:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.633 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.891 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.891 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.892 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.892 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.892 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.892 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.892 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.892 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.150 19:11:27 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.408 19:11:27 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.666 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.666 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.666 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.666 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.666 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.667 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.925 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.183 19:11:28 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.441 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.441 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.441 19:11:28 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.441 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.441 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.441 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.441 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.441 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.700 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.958 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.958 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.216 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.216 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.216 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.216 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.216 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.216 19:11:29 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.474 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.475 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.475 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.475 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.475 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.475 19:11:29 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.475 19:11:29 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.733 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.991 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.992 19:11:30 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.250 19:11:30 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.509 19:11:30 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.509 19:11:31 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:12.509 19:11:31 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:12.509 19:11:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:12.509 19:11:31 -- nvmf/common.sh@116 -- # sync 00:13:12.509 19:11:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:12.509 19:11:31 -- nvmf/common.sh@119 -- # set +e 00:13:12.509 19:11:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:12.509 19:11:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:12.509 rmmod nvme_tcp 00:13:12.509 rmmod nvme_fabrics 00:13:12.509 rmmod nvme_keyring 00:13:12.509 19:11:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:12.509 19:11:31 -- nvmf/common.sh@123 -- # set -e 00:13:12.509 19:11:31 -- nvmf/common.sh@124 -- # return 0 00:13:12.509 19:11:31 -- nvmf/common.sh@477 -- # '[' -n 3397825 ']' 00:13:12.509 19:11:31 -- nvmf/common.sh@478 -- # killprocess 3397825 00:13:12.509 19:11:31 -- common/autotest_common.sh@936 -- # '[' -z 3397825 ']' 00:13:12.509 19:11:31 -- common/autotest_common.sh@940 -- # kill -0 3397825 00:13:12.509 19:11:31 -- common/autotest_common.sh@941 -- # uname 00:13:12.509 19:11:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:12.509 19:11:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3397825 00:13:12.509 19:11:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:12.509 19:11:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:12.509 19:11:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3397825' 00:13:12.509 killing process with pid 3397825 00:13:12.509 19:11:31 -- common/autotest_common.sh@955 -- # kill 3397825 00:13:12.509 19:11:31 -- common/autotest_common.sh@960 -- # wait 3397825 00:13:13.076 19:11:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:13.076 19:11:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:13.076 19:11:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:13.076 19:11:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:13.076 19:11:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:13.076 19:11:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:13.076 19:11:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:13.076 19:11:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:14.979 19:11:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:14.979 00:13:14.979 real 0m47.665s 00:13:14.979 user 3m37.786s 00:13:14.979 sys 0m15.271s 00:13:14.979 19:11:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:14.979 19:11:33 -- common/autotest_common.sh@10 -- # set +x 00:13:14.979 ************************************ 00:13:14.979 END TEST nvmf_ns_hotplug_stress 00:13:14.979 ************************************ 00:13:14.979 19:11:33 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:14.979 19:11:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:14.979 19:11:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:14.979 19:11:33 -- common/autotest_common.sh@10 -- # set +x 00:13:14.979 ************************************ 00:13:14.979 START TEST nvmf_connect_stress 00:13:14.979 ************************************ 00:13:14.979 19:11:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:14.979 * Looking for test storage... 00:13:14.979 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:14.979 19:11:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:14.979 19:11:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:14.979 19:11:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:14.979 19:11:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:14.979 19:11:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:14.979 19:11:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:14.979 19:11:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:14.979 19:11:33 -- scripts/common.sh@335 -- # IFS=.-: 00:13:14.979 19:11:33 -- scripts/common.sh@335 -- # read -ra ver1 00:13:14.979 19:11:33 -- scripts/common.sh@336 -- # IFS=.-: 00:13:14.979 19:11:33 -- scripts/common.sh@336 -- # read -ra ver2 00:13:14.979 19:11:33 -- scripts/common.sh@337 -- # local 'op=<' 00:13:14.979 19:11:33 -- scripts/common.sh@339 -- # ver1_l=2 00:13:14.979 19:11:33 -- scripts/common.sh@340 -- # ver2_l=1 00:13:14.979 19:11:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:14.979 19:11:33 -- scripts/common.sh@343 -- # case "$op" in 00:13:14.979 19:11:33 -- scripts/common.sh@344 -- # : 1 00:13:14.979 19:11:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:14.979 19:11:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:14.979 19:11:33 -- scripts/common.sh@364 -- # decimal 1 00:13:14.979 19:11:33 -- scripts/common.sh@352 -- # local d=1 00:13:14.979 19:11:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:14.979 19:11:33 -- scripts/common.sh@354 -- # echo 1 00:13:14.979 19:11:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:14.979 19:11:33 -- scripts/common.sh@365 -- # decimal 2 00:13:14.979 19:11:33 -- scripts/common.sh@352 -- # local d=2 00:13:14.979 19:11:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:14.979 19:11:33 -- scripts/common.sh@354 -- # echo 2 00:13:14.979 19:11:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:14.979 19:11:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:14.979 19:11:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:14.979 19:11:33 -- scripts/common.sh@367 -- # return 0 00:13:14.979 19:11:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:14.979 19:11:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:14.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.979 --rc genhtml_branch_coverage=1 00:13:14.979 --rc genhtml_function_coverage=1 00:13:14.979 --rc genhtml_legend=1 00:13:14.979 --rc geninfo_all_blocks=1 00:13:14.979 --rc geninfo_unexecuted_blocks=1 00:13:14.979 00:13:14.979 ' 00:13:14.979 19:11:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:14.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.979 --rc genhtml_branch_coverage=1 00:13:14.979 --rc genhtml_function_coverage=1 00:13:14.979 --rc genhtml_legend=1 00:13:14.979 --rc geninfo_all_blocks=1 00:13:14.979 --rc geninfo_unexecuted_blocks=1 00:13:14.979 00:13:14.979 ' 00:13:14.979 19:11:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:14.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.979 --rc genhtml_branch_coverage=1 00:13:14.979 --rc genhtml_function_coverage=1 00:13:14.979 --rc genhtml_legend=1 00:13:14.979 --rc geninfo_all_blocks=1 00:13:14.979 --rc geninfo_unexecuted_blocks=1 00:13:14.979 00:13:14.979 ' 00:13:14.979 19:11:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:14.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.979 --rc genhtml_branch_coverage=1 00:13:14.979 --rc genhtml_function_coverage=1 00:13:14.979 --rc genhtml_legend=1 00:13:14.979 --rc geninfo_all_blocks=1 00:13:14.979 --rc geninfo_unexecuted_blocks=1 00:13:14.979 00:13:14.979 ' 00:13:14.979 19:11:33 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:14.979 19:11:33 -- nvmf/common.sh@7 -- # uname -s 00:13:14.979 19:11:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:14.979 19:11:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:14.979 19:11:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:14.979 19:11:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:14.979 19:11:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:14.979 19:11:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:14.979 19:11:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:14.979 19:11:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:14.979 19:11:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:14.979 19:11:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:15.238 19:11:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.238 19:11:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.238 19:11:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:15.238 19:11:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:15.238 19:11:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:15.238 19:11:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:15.238 19:11:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:15.238 19:11:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:15.238 19:11:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:15.238 19:11:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.238 19:11:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.238 19:11:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.238 19:11:33 -- paths/export.sh@5 -- # export PATH 00:13:15.238 19:11:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.238 19:11:33 -- nvmf/common.sh@46 -- # : 0 00:13:15.238 19:11:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:15.238 19:11:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:15.238 19:11:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:15.238 19:11:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:15.238 19:11:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:15.238 19:11:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:15.238 19:11:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:15.238 19:11:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:15.238 19:11:33 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:15.238 19:11:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:15.238 19:11:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:15.238 19:11:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:15.238 19:11:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:15.238 19:11:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:15.238 19:11:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.238 19:11:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.238 19:11:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.238 19:11:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:15.238 19:11:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:15.238 19:11:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:15.238 19:11:33 -- common/autotest_common.sh@10 -- # set +x 00:13:17.139 19:11:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:17.139 19:11:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:17.139 19:11:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:17.139 19:11:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:17.139 19:11:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:17.139 19:11:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:17.139 19:11:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:17.139 19:11:35 -- nvmf/common.sh@294 -- # net_devs=() 00:13:17.139 19:11:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:17.139 19:11:35 -- nvmf/common.sh@295 -- # e810=() 00:13:17.139 19:11:35 -- nvmf/common.sh@295 -- # local -ga e810 00:13:17.139 19:11:35 -- nvmf/common.sh@296 -- # x722=() 00:13:17.139 19:11:35 -- nvmf/common.sh@296 -- # local -ga x722 00:13:17.139 19:11:35 -- nvmf/common.sh@297 -- # mlx=() 00:13:17.139 19:11:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:17.139 19:11:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:17.139 19:11:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:17.139 19:11:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:17.139 19:11:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:17.139 19:11:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.139 19:11:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:17.139 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:17.139 19:11:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.139 19:11:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:17.139 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:17.139 19:11:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:17.139 19:11:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.139 19:11:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.139 19:11:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.139 19:11:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.139 19:11:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:17.139 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:17.139 19:11:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.139 19:11:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.139 19:11:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.139 19:11:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.139 19:11:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.139 19:11:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:17.139 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:17.139 19:11:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.139 19:11:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:17.139 19:11:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:17.139 19:11:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:17.139 19:11:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:17.139 19:11:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:17.139 19:11:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:17.139 19:11:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:17.139 19:11:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:17.139 19:11:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:17.139 19:11:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:17.139 19:11:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:17.139 19:11:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:17.139 19:11:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:17.139 19:11:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:17.139 19:11:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:17.139 19:11:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:17.139 19:11:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:17.398 19:11:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:17.398 19:11:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:17.398 19:11:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:17.398 19:11:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:17.398 19:11:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:17.398 19:11:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:17.398 19:11:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:17.398 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:17.398 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:13:17.398 00:13:17.398 --- 10.0.0.2 ping statistics --- 00:13:17.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.398 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:13:17.398 19:11:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:17.398 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:17.398 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:13:17.398 00:13:17.398 --- 10.0.0.1 ping statistics --- 00:13:17.398 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.398 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:13:17.398 19:11:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:17.398 19:11:35 -- nvmf/common.sh@410 -- # return 0 00:13:17.398 19:11:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:17.398 19:11:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:17.398 19:11:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:17.398 19:11:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:17.398 19:11:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:17.398 19:11:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:17.398 19:11:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:17.398 19:11:35 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:17.398 19:11:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:17.398 19:11:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:17.398 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:13:17.398 19:11:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:17.398 19:11:35 -- nvmf/common.sh@469 -- # nvmfpid=3405355 00:13:17.398 19:11:35 -- nvmf/common.sh@470 -- # waitforlisten 3405355 00:13:17.398 19:11:35 -- common/autotest_common.sh@829 -- # '[' -z 3405355 ']' 00:13:17.398 19:11:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:17.398 19:11:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:17.398 19:11:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:17.398 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:17.398 19:11:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:17.398 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:13:17.398 [2024-11-18 19:11:35.876300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:17.398 [2024-11-18 19:11:35.876379] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:17.398 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.398 [2024-11-18 19:11:35.944025] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:17.656 [2024-11-18 19:11:36.059766] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:17.656 [2024-11-18 19:11:36.059925] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:17.656 [2024-11-18 19:11:36.059943] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:17.656 [2024-11-18 19:11:36.059956] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:17.656 [2024-11-18 19:11:36.060016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:17.656 [2024-11-18 19:11:36.060071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:17.657 [2024-11-18 19:11:36.060590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:18.590 19:11:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:18.590 19:11:36 -- common/autotest_common.sh@862 -- # return 0 00:13:18.590 19:11:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:18.590 19:11:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:18.590 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:18.590 19:11:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:18.590 19:11:36 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:18.590 19:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.590 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:18.590 [2024-11-18 19:11:36.852978] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:18.590 19:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.590 19:11:36 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:18.590 19:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.590 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:18.590 19:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.590 19:11:36 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:18.590 19:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.590 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:18.590 [2024-11-18 19:11:36.887806] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:18.590 19:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.590 19:11:36 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:18.590 19:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.590 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:18.590 NULL1 00:13:18.590 19:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.590 19:11:36 -- target/connect_stress.sh@21 -- # PERF_PID=3405512 00:13:18.590 19:11:36 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:18.590 19:11:36 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:18.590 19:11:36 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.590 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.590 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.590 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.590 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.590 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.590 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.590 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 EAL: No free 2048 kB hugepages reported on node 1 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:18.591 19:11:36 -- target/connect_stress.sh@28 -- # cat 00:13:18.591 19:11:36 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:18.591 19:11:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:18.591 19:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.591 19:11:36 -- common/autotest_common.sh@10 -- # set +x 00:13:18.849 19:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.849 19:11:37 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:18.849 19:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:18.849 19:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.849 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:19.106 19:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.106 19:11:37 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:19.106 19:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.106 19:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.106 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:19.364 19:11:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.364 19:11:37 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:19.364 19:11:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.364 19:11:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.364 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:13:19.927 19:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.927 19:11:38 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:19.927 19:11:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.927 19:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.927 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:13:20.184 19:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.184 19:11:38 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:20.184 19:11:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.184 19:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.184 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:13:20.442 19:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.442 19:11:38 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:20.442 19:11:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.442 19:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.442 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:13:20.713 19:11:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.713 19:11:39 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:20.713 19:11:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.713 19:11:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.713 19:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:20.972 19:11:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.972 19:11:39 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:20.972 19:11:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.972 19:11:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.972 19:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:21.537 19:11:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.537 19:11:39 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:21.537 19:11:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.537 19:11:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.537 19:11:39 -- common/autotest_common.sh@10 -- # set +x 00:13:21.794 19:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.794 19:11:40 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:21.794 19:11:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.794 19:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.794 19:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:22.052 19:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.052 19:11:40 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:22.052 19:11:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.052 19:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.052 19:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:22.309 19:11:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.309 19:11:40 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:22.309 19:11:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.309 19:11:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.309 19:11:40 -- common/autotest_common.sh@10 -- # set +x 00:13:22.567 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.567 19:11:41 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:22.567 19:11:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.567 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.567 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:23.131 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.131 19:11:41 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:23.131 19:11:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.131 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.131 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:23.388 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.388 19:11:41 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:23.388 19:11:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.388 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.388 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:13:23.646 19:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.646 19:11:42 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:23.646 19:11:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.646 19:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.646 19:11:42 -- common/autotest_common.sh@10 -- # set +x 00:13:23.904 19:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.904 19:11:42 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:23.904 19:11:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.904 19:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.904 19:11:42 -- common/autotest_common.sh@10 -- # set +x 00:13:24.163 19:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.163 19:11:42 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:24.163 19:11:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.163 19:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.163 19:11:42 -- common/autotest_common.sh@10 -- # set +x 00:13:24.729 19:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.729 19:11:43 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:24.729 19:11:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.729 19:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.729 19:11:43 -- common/autotest_common.sh@10 -- # set +x 00:13:24.987 19:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.987 19:11:43 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:24.987 19:11:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.987 19:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.987 19:11:43 -- common/autotest_common.sh@10 -- # set +x 00:13:25.245 19:11:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.245 19:11:43 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:25.245 19:11:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.245 19:11:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.245 19:11:43 -- common/autotest_common.sh@10 -- # set +x 00:13:25.502 19:11:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.502 19:11:44 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:25.502 19:11:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.502 19:11:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.502 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:13:25.760 19:11:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.760 19:11:44 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:25.760 19:11:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.760 19:11:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.760 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:13:26.323 19:11:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.323 19:11:44 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:26.323 19:11:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.323 19:11:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.323 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:13:26.580 19:11:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.580 19:11:44 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:26.580 19:11:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.580 19:11:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.580 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:13:26.838 19:11:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.838 19:11:45 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:26.838 19:11:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.838 19:11:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.838 19:11:45 -- common/autotest_common.sh@10 -- # set +x 00:13:27.096 19:11:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.096 19:11:45 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:27.096 19:11:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.096 19:11:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.096 19:11:45 -- common/autotest_common.sh@10 -- # set +x 00:13:27.354 19:11:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.354 19:11:45 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:27.354 19:11:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.354 19:11:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.354 19:11:45 -- common/autotest_common.sh@10 -- # set +x 00:13:27.919 19:11:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.919 19:11:46 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:27.919 19:11:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.919 19:11:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.919 19:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:28.176 19:11:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.176 19:11:46 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:28.176 19:11:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.177 19:11:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.177 19:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:28.434 19:11:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.434 19:11:46 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:28.434 19:11:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.434 19:11:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.434 19:11:46 -- common/autotest_common.sh@10 -- # set +x 00:13:28.434 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:28.704 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.704 19:11:47 -- target/connect_stress.sh@34 -- # kill -0 3405512 00:13:28.704 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3405512) - No such process 00:13:28.704 19:11:47 -- target/connect_stress.sh@38 -- # wait 3405512 00:13:28.705 19:11:47 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:28.705 19:11:47 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:28.705 19:11:47 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:28.705 19:11:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:28.705 19:11:47 -- nvmf/common.sh@116 -- # sync 00:13:28.705 19:11:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:28.705 19:11:47 -- nvmf/common.sh@119 -- # set +e 00:13:28.705 19:11:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:28.705 19:11:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:28.705 rmmod nvme_tcp 00:13:28.705 rmmod nvme_fabrics 00:13:28.705 rmmod nvme_keyring 00:13:28.705 19:11:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:28.963 19:11:47 -- nvmf/common.sh@123 -- # set -e 00:13:28.963 19:11:47 -- nvmf/common.sh@124 -- # return 0 00:13:28.963 19:11:47 -- nvmf/common.sh@477 -- # '[' -n 3405355 ']' 00:13:28.963 19:11:47 -- nvmf/common.sh@478 -- # killprocess 3405355 00:13:28.963 19:11:47 -- common/autotest_common.sh@936 -- # '[' -z 3405355 ']' 00:13:28.963 19:11:47 -- common/autotest_common.sh@940 -- # kill -0 3405355 00:13:28.963 19:11:47 -- common/autotest_common.sh@941 -- # uname 00:13:28.963 19:11:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.963 19:11:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3405355 00:13:28.963 19:11:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:28.963 19:11:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:28.963 19:11:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3405355' 00:13:28.963 killing process with pid 3405355 00:13:28.963 19:11:47 -- common/autotest_common.sh@955 -- # kill 3405355 00:13:28.963 19:11:47 -- common/autotest_common.sh@960 -- # wait 3405355 00:13:29.222 19:11:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:29.222 19:11:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:29.222 19:11:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:29.222 19:11:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:29.222 19:11:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:29.222 19:11:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.222 19:11:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.222 19:11:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.123 19:11:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:31.123 00:13:31.123 real 0m16.239s 00:13:31.123 user 0m40.974s 00:13:31.123 sys 0m5.824s 00:13:31.123 19:11:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:31.123 19:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:31.123 ************************************ 00:13:31.123 END TEST nvmf_connect_stress 00:13:31.123 ************************************ 00:13:31.123 19:11:49 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:31.124 19:11:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:31.124 19:11:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:31.124 19:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:31.124 ************************************ 00:13:31.124 START TEST nvmf_fused_ordering 00:13:31.124 ************************************ 00:13:31.124 19:11:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:31.382 * Looking for test storage... 00:13:31.382 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:31.382 19:11:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:31.382 19:11:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:31.382 19:11:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:31.382 19:11:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:31.382 19:11:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:31.382 19:11:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:31.382 19:11:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:31.382 19:11:49 -- scripts/common.sh@335 -- # IFS=.-: 00:13:31.382 19:11:49 -- scripts/common.sh@335 -- # read -ra ver1 00:13:31.382 19:11:49 -- scripts/common.sh@336 -- # IFS=.-: 00:13:31.382 19:11:49 -- scripts/common.sh@336 -- # read -ra ver2 00:13:31.382 19:11:49 -- scripts/common.sh@337 -- # local 'op=<' 00:13:31.382 19:11:49 -- scripts/common.sh@339 -- # ver1_l=2 00:13:31.382 19:11:49 -- scripts/common.sh@340 -- # ver2_l=1 00:13:31.382 19:11:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:31.382 19:11:49 -- scripts/common.sh@343 -- # case "$op" in 00:13:31.382 19:11:49 -- scripts/common.sh@344 -- # : 1 00:13:31.382 19:11:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:31.382 19:11:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:31.382 19:11:49 -- scripts/common.sh@364 -- # decimal 1 00:13:31.382 19:11:49 -- scripts/common.sh@352 -- # local d=1 00:13:31.382 19:11:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:31.382 19:11:49 -- scripts/common.sh@354 -- # echo 1 00:13:31.382 19:11:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:31.382 19:11:49 -- scripts/common.sh@365 -- # decimal 2 00:13:31.382 19:11:49 -- scripts/common.sh@352 -- # local d=2 00:13:31.382 19:11:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:31.382 19:11:49 -- scripts/common.sh@354 -- # echo 2 00:13:31.382 19:11:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:31.382 19:11:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:31.382 19:11:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:31.382 19:11:49 -- scripts/common.sh@367 -- # return 0 00:13:31.382 19:11:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:31.382 19:11:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:31.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.382 --rc genhtml_branch_coverage=1 00:13:31.382 --rc genhtml_function_coverage=1 00:13:31.382 --rc genhtml_legend=1 00:13:31.382 --rc geninfo_all_blocks=1 00:13:31.382 --rc geninfo_unexecuted_blocks=1 00:13:31.382 00:13:31.382 ' 00:13:31.382 19:11:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:31.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.382 --rc genhtml_branch_coverage=1 00:13:31.382 --rc genhtml_function_coverage=1 00:13:31.382 --rc genhtml_legend=1 00:13:31.382 --rc geninfo_all_blocks=1 00:13:31.382 --rc geninfo_unexecuted_blocks=1 00:13:31.382 00:13:31.382 ' 00:13:31.382 19:11:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:31.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.383 --rc genhtml_branch_coverage=1 00:13:31.383 --rc genhtml_function_coverage=1 00:13:31.383 --rc genhtml_legend=1 00:13:31.383 --rc geninfo_all_blocks=1 00:13:31.383 --rc geninfo_unexecuted_blocks=1 00:13:31.383 00:13:31.383 ' 00:13:31.383 19:11:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:31.383 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:31.383 --rc genhtml_branch_coverage=1 00:13:31.383 --rc genhtml_function_coverage=1 00:13:31.383 --rc genhtml_legend=1 00:13:31.383 --rc geninfo_all_blocks=1 00:13:31.383 --rc geninfo_unexecuted_blocks=1 00:13:31.383 00:13:31.383 ' 00:13:31.383 19:11:49 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:31.383 19:11:49 -- nvmf/common.sh@7 -- # uname -s 00:13:31.383 19:11:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:31.383 19:11:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:31.383 19:11:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:31.383 19:11:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:31.383 19:11:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:31.383 19:11:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:31.383 19:11:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:31.383 19:11:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:31.383 19:11:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:31.383 19:11:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:31.383 19:11:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.383 19:11:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:31.383 19:11:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:31.383 19:11:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:31.383 19:11:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:31.383 19:11:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:31.383 19:11:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:31.383 19:11:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:31.383 19:11:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:31.383 19:11:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.383 19:11:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.383 19:11:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.383 19:11:49 -- paths/export.sh@5 -- # export PATH 00:13:31.383 19:11:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:31.383 19:11:49 -- nvmf/common.sh@46 -- # : 0 00:13:31.383 19:11:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:31.383 19:11:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:31.383 19:11:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:31.383 19:11:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:31.383 19:11:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:31.383 19:11:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:31.383 19:11:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:31.383 19:11:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:31.383 19:11:49 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:31.383 19:11:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:31.383 19:11:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:31.383 19:11:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:31.383 19:11:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:31.383 19:11:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:31.383 19:11:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:31.383 19:11:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:31.383 19:11:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.383 19:11:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:31.383 19:11:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:31.383 19:11:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:31.383 19:11:49 -- common/autotest_common.sh@10 -- # set +x 00:13:33.285 19:11:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:33.285 19:11:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:33.285 19:11:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:33.285 19:11:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:33.285 19:11:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:33.285 19:11:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:33.285 19:11:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:33.285 19:11:51 -- nvmf/common.sh@294 -- # net_devs=() 00:13:33.285 19:11:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:33.285 19:11:51 -- nvmf/common.sh@295 -- # e810=() 00:13:33.285 19:11:51 -- nvmf/common.sh@295 -- # local -ga e810 00:13:33.285 19:11:51 -- nvmf/common.sh@296 -- # x722=() 00:13:33.285 19:11:51 -- nvmf/common.sh@296 -- # local -ga x722 00:13:33.285 19:11:51 -- nvmf/common.sh@297 -- # mlx=() 00:13:33.285 19:11:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:33.285 19:11:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:33.285 19:11:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:33.285 19:11:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:33.285 19:11:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:33.285 19:11:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:33.285 19:11:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:33.285 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:33.285 19:11:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:33.285 19:11:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:33.285 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:33.285 19:11:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:33.285 19:11:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:33.285 19:11:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:33.285 19:11:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:33.285 19:11:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:33.285 19:11:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:33.285 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:33.285 19:11:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:33.285 19:11:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:33.285 19:11:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:33.285 19:11:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:33.285 19:11:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:33.285 19:11:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:33.285 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:33.285 19:11:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:33.285 19:11:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:33.285 19:11:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:33.285 19:11:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:33.285 19:11:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:33.285 19:11:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:33.285 19:11:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:33.285 19:11:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:33.285 19:11:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:33.285 19:11:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:33.285 19:11:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:33.285 19:11:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:33.285 19:11:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:33.285 19:11:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:33.285 19:11:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:33.285 19:11:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:33.285 19:11:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:33.285 19:11:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:33.285 19:11:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:33.285 19:11:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:33.285 19:11:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:33.285 19:11:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:33.544 19:11:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:33.544 19:11:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:33.544 19:11:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:33.544 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:33.544 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:13:33.544 00:13:33.544 --- 10.0.0.2 ping statistics --- 00:13:33.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:33.544 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:13:33.544 19:11:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:33.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:33.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:13:33.544 00:13:33.544 --- 10.0.0.1 ping statistics --- 00:13:33.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:33.544 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:13:33.544 19:11:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:33.544 19:11:51 -- nvmf/common.sh@410 -- # return 0 00:13:33.544 19:11:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:33.544 19:11:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:33.544 19:11:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:33.544 19:11:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:33.544 19:11:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:33.544 19:11:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:33.544 19:11:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:33.544 19:11:51 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:33.544 19:11:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:33.544 19:11:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:33.544 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:13:33.544 19:11:51 -- nvmf/common.sh@469 -- # nvmfpid=3408709 00:13:33.544 19:11:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:33.544 19:11:51 -- nvmf/common.sh@470 -- # waitforlisten 3408709 00:13:33.544 19:11:51 -- common/autotest_common.sh@829 -- # '[' -z 3408709 ']' 00:13:33.544 19:11:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:33.544 19:11:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:33.544 19:11:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:33.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:33.544 19:11:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:33.544 19:11:51 -- common/autotest_common.sh@10 -- # set +x 00:13:33.544 [2024-11-18 19:11:52.007927] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:33.544 [2024-11-18 19:11:52.008016] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:33.544 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.544 [2024-11-18 19:11:52.078842] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:33.851 [2024-11-18 19:11:52.187313] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:33.851 [2024-11-18 19:11:52.187465] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:33.851 [2024-11-18 19:11:52.187485] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:33.851 [2024-11-18 19:11:52.187497] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:33.851 [2024-11-18 19:11:52.187531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:34.417 19:11:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:34.417 19:11:52 -- common/autotest_common.sh@862 -- # return 0 00:13:34.417 19:11:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:34.417 19:11:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:34.417 19:11:52 -- common/autotest_common.sh@10 -- # set +x 00:13:34.417 19:11:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:34.417 19:11:52 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:34.417 19:11:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.417 19:11:52 -- common/autotest_common.sh@10 -- # set +x 00:13:34.417 [2024-11-18 19:11:53.002168] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:34.417 19:11:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.417 19:11:53 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:34.417 19:11:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.417 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.417 19:11:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.417 19:11:53 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.417 19:11:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.417 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.417 [2024-11-18 19:11:53.018347] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.675 19:11:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.675 19:11:53 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:34.675 19:11:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.675 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.675 NULL1 00:13:34.675 19:11:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.675 19:11:53 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:34.675 19:11:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.675 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.675 19:11:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.675 19:11:53 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:34.675 19:11:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.675 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:13:34.675 19:11:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.675 19:11:53 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:34.675 [2024-11-18 19:11:53.063276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:34.675 [2024-11-18 19:11:53.063317] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3408867 ] 00:13:34.675 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.933 Attached to nqn.2016-06.io.spdk:cnode1 00:13:34.933 Namespace ID: 1 size: 1GB 00:13:34.933 fused_ordering(0) 00:13:34.933 fused_ordering(1) 00:13:34.933 fused_ordering(2) 00:13:34.933 fused_ordering(3) 00:13:34.933 fused_ordering(4) 00:13:34.933 fused_ordering(5) 00:13:34.933 fused_ordering(6) 00:13:34.933 fused_ordering(7) 00:13:34.933 fused_ordering(8) 00:13:34.933 fused_ordering(9) 00:13:34.933 fused_ordering(10) 00:13:34.933 fused_ordering(11) 00:13:34.933 fused_ordering(12) 00:13:34.933 fused_ordering(13) 00:13:34.933 fused_ordering(14) 00:13:34.933 fused_ordering(15) 00:13:34.933 fused_ordering(16) 00:13:34.933 fused_ordering(17) 00:13:34.933 fused_ordering(18) 00:13:34.933 fused_ordering(19) 00:13:34.933 fused_ordering(20) 00:13:34.933 fused_ordering(21) 00:13:34.933 fused_ordering(22) 00:13:34.933 fused_ordering(23) 00:13:34.933 fused_ordering(24) 00:13:34.933 fused_ordering(25) 00:13:34.933 fused_ordering(26) 00:13:34.933 fused_ordering(27) 00:13:34.933 fused_ordering(28) 00:13:34.933 fused_ordering(29) 00:13:34.933 fused_ordering(30) 00:13:34.933 fused_ordering(31) 00:13:34.933 fused_ordering(32) 00:13:34.933 fused_ordering(33) 00:13:34.933 fused_ordering(34) 00:13:34.933 fused_ordering(35) 00:13:34.933 fused_ordering(36) 00:13:34.933 fused_ordering(37) 00:13:34.933 fused_ordering(38) 00:13:34.933 fused_ordering(39) 00:13:34.933 fused_ordering(40) 00:13:34.933 fused_ordering(41) 00:13:34.933 fused_ordering(42) 00:13:34.933 fused_ordering(43) 00:13:34.933 fused_ordering(44) 00:13:34.933 fused_ordering(45) 00:13:34.933 fused_ordering(46) 00:13:34.933 fused_ordering(47) 00:13:34.933 fused_ordering(48) 00:13:34.933 fused_ordering(49) 00:13:34.933 fused_ordering(50) 00:13:34.933 fused_ordering(51) 00:13:34.933 fused_ordering(52) 00:13:34.933 fused_ordering(53) 00:13:34.933 fused_ordering(54) 00:13:34.933 fused_ordering(55) 00:13:34.933 fused_ordering(56) 00:13:34.933 fused_ordering(57) 00:13:34.933 fused_ordering(58) 00:13:34.933 fused_ordering(59) 00:13:34.933 fused_ordering(60) 00:13:34.933 fused_ordering(61) 00:13:34.933 fused_ordering(62) 00:13:34.933 fused_ordering(63) 00:13:34.933 fused_ordering(64) 00:13:34.933 fused_ordering(65) 00:13:34.933 fused_ordering(66) 00:13:34.933 fused_ordering(67) 00:13:34.933 fused_ordering(68) 00:13:34.933 fused_ordering(69) 00:13:34.933 fused_ordering(70) 00:13:34.933 fused_ordering(71) 00:13:34.933 fused_ordering(72) 00:13:34.933 fused_ordering(73) 00:13:34.933 fused_ordering(74) 00:13:34.933 fused_ordering(75) 00:13:34.933 fused_ordering(76) 00:13:34.933 fused_ordering(77) 00:13:34.933 fused_ordering(78) 00:13:34.933 fused_ordering(79) 00:13:34.933 fused_ordering(80) 00:13:34.933 fused_ordering(81) 00:13:34.933 fused_ordering(82) 00:13:34.933 fused_ordering(83) 00:13:34.933 fused_ordering(84) 00:13:34.933 fused_ordering(85) 00:13:34.933 fused_ordering(86) 00:13:34.933 fused_ordering(87) 00:13:34.933 fused_ordering(88) 00:13:34.933 fused_ordering(89) 00:13:34.933 fused_ordering(90) 00:13:34.933 fused_ordering(91) 00:13:34.933 fused_ordering(92) 00:13:34.933 fused_ordering(93) 00:13:34.933 fused_ordering(94) 00:13:34.933 fused_ordering(95) 00:13:34.933 fused_ordering(96) 00:13:34.933 fused_ordering(97) 00:13:34.933 fused_ordering(98) 00:13:34.933 fused_ordering(99) 00:13:34.933 fused_ordering(100) 00:13:34.933 fused_ordering(101) 00:13:34.933 fused_ordering(102) 00:13:34.933 fused_ordering(103) 00:13:34.933 fused_ordering(104) 00:13:34.933 fused_ordering(105) 00:13:34.933 fused_ordering(106) 00:13:34.933 fused_ordering(107) 00:13:34.933 fused_ordering(108) 00:13:34.933 fused_ordering(109) 00:13:34.933 fused_ordering(110) 00:13:34.933 fused_ordering(111) 00:13:34.933 fused_ordering(112) 00:13:34.933 fused_ordering(113) 00:13:34.933 fused_ordering(114) 00:13:34.933 fused_ordering(115) 00:13:34.933 fused_ordering(116) 00:13:34.933 fused_ordering(117) 00:13:34.933 fused_ordering(118) 00:13:34.933 fused_ordering(119) 00:13:34.933 fused_ordering(120) 00:13:34.933 fused_ordering(121) 00:13:34.933 fused_ordering(122) 00:13:34.933 fused_ordering(123) 00:13:34.933 fused_ordering(124) 00:13:34.933 fused_ordering(125) 00:13:34.933 fused_ordering(126) 00:13:34.933 fused_ordering(127) 00:13:34.933 fused_ordering(128) 00:13:34.933 fused_ordering(129) 00:13:34.933 fused_ordering(130) 00:13:34.933 fused_ordering(131) 00:13:34.933 fused_ordering(132) 00:13:34.933 fused_ordering(133) 00:13:34.933 fused_ordering(134) 00:13:34.933 fused_ordering(135) 00:13:34.933 fused_ordering(136) 00:13:34.933 fused_ordering(137) 00:13:34.933 fused_ordering(138) 00:13:34.933 fused_ordering(139) 00:13:34.933 fused_ordering(140) 00:13:34.933 fused_ordering(141) 00:13:34.933 fused_ordering(142) 00:13:34.933 fused_ordering(143) 00:13:34.933 fused_ordering(144) 00:13:34.933 fused_ordering(145) 00:13:34.933 fused_ordering(146) 00:13:34.933 fused_ordering(147) 00:13:34.933 fused_ordering(148) 00:13:34.933 fused_ordering(149) 00:13:34.933 fused_ordering(150) 00:13:34.933 fused_ordering(151) 00:13:34.933 fused_ordering(152) 00:13:34.933 fused_ordering(153) 00:13:34.933 fused_ordering(154) 00:13:34.933 fused_ordering(155) 00:13:34.933 fused_ordering(156) 00:13:34.933 fused_ordering(157) 00:13:34.933 fused_ordering(158) 00:13:34.933 fused_ordering(159) 00:13:34.933 fused_ordering(160) 00:13:34.933 fused_ordering(161) 00:13:34.933 fused_ordering(162) 00:13:34.933 fused_ordering(163) 00:13:34.933 fused_ordering(164) 00:13:34.933 fused_ordering(165) 00:13:34.933 fused_ordering(166) 00:13:34.933 fused_ordering(167) 00:13:34.933 fused_ordering(168) 00:13:34.933 fused_ordering(169) 00:13:34.933 fused_ordering(170) 00:13:34.933 fused_ordering(171) 00:13:34.933 fused_ordering(172) 00:13:34.933 fused_ordering(173) 00:13:34.933 fused_ordering(174) 00:13:34.933 fused_ordering(175) 00:13:34.933 fused_ordering(176) 00:13:34.933 fused_ordering(177) 00:13:34.933 fused_ordering(178) 00:13:34.934 fused_ordering(179) 00:13:34.934 fused_ordering(180) 00:13:34.934 fused_ordering(181) 00:13:34.934 fused_ordering(182) 00:13:34.934 fused_ordering(183) 00:13:34.934 fused_ordering(184) 00:13:34.934 fused_ordering(185) 00:13:34.934 fused_ordering(186) 00:13:34.934 fused_ordering(187) 00:13:34.934 fused_ordering(188) 00:13:34.934 fused_ordering(189) 00:13:34.934 fused_ordering(190) 00:13:34.934 fused_ordering(191) 00:13:34.934 fused_ordering(192) 00:13:34.934 fused_ordering(193) 00:13:34.934 fused_ordering(194) 00:13:34.934 fused_ordering(195) 00:13:34.934 fused_ordering(196) 00:13:34.934 fused_ordering(197) 00:13:34.934 fused_ordering(198) 00:13:34.934 fused_ordering(199) 00:13:34.934 fused_ordering(200) 00:13:34.934 fused_ordering(201) 00:13:34.934 fused_ordering(202) 00:13:34.934 fused_ordering(203) 00:13:34.934 fused_ordering(204) 00:13:34.934 fused_ordering(205) 00:13:35.192 fused_ordering(206) 00:13:35.192 fused_ordering(207) 00:13:35.192 fused_ordering(208) 00:13:35.192 fused_ordering(209) 00:13:35.192 fused_ordering(210) 00:13:35.192 fused_ordering(211) 00:13:35.192 fused_ordering(212) 00:13:35.192 fused_ordering(213) 00:13:35.192 fused_ordering(214) 00:13:35.192 fused_ordering(215) 00:13:35.192 fused_ordering(216) 00:13:35.192 fused_ordering(217) 00:13:35.192 fused_ordering(218) 00:13:35.192 fused_ordering(219) 00:13:35.192 fused_ordering(220) 00:13:35.192 fused_ordering(221) 00:13:35.192 fused_ordering(222) 00:13:35.192 fused_ordering(223) 00:13:35.192 fused_ordering(224) 00:13:35.192 fused_ordering(225) 00:13:35.192 fused_ordering(226) 00:13:35.192 fused_ordering(227) 00:13:35.192 fused_ordering(228) 00:13:35.192 fused_ordering(229) 00:13:35.192 fused_ordering(230) 00:13:35.192 fused_ordering(231) 00:13:35.192 fused_ordering(232) 00:13:35.192 fused_ordering(233) 00:13:35.192 fused_ordering(234) 00:13:35.192 fused_ordering(235) 00:13:35.192 fused_ordering(236) 00:13:35.192 fused_ordering(237) 00:13:35.192 fused_ordering(238) 00:13:35.192 fused_ordering(239) 00:13:35.192 fused_ordering(240) 00:13:35.192 fused_ordering(241) 00:13:35.192 fused_ordering(242) 00:13:35.192 fused_ordering(243) 00:13:35.192 fused_ordering(244) 00:13:35.192 fused_ordering(245) 00:13:35.192 fused_ordering(246) 00:13:35.192 fused_ordering(247) 00:13:35.192 fused_ordering(248) 00:13:35.192 fused_ordering(249) 00:13:35.192 fused_ordering(250) 00:13:35.192 fused_ordering(251) 00:13:35.192 fused_ordering(252) 00:13:35.192 fused_ordering(253) 00:13:35.192 fused_ordering(254) 00:13:35.192 fused_ordering(255) 00:13:35.192 fused_ordering(256) 00:13:35.192 fused_ordering(257) 00:13:35.192 fused_ordering(258) 00:13:35.192 fused_ordering(259) 00:13:35.192 fused_ordering(260) 00:13:35.192 fused_ordering(261) 00:13:35.192 fused_ordering(262) 00:13:35.192 fused_ordering(263) 00:13:35.192 fused_ordering(264) 00:13:35.192 fused_ordering(265) 00:13:35.192 fused_ordering(266) 00:13:35.192 fused_ordering(267) 00:13:35.192 fused_ordering(268) 00:13:35.192 fused_ordering(269) 00:13:35.192 fused_ordering(270) 00:13:35.192 fused_ordering(271) 00:13:35.192 fused_ordering(272) 00:13:35.192 fused_ordering(273) 00:13:35.192 fused_ordering(274) 00:13:35.192 fused_ordering(275) 00:13:35.192 fused_ordering(276) 00:13:35.192 fused_ordering(277) 00:13:35.192 fused_ordering(278) 00:13:35.192 fused_ordering(279) 00:13:35.192 fused_ordering(280) 00:13:35.192 fused_ordering(281) 00:13:35.192 fused_ordering(282) 00:13:35.192 fused_ordering(283) 00:13:35.192 fused_ordering(284) 00:13:35.192 fused_ordering(285) 00:13:35.192 fused_ordering(286) 00:13:35.192 fused_ordering(287) 00:13:35.192 fused_ordering(288) 00:13:35.192 fused_ordering(289) 00:13:35.192 fused_ordering(290) 00:13:35.192 fused_ordering(291) 00:13:35.192 fused_ordering(292) 00:13:35.192 fused_ordering(293) 00:13:35.192 fused_ordering(294) 00:13:35.192 fused_ordering(295) 00:13:35.192 fused_ordering(296) 00:13:35.192 fused_ordering(297) 00:13:35.192 fused_ordering(298) 00:13:35.192 fused_ordering(299) 00:13:35.192 fused_ordering(300) 00:13:35.192 fused_ordering(301) 00:13:35.192 fused_ordering(302) 00:13:35.192 fused_ordering(303) 00:13:35.192 fused_ordering(304) 00:13:35.192 fused_ordering(305) 00:13:35.192 fused_ordering(306) 00:13:35.192 fused_ordering(307) 00:13:35.192 fused_ordering(308) 00:13:35.192 fused_ordering(309) 00:13:35.192 fused_ordering(310) 00:13:35.192 fused_ordering(311) 00:13:35.192 fused_ordering(312) 00:13:35.192 fused_ordering(313) 00:13:35.192 fused_ordering(314) 00:13:35.192 fused_ordering(315) 00:13:35.192 fused_ordering(316) 00:13:35.192 fused_ordering(317) 00:13:35.192 fused_ordering(318) 00:13:35.192 fused_ordering(319) 00:13:35.192 fused_ordering(320) 00:13:35.192 fused_ordering(321) 00:13:35.192 fused_ordering(322) 00:13:35.192 fused_ordering(323) 00:13:35.192 fused_ordering(324) 00:13:35.192 fused_ordering(325) 00:13:35.192 fused_ordering(326) 00:13:35.192 fused_ordering(327) 00:13:35.192 fused_ordering(328) 00:13:35.192 fused_ordering(329) 00:13:35.192 fused_ordering(330) 00:13:35.192 fused_ordering(331) 00:13:35.192 fused_ordering(332) 00:13:35.192 fused_ordering(333) 00:13:35.192 fused_ordering(334) 00:13:35.192 fused_ordering(335) 00:13:35.192 fused_ordering(336) 00:13:35.192 fused_ordering(337) 00:13:35.192 fused_ordering(338) 00:13:35.192 fused_ordering(339) 00:13:35.192 fused_ordering(340) 00:13:35.192 fused_ordering(341) 00:13:35.192 fused_ordering(342) 00:13:35.192 fused_ordering(343) 00:13:35.192 fused_ordering(344) 00:13:35.192 fused_ordering(345) 00:13:35.192 fused_ordering(346) 00:13:35.192 fused_ordering(347) 00:13:35.192 fused_ordering(348) 00:13:35.192 fused_ordering(349) 00:13:35.192 fused_ordering(350) 00:13:35.192 fused_ordering(351) 00:13:35.192 fused_ordering(352) 00:13:35.192 fused_ordering(353) 00:13:35.192 fused_ordering(354) 00:13:35.192 fused_ordering(355) 00:13:35.192 fused_ordering(356) 00:13:35.192 fused_ordering(357) 00:13:35.192 fused_ordering(358) 00:13:35.192 fused_ordering(359) 00:13:35.192 fused_ordering(360) 00:13:35.192 fused_ordering(361) 00:13:35.192 fused_ordering(362) 00:13:35.192 fused_ordering(363) 00:13:35.192 fused_ordering(364) 00:13:35.192 fused_ordering(365) 00:13:35.192 fused_ordering(366) 00:13:35.192 fused_ordering(367) 00:13:35.192 fused_ordering(368) 00:13:35.192 fused_ordering(369) 00:13:35.192 fused_ordering(370) 00:13:35.192 fused_ordering(371) 00:13:35.192 fused_ordering(372) 00:13:35.192 fused_ordering(373) 00:13:35.192 fused_ordering(374) 00:13:35.192 fused_ordering(375) 00:13:35.192 fused_ordering(376) 00:13:35.192 fused_ordering(377) 00:13:35.192 fused_ordering(378) 00:13:35.192 fused_ordering(379) 00:13:35.192 fused_ordering(380) 00:13:35.192 fused_ordering(381) 00:13:35.192 fused_ordering(382) 00:13:35.192 fused_ordering(383) 00:13:35.192 fused_ordering(384) 00:13:35.192 fused_ordering(385) 00:13:35.192 fused_ordering(386) 00:13:35.192 fused_ordering(387) 00:13:35.192 fused_ordering(388) 00:13:35.192 fused_ordering(389) 00:13:35.192 fused_ordering(390) 00:13:35.192 fused_ordering(391) 00:13:35.192 fused_ordering(392) 00:13:35.192 fused_ordering(393) 00:13:35.192 fused_ordering(394) 00:13:35.192 fused_ordering(395) 00:13:35.192 fused_ordering(396) 00:13:35.192 fused_ordering(397) 00:13:35.192 fused_ordering(398) 00:13:35.192 fused_ordering(399) 00:13:35.192 fused_ordering(400) 00:13:35.192 fused_ordering(401) 00:13:35.192 fused_ordering(402) 00:13:35.192 fused_ordering(403) 00:13:35.192 fused_ordering(404) 00:13:35.192 fused_ordering(405) 00:13:35.192 fused_ordering(406) 00:13:35.192 fused_ordering(407) 00:13:35.192 fused_ordering(408) 00:13:35.192 fused_ordering(409) 00:13:35.192 fused_ordering(410) 00:13:35.758 fused_ordering(411) 00:13:35.758 fused_ordering(412) 00:13:35.758 fused_ordering(413) 00:13:35.758 fused_ordering(414) 00:13:35.758 fused_ordering(415) 00:13:35.758 fused_ordering(416) 00:13:35.758 fused_ordering(417) 00:13:35.758 fused_ordering(418) 00:13:35.758 fused_ordering(419) 00:13:35.758 fused_ordering(420) 00:13:35.758 fused_ordering(421) 00:13:35.758 fused_ordering(422) 00:13:35.758 fused_ordering(423) 00:13:35.758 fused_ordering(424) 00:13:35.758 fused_ordering(425) 00:13:35.758 fused_ordering(426) 00:13:35.758 fused_ordering(427) 00:13:35.758 fused_ordering(428) 00:13:35.758 fused_ordering(429) 00:13:35.758 fused_ordering(430) 00:13:35.758 fused_ordering(431) 00:13:35.758 fused_ordering(432) 00:13:35.758 fused_ordering(433) 00:13:35.758 fused_ordering(434) 00:13:35.758 fused_ordering(435) 00:13:35.758 fused_ordering(436) 00:13:35.758 fused_ordering(437) 00:13:35.758 fused_ordering(438) 00:13:35.758 fused_ordering(439) 00:13:35.758 fused_ordering(440) 00:13:35.758 fused_ordering(441) 00:13:35.758 fused_ordering(442) 00:13:35.758 fused_ordering(443) 00:13:35.758 fused_ordering(444) 00:13:35.758 fused_ordering(445) 00:13:35.758 fused_ordering(446) 00:13:35.758 fused_ordering(447) 00:13:35.758 fused_ordering(448) 00:13:35.758 fused_ordering(449) 00:13:35.758 fused_ordering(450) 00:13:35.758 fused_ordering(451) 00:13:35.758 fused_ordering(452) 00:13:35.758 fused_ordering(453) 00:13:35.758 fused_ordering(454) 00:13:35.758 fused_ordering(455) 00:13:35.758 fused_ordering(456) 00:13:35.758 fused_ordering(457) 00:13:35.758 fused_ordering(458) 00:13:35.758 fused_ordering(459) 00:13:35.758 fused_ordering(460) 00:13:35.758 fused_ordering(461) 00:13:35.758 fused_ordering(462) 00:13:35.758 fused_ordering(463) 00:13:35.758 fused_ordering(464) 00:13:35.758 fused_ordering(465) 00:13:35.758 fused_ordering(466) 00:13:35.758 fused_ordering(467) 00:13:35.758 fused_ordering(468) 00:13:35.758 fused_ordering(469) 00:13:35.758 fused_ordering(470) 00:13:35.758 fused_ordering(471) 00:13:35.758 fused_ordering(472) 00:13:35.758 fused_ordering(473) 00:13:35.758 fused_ordering(474) 00:13:35.758 fused_ordering(475) 00:13:35.758 fused_ordering(476) 00:13:35.758 fused_ordering(477) 00:13:35.758 fused_ordering(478) 00:13:35.758 fused_ordering(479) 00:13:35.758 fused_ordering(480) 00:13:35.758 fused_ordering(481) 00:13:35.758 fused_ordering(482) 00:13:35.758 fused_ordering(483) 00:13:35.758 fused_ordering(484) 00:13:35.758 fused_ordering(485) 00:13:35.758 fused_ordering(486) 00:13:35.758 fused_ordering(487) 00:13:35.758 fused_ordering(488) 00:13:35.758 fused_ordering(489) 00:13:35.758 fused_ordering(490) 00:13:35.758 fused_ordering(491) 00:13:35.758 fused_ordering(492) 00:13:35.758 fused_ordering(493) 00:13:35.758 fused_ordering(494) 00:13:35.758 fused_ordering(495) 00:13:35.758 fused_ordering(496) 00:13:35.758 fused_ordering(497) 00:13:35.758 fused_ordering(498) 00:13:35.758 fused_ordering(499) 00:13:35.758 fused_ordering(500) 00:13:35.758 fused_ordering(501) 00:13:35.758 fused_ordering(502) 00:13:35.758 fused_ordering(503) 00:13:35.758 fused_ordering(504) 00:13:35.758 fused_ordering(505) 00:13:35.758 fused_ordering(506) 00:13:35.758 fused_ordering(507) 00:13:35.758 fused_ordering(508) 00:13:35.758 fused_ordering(509) 00:13:35.758 fused_ordering(510) 00:13:35.758 fused_ordering(511) 00:13:35.758 fused_ordering(512) 00:13:35.758 fused_ordering(513) 00:13:35.758 fused_ordering(514) 00:13:35.758 fused_ordering(515) 00:13:35.758 fused_ordering(516) 00:13:35.758 fused_ordering(517) 00:13:35.758 fused_ordering(518) 00:13:35.758 fused_ordering(519) 00:13:35.758 fused_ordering(520) 00:13:35.758 fused_ordering(521) 00:13:35.758 fused_ordering(522) 00:13:35.758 fused_ordering(523) 00:13:35.758 fused_ordering(524) 00:13:35.758 fused_ordering(525) 00:13:35.758 fused_ordering(526) 00:13:35.758 fused_ordering(527) 00:13:35.758 fused_ordering(528) 00:13:35.758 fused_ordering(529) 00:13:35.758 fused_ordering(530) 00:13:35.758 fused_ordering(531) 00:13:35.758 fused_ordering(532) 00:13:35.758 fused_ordering(533) 00:13:35.758 fused_ordering(534) 00:13:35.758 fused_ordering(535) 00:13:35.758 fused_ordering(536) 00:13:35.758 fused_ordering(537) 00:13:35.758 fused_ordering(538) 00:13:35.758 fused_ordering(539) 00:13:35.758 fused_ordering(540) 00:13:35.758 fused_ordering(541) 00:13:35.758 fused_ordering(542) 00:13:35.758 fused_ordering(543) 00:13:35.758 fused_ordering(544) 00:13:35.758 fused_ordering(545) 00:13:35.758 fused_ordering(546) 00:13:35.758 fused_ordering(547) 00:13:35.758 fused_ordering(548) 00:13:35.758 fused_ordering(549) 00:13:35.758 fused_ordering(550) 00:13:35.758 fused_ordering(551) 00:13:35.758 fused_ordering(552) 00:13:35.758 fused_ordering(553) 00:13:35.758 fused_ordering(554) 00:13:35.758 fused_ordering(555) 00:13:35.758 fused_ordering(556) 00:13:35.758 fused_ordering(557) 00:13:35.758 fused_ordering(558) 00:13:35.758 fused_ordering(559) 00:13:35.758 fused_ordering(560) 00:13:35.758 fused_ordering(561) 00:13:35.758 fused_ordering(562) 00:13:35.758 fused_ordering(563) 00:13:35.759 fused_ordering(564) 00:13:35.759 fused_ordering(565) 00:13:35.759 fused_ordering(566) 00:13:35.759 fused_ordering(567) 00:13:35.759 fused_ordering(568) 00:13:35.759 fused_ordering(569) 00:13:35.759 fused_ordering(570) 00:13:35.759 fused_ordering(571) 00:13:35.759 fused_ordering(572) 00:13:35.759 fused_ordering(573) 00:13:35.759 fused_ordering(574) 00:13:35.759 fused_ordering(575) 00:13:35.759 fused_ordering(576) 00:13:35.759 fused_ordering(577) 00:13:35.759 fused_ordering(578) 00:13:35.759 fused_ordering(579) 00:13:35.759 fused_ordering(580) 00:13:35.759 fused_ordering(581) 00:13:35.759 fused_ordering(582) 00:13:35.759 fused_ordering(583) 00:13:35.759 fused_ordering(584) 00:13:35.759 fused_ordering(585) 00:13:35.759 fused_ordering(586) 00:13:35.759 fused_ordering(587) 00:13:35.759 fused_ordering(588) 00:13:35.759 fused_ordering(589) 00:13:35.759 fused_ordering(590) 00:13:35.759 fused_ordering(591) 00:13:35.759 fused_ordering(592) 00:13:35.759 fused_ordering(593) 00:13:35.759 fused_ordering(594) 00:13:35.759 fused_ordering(595) 00:13:35.759 fused_ordering(596) 00:13:35.759 fused_ordering(597) 00:13:35.759 fused_ordering(598) 00:13:35.759 fused_ordering(599) 00:13:35.759 fused_ordering(600) 00:13:35.759 fused_ordering(601) 00:13:35.759 fused_ordering(602) 00:13:35.759 fused_ordering(603) 00:13:35.759 fused_ordering(604) 00:13:35.759 fused_ordering(605) 00:13:35.759 fused_ordering(606) 00:13:35.759 fused_ordering(607) 00:13:35.759 fused_ordering(608) 00:13:35.759 fused_ordering(609) 00:13:35.759 fused_ordering(610) 00:13:35.759 fused_ordering(611) 00:13:35.759 fused_ordering(612) 00:13:35.759 fused_ordering(613) 00:13:35.759 fused_ordering(614) 00:13:35.759 fused_ordering(615) 00:13:36.324 fused_ordering(616) 00:13:36.324 fused_ordering(617) 00:13:36.324 fused_ordering(618) 00:13:36.324 fused_ordering(619) 00:13:36.324 fused_ordering(620) 00:13:36.324 fused_ordering(621) 00:13:36.324 fused_ordering(622) 00:13:36.324 fused_ordering(623) 00:13:36.324 fused_ordering(624) 00:13:36.324 fused_ordering(625) 00:13:36.324 fused_ordering(626) 00:13:36.324 fused_ordering(627) 00:13:36.324 fused_ordering(628) 00:13:36.324 fused_ordering(629) 00:13:36.324 fused_ordering(630) 00:13:36.324 fused_ordering(631) 00:13:36.324 fused_ordering(632) 00:13:36.324 fused_ordering(633) 00:13:36.324 fused_ordering(634) 00:13:36.324 fused_ordering(635) 00:13:36.324 fused_ordering(636) 00:13:36.324 fused_ordering(637) 00:13:36.324 fused_ordering(638) 00:13:36.324 fused_ordering(639) 00:13:36.324 fused_ordering(640) 00:13:36.324 fused_ordering(641) 00:13:36.324 fused_ordering(642) 00:13:36.324 fused_ordering(643) 00:13:36.324 fused_ordering(644) 00:13:36.324 fused_ordering(645) 00:13:36.324 fused_ordering(646) 00:13:36.324 fused_ordering(647) 00:13:36.324 fused_ordering(648) 00:13:36.324 fused_ordering(649) 00:13:36.324 fused_ordering(650) 00:13:36.324 fused_ordering(651) 00:13:36.324 fused_ordering(652) 00:13:36.324 fused_ordering(653) 00:13:36.324 fused_ordering(654) 00:13:36.324 fused_ordering(655) 00:13:36.324 fused_ordering(656) 00:13:36.324 fused_ordering(657) 00:13:36.324 fused_ordering(658) 00:13:36.324 fused_ordering(659) 00:13:36.324 fused_ordering(660) 00:13:36.324 fused_ordering(661) 00:13:36.324 fused_ordering(662) 00:13:36.324 fused_ordering(663) 00:13:36.324 fused_ordering(664) 00:13:36.324 fused_ordering(665) 00:13:36.324 fused_ordering(666) 00:13:36.324 fused_ordering(667) 00:13:36.324 fused_ordering(668) 00:13:36.325 fused_ordering(669) 00:13:36.325 fused_ordering(670) 00:13:36.325 fused_ordering(671) 00:13:36.325 fused_ordering(672) 00:13:36.325 fused_ordering(673) 00:13:36.325 fused_ordering(674) 00:13:36.325 fused_ordering(675) 00:13:36.325 fused_ordering(676) 00:13:36.325 fused_ordering(677) 00:13:36.325 fused_ordering(678) 00:13:36.325 fused_ordering(679) 00:13:36.325 fused_ordering(680) 00:13:36.325 fused_ordering(681) 00:13:36.325 fused_ordering(682) 00:13:36.325 fused_ordering(683) 00:13:36.325 fused_ordering(684) 00:13:36.325 fused_ordering(685) 00:13:36.325 fused_ordering(686) 00:13:36.325 fused_ordering(687) 00:13:36.325 fused_ordering(688) 00:13:36.325 fused_ordering(689) 00:13:36.325 fused_ordering(690) 00:13:36.325 fused_ordering(691) 00:13:36.325 fused_ordering(692) 00:13:36.325 fused_ordering(693) 00:13:36.325 fused_ordering(694) 00:13:36.325 fused_ordering(695) 00:13:36.325 fused_ordering(696) 00:13:36.325 fused_ordering(697) 00:13:36.325 fused_ordering(698) 00:13:36.325 fused_ordering(699) 00:13:36.325 fused_ordering(700) 00:13:36.325 fused_ordering(701) 00:13:36.325 fused_ordering(702) 00:13:36.325 fused_ordering(703) 00:13:36.325 fused_ordering(704) 00:13:36.325 fused_ordering(705) 00:13:36.325 fused_ordering(706) 00:13:36.325 fused_ordering(707) 00:13:36.325 fused_ordering(708) 00:13:36.325 fused_ordering(709) 00:13:36.325 fused_ordering(710) 00:13:36.325 fused_ordering(711) 00:13:36.325 fused_ordering(712) 00:13:36.325 fused_ordering(713) 00:13:36.325 fused_ordering(714) 00:13:36.325 fused_ordering(715) 00:13:36.325 fused_ordering(716) 00:13:36.325 fused_ordering(717) 00:13:36.325 fused_ordering(718) 00:13:36.325 fused_ordering(719) 00:13:36.325 fused_ordering(720) 00:13:36.325 fused_ordering(721) 00:13:36.325 fused_ordering(722) 00:13:36.325 fused_ordering(723) 00:13:36.325 fused_ordering(724) 00:13:36.325 fused_ordering(725) 00:13:36.325 fused_ordering(726) 00:13:36.325 fused_ordering(727) 00:13:36.325 fused_ordering(728) 00:13:36.325 fused_ordering(729) 00:13:36.325 fused_ordering(730) 00:13:36.325 fused_ordering(731) 00:13:36.325 fused_ordering(732) 00:13:36.325 fused_ordering(733) 00:13:36.325 fused_ordering(734) 00:13:36.325 fused_ordering(735) 00:13:36.325 fused_ordering(736) 00:13:36.325 fused_ordering(737) 00:13:36.325 fused_ordering(738) 00:13:36.325 fused_ordering(739) 00:13:36.325 fused_ordering(740) 00:13:36.325 fused_ordering(741) 00:13:36.325 fused_ordering(742) 00:13:36.325 fused_ordering(743) 00:13:36.325 fused_ordering(744) 00:13:36.325 fused_ordering(745) 00:13:36.325 fused_ordering(746) 00:13:36.325 fused_ordering(747) 00:13:36.325 fused_ordering(748) 00:13:36.325 fused_ordering(749) 00:13:36.325 fused_ordering(750) 00:13:36.325 fused_ordering(751) 00:13:36.325 fused_ordering(752) 00:13:36.325 fused_ordering(753) 00:13:36.325 fused_ordering(754) 00:13:36.325 fused_ordering(755) 00:13:36.325 fused_ordering(756) 00:13:36.325 fused_ordering(757) 00:13:36.325 fused_ordering(758) 00:13:36.325 fused_ordering(759) 00:13:36.325 fused_ordering(760) 00:13:36.325 fused_ordering(761) 00:13:36.325 fused_ordering(762) 00:13:36.325 fused_ordering(763) 00:13:36.325 fused_ordering(764) 00:13:36.325 fused_ordering(765) 00:13:36.325 fused_ordering(766) 00:13:36.325 fused_ordering(767) 00:13:36.325 fused_ordering(768) 00:13:36.325 fused_ordering(769) 00:13:36.325 fused_ordering(770) 00:13:36.325 fused_ordering(771) 00:13:36.325 fused_ordering(772) 00:13:36.325 fused_ordering(773) 00:13:36.325 fused_ordering(774) 00:13:36.325 fused_ordering(775) 00:13:36.325 fused_ordering(776) 00:13:36.325 fused_ordering(777) 00:13:36.325 fused_ordering(778) 00:13:36.325 fused_ordering(779) 00:13:36.325 fused_ordering(780) 00:13:36.325 fused_ordering(781) 00:13:36.325 fused_ordering(782) 00:13:36.325 fused_ordering(783) 00:13:36.325 fused_ordering(784) 00:13:36.325 fused_ordering(785) 00:13:36.325 fused_ordering(786) 00:13:36.325 fused_ordering(787) 00:13:36.325 fused_ordering(788) 00:13:36.325 fused_ordering(789) 00:13:36.325 fused_ordering(790) 00:13:36.325 fused_ordering(791) 00:13:36.325 fused_ordering(792) 00:13:36.325 fused_ordering(793) 00:13:36.325 fused_ordering(794) 00:13:36.325 fused_ordering(795) 00:13:36.325 fused_ordering(796) 00:13:36.325 fused_ordering(797) 00:13:36.325 fused_ordering(798) 00:13:36.325 fused_ordering(799) 00:13:36.325 fused_ordering(800) 00:13:36.325 fused_ordering(801) 00:13:36.325 fused_ordering(802) 00:13:36.325 fused_ordering(803) 00:13:36.325 fused_ordering(804) 00:13:36.325 fused_ordering(805) 00:13:36.325 fused_ordering(806) 00:13:36.325 fused_ordering(807) 00:13:36.325 fused_ordering(808) 00:13:36.325 fused_ordering(809) 00:13:36.325 fused_ordering(810) 00:13:36.325 fused_ordering(811) 00:13:36.325 fused_ordering(812) 00:13:36.325 fused_ordering(813) 00:13:36.325 fused_ordering(814) 00:13:36.325 fused_ordering(815) 00:13:36.325 fused_ordering(816) 00:13:36.325 fused_ordering(817) 00:13:36.325 fused_ordering(818) 00:13:36.325 fused_ordering(819) 00:13:36.325 fused_ordering(820) 00:13:37.259 fused_ordering(821) 00:13:37.259 fused_ordering(822) 00:13:37.259 fused_ordering(823) 00:13:37.259 fused_ordering(824) 00:13:37.259 fused_ordering(825) 00:13:37.259 fused_ordering(826) 00:13:37.259 fused_ordering(827) 00:13:37.259 fused_ordering(828) 00:13:37.259 fused_ordering(829) 00:13:37.259 fused_ordering(830) 00:13:37.259 fused_ordering(831) 00:13:37.259 fused_ordering(832) 00:13:37.259 fused_ordering(833) 00:13:37.259 fused_ordering(834) 00:13:37.259 fused_ordering(835) 00:13:37.259 fused_ordering(836) 00:13:37.259 fused_ordering(837) 00:13:37.259 fused_ordering(838) 00:13:37.259 fused_ordering(839) 00:13:37.259 fused_ordering(840) 00:13:37.259 fused_ordering(841) 00:13:37.259 fused_ordering(842) 00:13:37.259 fused_ordering(843) 00:13:37.259 fused_ordering(844) 00:13:37.259 fused_ordering(845) 00:13:37.259 fused_ordering(846) 00:13:37.259 fused_ordering(847) 00:13:37.259 fused_ordering(848) 00:13:37.259 fused_ordering(849) 00:13:37.259 fused_ordering(850) 00:13:37.259 fused_ordering(851) 00:13:37.259 fused_ordering(852) 00:13:37.259 fused_ordering(853) 00:13:37.259 fused_ordering(854) 00:13:37.259 fused_ordering(855) 00:13:37.259 fused_ordering(856) 00:13:37.259 fused_ordering(857) 00:13:37.259 fused_ordering(858) 00:13:37.259 fused_ordering(859) 00:13:37.259 fused_ordering(860) 00:13:37.259 fused_ordering(861) 00:13:37.259 fused_ordering(862) 00:13:37.259 fused_ordering(863) 00:13:37.259 fused_ordering(864) 00:13:37.259 fused_ordering(865) 00:13:37.259 fused_ordering(866) 00:13:37.259 fused_ordering(867) 00:13:37.259 fused_ordering(868) 00:13:37.259 fused_ordering(869) 00:13:37.259 fused_ordering(870) 00:13:37.259 fused_ordering(871) 00:13:37.259 fused_ordering(872) 00:13:37.259 fused_ordering(873) 00:13:37.259 fused_ordering(874) 00:13:37.259 fused_ordering(875) 00:13:37.259 fused_ordering(876) 00:13:37.259 fused_ordering(877) 00:13:37.259 fused_ordering(878) 00:13:37.259 fused_ordering(879) 00:13:37.259 fused_ordering(880) 00:13:37.259 fused_ordering(881) 00:13:37.259 fused_ordering(882) 00:13:37.259 fused_ordering(883) 00:13:37.259 fused_ordering(884) 00:13:37.259 fused_ordering(885) 00:13:37.260 fused_ordering(886) 00:13:37.260 fused_ordering(887) 00:13:37.260 fused_ordering(888) 00:13:37.260 fused_ordering(889) 00:13:37.260 fused_ordering(890) 00:13:37.260 fused_ordering(891) 00:13:37.260 fused_ordering(892) 00:13:37.260 fused_ordering(893) 00:13:37.260 fused_ordering(894) 00:13:37.260 fused_ordering(895) 00:13:37.260 fused_ordering(896) 00:13:37.260 fused_ordering(897) 00:13:37.260 fused_ordering(898) 00:13:37.260 fused_ordering(899) 00:13:37.260 fused_ordering(900) 00:13:37.260 fused_ordering(901) 00:13:37.260 fused_ordering(902) 00:13:37.260 fused_ordering(903) 00:13:37.260 fused_ordering(904) 00:13:37.260 fused_ordering(905) 00:13:37.260 fused_ordering(906) 00:13:37.260 fused_ordering(907) 00:13:37.260 fused_ordering(908) 00:13:37.260 fused_ordering(909) 00:13:37.260 fused_ordering(910) 00:13:37.260 fused_ordering(911) 00:13:37.260 fused_ordering(912) 00:13:37.260 fused_ordering(913) 00:13:37.260 fused_ordering(914) 00:13:37.260 fused_ordering(915) 00:13:37.260 fused_ordering(916) 00:13:37.260 fused_ordering(917) 00:13:37.260 fused_ordering(918) 00:13:37.260 fused_ordering(919) 00:13:37.260 fused_ordering(920) 00:13:37.260 fused_ordering(921) 00:13:37.260 fused_ordering(922) 00:13:37.260 fused_ordering(923) 00:13:37.260 fused_ordering(924) 00:13:37.260 fused_ordering(925) 00:13:37.260 fused_ordering(926) 00:13:37.260 fused_ordering(927) 00:13:37.260 fused_ordering(928) 00:13:37.260 fused_ordering(929) 00:13:37.260 fused_ordering(930) 00:13:37.260 fused_ordering(931) 00:13:37.260 fused_ordering(932) 00:13:37.260 fused_ordering(933) 00:13:37.260 fused_ordering(934) 00:13:37.260 fused_ordering(935) 00:13:37.260 fused_ordering(936) 00:13:37.260 fused_ordering(937) 00:13:37.260 fused_ordering(938) 00:13:37.260 fused_ordering(939) 00:13:37.260 fused_ordering(940) 00:13:37.260 fused_ordering(941) 00:13:37.260 fused_ordering(942) 00:13:37.260 fused_ordering(943) 00:13:37.260 fused_ordering(944) 00:13:37.260 fused_ordering(945) 00:13:37.260 fused_ordering(946) 00:13:37.260 fused_ordering(947) 00:13:37.260 fused_ordering(948) 00:13:37.260 fused_ordering(949) 00:13:37.260 fused_ordering(950) 00:13:37.260 fused_ordering(951) 00:13:37.260 fused_ordering(952) 00:13:37.260 fused_ordering(953) 00:13:37.260 fused_ordering(954) 00:13:37.260 fused_ordering(955) 00:13:37.260 fused_ordering(956) 00:13:37.260 fused_ordering(957) 00:13:37.260 fused_ordering(958) 00:13:37.260 fused_ordering(959) 00:13:37.260 fused_ordering(960) 00:13:37.260 fused_ordering(961) 00:13:37.260 fused_ordering(962) 00:13:37.260 fused_ordering(963) 00:13:37.260 fused_ordering(964) 00:13:37.260 fused_ordering(965) 00:13:37.260 fused_ordering(966) 00:13:37.260 fused_ordering(967) 00:13:37.260 fused_ordering(968) 00:13:37.260 fused_ordering(969) 00:13:37.260 fused_ordering(970) 00:13:37.260 fused_ordering(971) 00:13:37.260 fused_ordering(972) 00:13:37.260 fused_ordering(973) 00:13:37.260 fused_ordering(974) 00:13:37.260 fused_ordering(975) 00:13:37.260 fused_ordering(976) 00:13:37.260 fused_ordering(977) 00:13:37.260 fused_ordering(978) 00:13:37.260 fused_ordering(979) 00:13:37.260 fused_ordering(980) 00:13:37.260 fused_ordering(981) 00:13:37.260 fused_ordering(982) 00:13:37.260 fused_ordering(983) 00:13:37.260 fused_ordering(984) 00:13:37.260 fused_ordering(985) 00:13:37.260 fused_ordering(986) 00:13:37.260 fused_ordering(987) 00:13:37.260 fused_ordering(988) 00:13:37.260 fused_ordering(989) 00:13:37.260 fused_ordering(990) 00:13:37.260 fused_ordering(991) 00:13:37.260 fused_ordering(992) 00:13:37.260 fused_ordering(993) 00:13:37.260 fused_ordering(994) 00:13:37.260 fused_ordering(995) 00:13:37.260 fused_ordering(996) 00:13:37.260 fused_ordering(997) 00:13:37.260 fused_ordering(998) 00:13:37.260 fused_ordering(999) 00:13:37.260 fused_ordering(1000) 00:13:37.260 fused_ordering(1001) 00:13:37.260 fused_ordering(1002) 00:13:37.260 fused_ordering(1003) 00:13:37.260 fused_ordering(1004) 00:13:37.260 fused_ordering(1005) 00:13:37.260 fused_ordering(1006) 00:13:37.260 fused_ordering(1007) 00:13:37.260 fused_ordering(1008) 00:13:37.260 fused_ordering(1009) 00:13:37.260 fused_ordering(1010) 00:13:37.260 fused_ordering(1011) 00:13:37.260 fused_ordering(1012) 00:13:37.260 fused_ordering(1013) 00:13:37.260 fused_ordering(1014) 00:13:37.260 fused_ordering(1015) 00:13:37.260 fused_ordering(1016) 00:13:37.260 fused_ordering(1017) 00:13:37.260 fused_ordering(1018) 00:13:37.260 fused_ordering(1019) 00:13:37.260 fused_ordering(1020) 00:13:37.260 fused_ordering(1021) 00:13:37.260 fused_ordering(1022) 00:13:37.260 fused_ordering(1023) 00:13:37.260 19:11:55 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:37.260 19:11:55 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:37.260 19:11:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:37.260 19:11:55 -- nvmf/common.sh@116 -- # sync 00:13:37.260 19:11:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:37.260 19:11:55 -- nvmf/common.sh@119 -- # set +e 00:13:37.260 19:11:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:37.260 19:11:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:37.260 rmmod nvme_tcp 00:13:37.260 rmmod nvme_fabrics 00:13:37.260 rmmod nvme_keyring 00:13:37.260 19:11:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:37.260 19:11:55 -- nvmf/common.sh@123 -- # set -e 00:13:37.260 19:11:55 -- nvmf/common.sh@124 -- # return 0 00:13:37.260 19:11:55 -- nvmf/common.sh@477 -- # '[' -n 3408709 ']' 00:13:37.260 19:11:55 -- nvmf/common.sh@478 -- # killprocess 3408709 00:13:37.260 19:11:55 -- common/autotest_common.sh@936 -- # '[' -z 3408709 ']' 00:13:37.260 19:11:55 -- common/autotest_common.sh@940 -- # kill -0 3408709 00:13:37.260 19:11:55 -- common/autotest_common.sh@941 -- # uname 00:13:37.260 19:11:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:37.260 19:11:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3408709 00:13:37.260 19:11:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:37.260 19:11:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:37.260 19:11:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3408709' 00:13:37.260 killing process with pid 3408709 00:13:37.260 19:11:55 -- common/autotest_common.sh@955 -- # kill 3408709 00:13:37.260 19:11:55 -- common/autotest_common.sh@960 -- # wait 3408709 00:13:37.518 19:11:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:37.518 19:11:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:37.518 19:11:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:37.518 19:11:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:37.518 19:11:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:37.519 19:11:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.519 19:11:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.519 19:11:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.419 19:11:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:39.419 00:13:39.419 real 0m8.202s 00:13:39.419 user 0m6.102s 00:13:39.419 sys 0m3.107s 00:13:39.419 19:11:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:39.419 19:11:57 -- common/autotest_common.sh@10 -- # set +x 00:13:39.419 ************************************ 00:13:39.419 END TEST nvmf_fused_ordering 00:13:39.419 ************************************ 00:13:39.419 19:11:57 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:39.419 19:11:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:39.419 19:11:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:39.419 19:11:57 -- common/autotest_common.sh@10 -- # set +x 00:13:39.419 ************************************ 00:13:39.419 START TEST nvmf_delete_subsystem 00:13:39.419 ************************************ 00:13:39.419 19:11:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:39.419 * Looking for test storage... 00:13:39.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:39.419 19:11:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:39.419 19:11:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:39.419 19:11:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:39.678 19:11:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:39.678 19:11:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:39.678 19:11:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:39.678 19:11:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:39.678 19:11:58 -- scripts/common.sh@335 -- # IFS=.-: 00:13:39.678 19:11:58 -- scripts/common.sh@335 -- # read -ra ver1 00:13:39.678 19:11:58 -- scripts/common.sh@336 -- # IFS=.-: 00:13:39.678 19:11:58 -- scripts/common.sh@336 -- # read -ra ver2 00:13:39.678 19:11:58 -- scripts/common.sh@337 -- # local 'op=<' 00:13:39.678 19:11:58 -- scripts/common.sh@339 -- # ver1_l=2 00:13:39.678 19:11:58 -- scripts/common.sh@340 -- # ver2_l=1 00:13:39.678 19:11:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:39.678 19:11:58 -- scripts/common.sh@343 -- # case "$op" in 00:13:39.678 19:11:58 -- scripts/common.sh@344 -- # : 1 00:13:39.678 19:11:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:39.678 19:11:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:39.678 19:11:58 -- scripts/common.sh@364 -- # decimal 1 00:13:39.678 19:11:58 -- scripts/common.sh@352 -- # local d=1 00:13:39.678 19:11:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:39.678 19:11:58 -- scripts/common.sh@354 -- # echo 1 00:13:39.678 19:11:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:39.678 19:11:58 -- scripts/common.sh@365 -- # decimal 2 00:13:39.678 19:11:58 -- scripts/common.sh@352 -- # local d=2 00:13:39.678 19:11:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:39.678 19:11:58 -- scripts/common.sh@354 -- # echo 2 00:13:39.678 19:11:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:39.678 19:11:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:39.678 19:11:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:39.678 19:11:58 -- scripts/common.sh@367 -- # return 0 00:13:39.678 19:11:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:39.678 19:11:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:39.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.678 --rc genhtml_branch_coverage=1 00:13:39.678 --rc genhtml_function_coverage=1 00:13:39.678 --rc genhtml_legend=1 00:13:39.678 --rc geninfo_all_blocks=1 00:13:39.678 --rc geninfo_unexecuted_blocks=1 00:13:39.678 00:13:39.678 ' 00:13:39.678 19:11:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:39.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.678 --rc genhtml_branch_coverage=1 00:13:39.678 --rc genhtml_function_coverage=1 00:13:39.678 --rc genhtml_legend=1 00:13:39.678 --rc geninfo_all_blocks=1 00:13:39.678 --rc geninfo_unexecuted_blocks=1 00:13:39.678 00:13:39.678 ' 00:13:39.678 19:11:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:39.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.678 --rc genhtml_branch_coverage=1 00:13:39.678 --rc genhtml_function_coverage=1 00:13:39.678 --rc genhtml_legend=1 00:13:39.678 --rc geninfo_all_blocks=1 00:13:39.678 --rc geninfo_unexecuted_blocks=1 00:13:39.678 00:13:39.678 ' 00:13:39.678 19:11:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:39.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.678 --rc genhtml_branch_coverage=1 00:13:39.678 --rc genhtml_function_coverage=1 00:13:39.678 --rc genhtml_legend=1 00:13:39.678 --rc geninfo_all_blocks=1 00:13:39.678 --rc geninfo_unexecuted_blocks=1 00:13:39.678 00:13:39.678 ' 00:13:39.678 19:11:58 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:39.678 19:11:58 -- nvmf/common.sh@7 -- # uname -s 00:13:39.678 19:11:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:39.678 19:11:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:39.678 19:11:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:39.678 19:11:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:39.678 19:11:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:39.678 19:11:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:39.678 19:11:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:39.678 19:11:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:39.678 19:11:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:39.678 19:11:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:39.678 19:11:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.678 19:11:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.678 19:11:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:39.678 19:11:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:39.678 19:11:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:39.679 19:11:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:39.679 19:11:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:39.679 19:11:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:39.679 19:11:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:39.679 19:11:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.679 19:11:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.679 19:11:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.679 19:11:58 -- paths/export.sh@5 -- # export PATH 00:13:39.679 19:11:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.679 19:11:58 -- nvmf/common.sh@46 -- # : 0 00:13:39.679 19:11:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:39.679 19:11:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:39.679 19:11:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:39.679 19:11:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:39.679 19:11:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:39.679 19:11:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:39.679 19:11:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:39.679 19:11:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:39.679 19:11:58 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:39.679 19:11:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:39.679 19:11:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:39.679 19:11:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:39.679 19:11:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:39.679 19:11:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:39.679 19:11:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.679 19:11:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.679 19:11:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.679 19:11:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:39.679 19:11:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:39.679 19:11:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:39.679 19:11:58 -- common/autotest_common.sh@10 -- # set +x 00:13:41.578 19:12:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:41.578 19:12:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:41.578 19:12:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:41.578 19:12:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:41.578 19:12:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:41.578 19:12:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:41.578 19:12:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:41.578 19:12:00 -- nvmf/common.sh@294 -- # net_devs=() 00:13:41.578 19:12:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:41.578 19:12:00 -- nvmf/common.sh@295 -- # e810=() 00:13:41.578 19:12:00 -- nvmf/common.sh@295 -- # local -ga e810 00:13:41.578 19:12:00 -- nvmf/common.sh@296 -- # x722=() 00:13:41.579 19:12:00 -- nvmf/common.sh@296 -- # local -ga x722 00:13:41.579 19:12:00 -- nvmf/common.sh@297 -- # mlx=() 00:13:41.579 19:12:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:41.579 19:12:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:41.579 19:12:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:41.579 19:12:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:41.579 19:12:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:41.579 19:12:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.579 19:12:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:41.579 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:41.579 19:12:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.579 19:12:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:41.579 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:41.579 19:12:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:41.579 19:12:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.579 19:12:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.579 19:12:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.579 19:12:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.579 19:12:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:41.579 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:41.579 19:12:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.579 19:12:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.579 19:12:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.579 19:12:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.579 19:12:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.579 19:12:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:41.579 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:41.579 19:12:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.579 19:12:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:41.579 19:12:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:41.579 19:12:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:41.579 19:12:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:41.579 19:12:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:41.579 19:12:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:41.579 19:12:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:41.579 19:12:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:41.579 19:12:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:41.579 19:12:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:41.579 19:12:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:41.579 19:12:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:41.579 19:12:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:41.579 19:12:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:41.579 19:12:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:41.579 19:12:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:41.579 19:12:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:41.579 19:12:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:41.579 19:12:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:41.579 19:12:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:41.579 19:12:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:41.837 19:12:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:41.837 19:12:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:41.837 19:12:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:41.837 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:41.837 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:13:41.837 00:13:41.837 --- 10.0.0.2 ping statistics --- 00:13:41.837 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:41.837 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:13:41.837 19:12:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:41.837 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:41.837 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.188 ms 00:13:41.837 00:13:41.837 --- 10.0.0.1 ping statistics --- 00:13:41.837 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:41.837 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:13:41.837 19:12:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:41.837 19:12:00 -- nvmf/common.sh@410 -- # return 0 00:13:41.837 19:12:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:41.838 19:12:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:41.838 19:12:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:41.838 19:12:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:41.838 19:12:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:41.838 19:12:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:41.838 19:12:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:41.838 19:12:00 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:41.838 19:12:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:41.838 19:12:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:41.838 19:12:00 -- common/autotest_common.sh@10 -- # set +x 00:13:41.838 19:12:00 -- nvmf/common.sh@469 -- # nvmfpid=3411239 00:13:41.838 19:12:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:41.838 19:12:00 -- nvmf/common.sh@470 -- # waitforlisten 3411239 00:13:41.838 19:12:00 -- common/autotest_common.sh@829 -- # '[' -z 3411239 ']' 00:13:41.838 19:12:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:41.838 19:12:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:41.838 19:12:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:41.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:41.838 19:12:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:41.838 19:12:00 -- common/autotest_common.sh@10 -- # set +x 00:13:41.838 [2024-11-18 19:12:00.293247] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:41.838 [2024-11-18 19:12:00.293320] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:41.838 EAL: No free 2048 kB hugepages reported on node 1 00:13:41.838 [2024-11-18 19:12:00.360727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:42.096 [2024-11-18 19:12:00.476192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:42.096 [2024-11-18 19:12:00.476347] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.096 [2024-11-18 19:12:00.476365] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.096 [2024-11-18 19:12:00.476379] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.096 [2024-11-18 19:12:00.476432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.096 [2024-11-18 19:12:00.476437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:43.029 19:12:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:43.029 19:12:01 -- common/autotest_common.sh@862 -- # return 0 00:13:43.029 19:12:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:43.029 19:12:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 19:12:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:43.029 19:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 [2024-11-18 19:12:01.312254] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:43.029 19:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:43.029 19:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 19:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:43.029 19:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 [2024-11-18 19:12:01.328712] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:43.029 19:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:43.029 19:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 NULL1 00:13:43.029 19:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:43.029 19:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 Delay0 00:13:43.029 19:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.029 19:12:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.029 19:12:01 -- common/autotest_common.sh@10 -- # set +x 00:13:43.029 19:12:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@28 -- # perf_pid=3411457 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:43.029 19:12:01 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:43.029 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.029 [2024-11-18 19:12:01.403244] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:44.927 19:12:03 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:44.927 19:12:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.927 19:12:03 -- common/autotest_common.sh@10 -- # set +x 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 [2024-11-18 19:12:03.533788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f5d90000c00 is same with the state(5) to be set 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Write completed with error (sct=0, sc=8) 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.185 starting I/O failed: -6 00:13:45.185 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 starting I/O failed: -6 00:13:45.186 [2024-11-18 19:12:03.534444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6a4c0 is same with the state(5) to be set 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Write completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:45.186 Read completed with error (sct=0, sc=8) 00:13:46.119 [2024-11-18 19:12:04.500507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb83960 is same with the state(5) to be set 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 [2024-11-18 19:12:04.534911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f5d9000bf20 is same with the state(5) to be set 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 [2024-11-18 19:12:04.535083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f5d9000c600 is same with the state(5) to be set 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 [2024-11-18 19:12:04.535996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb8a3d0 is same with the state(5) to be set 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Write completed with error (sct=0, sc=8) 00:13:46.119 Read completed with error (sct=0, sc=8) 00:13:46.120 Write completed with error (sct=0, sc=8) 00:13:46.120 [2024-11-18 19:12:04.536481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb6a770 is same with the state(5) to be set 00:13:46.120 [2024-11-18 19:12:04.536916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xb83960 (9): Bad file descriptor 00:13:46.120 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:46.120 19:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.120 19:12:04 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:46.120 19:12:04 -- target/delete_subsystem.sh@35 -- # kill -0 3411457 00:13:46.120 19:12:04 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:46.120 Initializing NVMe Controllers 00:13:46.120 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:46.120 Controller IO queue size 128, less than required. 00:13:46.120 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:46.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:46.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:46.120 Initialization complete. Launching workers. 00:13:46.120 ======================================================== 00:13:46.120 Latency(us) 00:13:46.120 Device Information : IOPS MiB/s Average min max 00:13:46.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 162.31 0.08 914068.48 399.64 1013312.53 00:13:46.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 165.78 0.08 903596.42 501.93 1011902.39 00:13:46.120 ======================================================== 00:13:46.120 Total : 328.09 0.16 908777.00 399.64 1013312.53 00:13:46.120 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@35 -- # kill -0 3411457 00:13:46.724 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3411457) - No such process 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@45 -- # NOT wait 3411457 00:13:46.724 19:12:05 -- common/autotest_common.sh@650 -- # local es=0 00:13:46.724 19:12:05 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3411457 00:13:46.724 19:12:05 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:46.724 19:12:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:46.724 19:12:05 -- common/autotest_common.sh@642 -- # type -t wait 00:13:46.724 19:12:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:46.724 19:12:05 -- common/autotest_common.sh@653 -- # wait 3411457 00:13:46.724 19:12:05 -- common/autotest_common.sh@653 -- # es=1 00:13:46.724 19:12:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:46.724 19:12:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:46.724 19:12:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:46.724 19:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.724 19:12:05 -- common/autotest_common.sh@10 -- # set +x 00:13:46.724 19:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:46.724 19:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.724 19:12:05 -- common/autotest_common.sh@10 -- # set +x 00:13:46.724 [2024-11-18 19:12:05.057767] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:46.724 19:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.724 19:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.724 19:12:05 -- common/autotest_common.sh@10 -- # set +x 00:13:46.724 19:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@54 -- # perf_pid=3411901 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:46.724 19:12:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:46.724 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.724 [2024-11-18 19:12:05.114909] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:46.982 19:12:05 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:46.982 19:12:05 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:46.982 19:12:05 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:47.547 19:12:06 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:47.547 19:12:06 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:47.547 19:12:06 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.112 19:12:06 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:48.112 19:12:06 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:48.112 19:12:06 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.677 19:12:07 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:48.677 19:12:07 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:48.677 19:12:07 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.242 19:12:07 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.242 19:12:07 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:49.242 19:12:07 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.500 19:12:08 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.500 19:12:08 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:49.500 19:12:08 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.758 Initializing NVMe Controllers 00:13:49.758 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:49.758 Controller IO queue size 128, less than required. 00:13:49.758 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:49.758 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:49.758 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:49.758 Initialization complete. Launching workers. 00:13:49.758 ======================================================== 00:13:49.758 Latency(us) 00:13:49.758 Device Information : IOPS MiB/s Average min max 00:13:49.758 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004196.55 1000183.84 1013408.96 00:13:49.758 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004974.00 1000151.71 1013429.85 00:13:49.758 ======================================================== 00:13:49.758 Total : 256.00 0.12 1004585.27 1000151.71 1013429.85 00:13:49.758 00:13:50.016 19:12:08 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.016 19:12:08 -- target/delete_subsystem.sh@57 -- # kill -0 3411901 00:13:50.016 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3411901) - No such process 00:13:50.016 19:12:08 -- target/delete_subsystem.sh@67 -- # wait 3411901 00:13:50.016 19:12:08 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:50.016 19:12:08 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:50.016 19:12:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.016 19:12:08 -- nvmf/common.sh@116 -- # sync 00:13:50.016 19:12:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.016 19:12:08 -- nvmf/common.sh@119 -- # set +e 00:13:50.016 19:12:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.016 19:12:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.016 rmmod nvme_tcp 00:13:50.016 rmmod nvme_fabrics 00:13:50.275 rmmod nvme_keyring 00:13:50.275 19:12:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:50.275 19:12:08 -- nvmf/common.sh@123 -- # set -e 00:13:50.275 19:12:08 -- nvmf/common.sh@124 -- # return 0 00:13:50.275 19:12:08 -- nvmf/common.sh@477 -- # '[' -n 3411239 ']' 00:13:50.275 19:12:08 -- nvmf/common.sh@478 -- # killprocess 3411239 00:13:50.275 19:12:08 -- common/autotest_common.sh@936 -- # '[' -z 3411239 ']' 00:13:50.275 19:12:08 -- common/autotest_common.sh@940 -- # kill -0 3411239 00:13:50.275 19:12:08 -- common/autotest_common.sh@941 -- # uname 00:13:50.275 19:12:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:50.275 19:12:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3411239 00:13:50.275 19:12:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:50.275 19:12:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:50.275 19:12:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3411239' 00:13:50.275 killing process with pid 3411239 00:13:50.275 19:12:08 -- common/autotest_common.sh@955 -- # kill 3411239 00:13:50.275 19:12:08 -- common/autotest_common.sh@960 -- # wait 3411239 00:13:50.533 19:12:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:50.533 19:12:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:50.533 19:12:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:50.533 19:12:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:50.533 19:12:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:50.533 19:12:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:50.533 19:12:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:50.533 19:12:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.433 19:12:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:52.433 00:13:52.433 real 0m13.055s 00:13:52.433 user 0m29.455s 00:13:52.433 sys 0m2.846s 00:13:52.433 19:12:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:52.433 19:12:10 -- common/autotest_common.sh@10 -- # set +x 00:13:52.433 ************************************ 00:13:52.433 END TEST nvmf_delete_subsystem 00:13:52.433 ************************************ 00:13:52.433 19:12:11 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:52.433 19:12:11 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:52.433 19:12:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:52.433 19:12:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:52.433 19:12:11 -- common/autotest_common.sh@10 -- # set +x 00:13:52.433 ************************************ 00:13:52.433 START TEST nvmf_nvme_cli 00:13:52.433 ************************************ 00:13:52.433 19:12:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:52.691 * Looking for test storage... 00:13:52.691 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:52.691 19:12:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:52.691 19:12:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:52.691 19:12:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:52.691 19:12:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:52.691 19:12:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:52.691 19:12:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:52.691 19:12:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:52.691 19:12:11 -- scripts/common.sh@335 -- # IFS=.-: 00:13:52.691 19:12:11 -- scripts/common.sh@335 -- # read -ra ver1 00:13:52.691 19:12:11 -- scripts/common.sh@336 -- # IFS=.-: 00:13:52.691 19:12:11 -- scripts/common.sh@336 -- # read -ra ver2 00:13:52.691 19:12:11 -- scripts/common.sh@337 -- # local 'op=<' 00:13:52.692 19:12:11 -- scripts/common.sh@339 -- # ver1_l=2 00:13:52.692 19:12:11 -- scripts/common.sh@340 -- # ver2_l=1 00:13:52.692 19:12:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:52.692 19:12:11 -- scripts/common.sh@343 -- # case "$op" in 00:13:52.692 19:12:11 -- scripts/common.sh@344 -- # : 1 00:13:52.692 19:12:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:52.692 19:12:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:52.692 19:12:11 -- scripts/common.sh@364 -- # decimal 1 00:13:52.692 19:12:11 -- scripts/common.sh@352 -- # local d=1 00:13:52.692 19:12:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:52.692 19:12:11 -- scripts/common.sh@354 -- # echo 1 00:13:52.692 19:12:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:52.692 19:12:11 -- scripts/common.sh@365 -- # decimal 2 00:13:52.692 19:12:11 -- scripts/common.sh@352 -- # local d=2 00:13:52.692 19:12:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:52.692 19:12:11 -- scripts/common.sh@354 -- # echo 2 00:13:52.692 19:12:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:52.692 19:12:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:52.692 19:12:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:52.692 19:12:11 -- scripts/common.sh@367 -- # return 0 00:13:52.692 19:12:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:52.692 19:12:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:52.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.692 --rc genhtml_branch_coverage=1 00:13:52.692 --rc genhtml_function_coverage=1 00:13:52.692 --rc genhtml_legend=1 00:13:52.692 --rc geninfo_all_blocks=1 00:13:52.692 --rc geninfo_unexecuted_blocks=1 00:13:52.692 00:13:52.692 ' 00:13:52.692 19:12:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:52.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.692 --rc genhtml_branch_coverage=1 00:13:52.692 --rc genhtml_function_coverage=1 00:13:52.692 --rc genhtml_legend=1 00:13:52.692 --rc geninfo_all_blocks=1 00:13:52.692 --rc geninfo_unexecuted_blocks=1 00:13:52.692 00:13:52.692 ' 00:13:52.692 19:12:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:52.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.692 --rc genhtml_branch_coverage=1 00:13:52.692 --rc genhtml_function_coverage=1 00:13:52.692 --rc genhtml_legend=1 00:13:52.692 --rc geninfo_all_blocks=1 00:13:52.692 --rc geninfo_unexecuted_blocks=1 00:13:52.692 00:13:52.692 ' 00:13:52.692 19:12:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:52.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:52.692 --rc genhtml_branch_coverage=1 00:13:52.692 --rc genhtml_function_coverage=1 00:13:52.692 --rc genhtml_legend=1 00:13:52.692 --rc geninfo_all_blocks=1 00:13:52.692 --rc geninfo_unexecuted_blocks=1 00:13:52.692 00:13:52.692 ' 00:13:52.692 19:12:11 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:52.692 19:12:11 -- nvmf/common.sh@7 -- # uname -s 00:13:52.692 19:12:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:52.692 19:12:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:52.692 19:12:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:52.692 19:12:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:52.692 19:12:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:52.692 19:12:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:52.692 19:12:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:52.692 19:12:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:52.692 19:12:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:52.692 19:12:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:52.692 19:12:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.692 19:12:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:52.692 19:12:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:52.692 19:12:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:52.692 19:12:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:52.692 19:12:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:52.692 19:12:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:52.692 19:12:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:52.692 19:12:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:52.692 19:12:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.692 19:12:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.692 19:12:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.692 19:12:11 -- paths/export.sh@5 -- # export PATH 00:13:52.692 19:12:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:52.692 19:12:11 -- nvmf/common.sh@46 -- # : 0 00:13:52.692 19:12:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:52.692 19:12:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:52.692 19:12:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:52.692 19:12:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:52.692 19:12:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:52.692 19:12:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:52.692 19:12:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:52.692 19:12:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:52.692 19:12:11 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:52.692 19:12:11 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:52.692 19:12:11 -- target/nvme_cli.sh@14 -- # devs=() 00:13:52.692 19:12:11 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:52.692 19:12:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:52.692 19:12:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:52.692 19:12:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:52.692 19:12:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:52.692 19:12:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:52.692 19:12:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.692 19:12:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.692 19:12:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:52.692 19:12:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:52.692 19:12:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:52.692 19:12:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:52.692 19:12:11 -- common/autotest_common.sh@10 -- # set +x 00:13:55.221 19:12:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.221 19:12:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.221 19:12:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.221 19:12:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.221 19:12:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.221 19:12:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.221 19:12:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.221 19:12:13 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.221 19:12:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.221 19:12:13 -- nvmf/common.sh@295 -- # e810=() 00:13:55.222 19:12:13 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.222 19:12:13 -- nvmf/common.sh@296 -- # x722=() 00:13:55.222 19:12:13 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.222 19:12:13 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.222 19:12:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.222 19:12:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.222 19:12:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.222 19:12:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.222 19:12:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.222 19:12:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.222 19:12:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.222 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.222 19:12:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.222 19:12:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.222 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.222 19:12:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.222 19:12:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.222 19:12:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.222 19:12:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.222 19:12:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.222 19:12:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.222 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.222 19:12:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.222 19:12:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.222 19:12:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.222 19:12:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.222 19:12:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.222 19:12:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.222 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.222 19:12:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.222 19:12:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.222 19:12:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.222 19:12:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.222 19:12:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.222 19:12:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.222 19:12:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.222 19:12:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.222 19:12:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.222 19:12:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.222 19:12:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.222 19:12:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.222 19:12:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.222 19:12:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.222 19:12:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.222 19:12:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.222 19:12:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.222 19:12:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.222 19:12:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.222 19:12:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.222 19:12:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.222 19:12:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.222 19:12:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.222 19:12:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.222 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.222 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.258 ms 00:13:55.222 00:13:55.222 --- 10.0.0.2 ping statistics --- 00:13:55.222 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.222 rtt min/avg/max/mdev = 0.258/0.258/0.258/0.000 ms 00:13:55.222 19:12:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.222 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.222 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:13:55.222 00:13:55.222 --- 10.0.0.1 ping statistics --- 00:13:55.222 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.222 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:13:55.222 19:12:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.222 19:12:13 -- nvmf/common.sh@410 -- # return 0 00:13:55.222 19:12:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.222 19:12:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.222 19:12:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.222 19:12:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.222 19:12:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.222 19:12:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.222 19:12:13 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:55.222 19:12:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.222 19:12:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:55.222 19:12:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.222 19:12:13 -- nvmf/common.sh@469 -- # nvmfpid=3414808 00:13:55.222 19:12:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:55.222 19:12:13 -- nvmf/common.sh@470 -- # waitforlisten 3414808 00:13:55.222 19:12:13 -- common/autotest_common.sh@829 -- # '[' -z 3414808 ']' 00:13:55.222 19:12:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.222 19:12:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:55.222 19:12:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.222 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.222 19:12:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:55.222 19:12:13 -- common/autotest_common.sh@10 -- # set +x 00:13:55.222 [2024-11-18 19:12:13.539129] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:55.222 [2024-11-18 19:12:13.539225] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.222 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.222 [2024-11-18 19:12:13.605727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:55.222 [2024-11-18 19:12:13.713165] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:55.222 [2024-11-18 19:12:13.713313] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.222 [2024-11-18 19:12:13.713330] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.222 [2024-11-18 19:12:13.713343] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.222 [2024-11-18 19:12:13.713397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:55.222 [2024-11-18 19:12:13.713455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:55.222 [2024-11-18 19:12:13.713537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:55.222 [2024-11-18 19:12:13.713540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:56.156 19:12:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:56.156 19:12:14 -- common/autotest_common.sh@862 -- # return 0 00:13:56.156 19:12:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.156 19:12:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 19:12:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.156 19:12:14 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 [2024-11-18 19:12:14.593415] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 Malloc0 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 Malloc1 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 [2024-11-18 19:12:14.677154] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:56.156 19:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.156 19:12:14 -- common/autotest_common.sh@10 -- # set +x 00:13:56.156 19:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.156 19:12:14 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:56.413 00:13:56.413 Discovery Log Number of Records 2, Generation counter 2 00:13:56.413 =====Discovery Log Entry 0====== 00:13:56.413 trtype: tcp 00:13:56.413 adrfam: ipv4 00:13:56.413 subtype: current discovery subsystem 00:13:56.413 treq: not required 00:13:56.413 portid: 0 00:13:56.413 trsvcid: 4420 00:13:56.413 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:56.413 traddr: 10.0.0.2 00:13:56.413 eflags: explicit discovery connections, duplicate discovery information 00:13:56.413 sectype: none 00:13:56.413 =====Discovery Log Entry 1====== 00:13:56.413 trtype: tcp 00:13:56.413 adrfam: ipv4 00:13:56.413 subtype: nvme subsystem 00:13:56.413 treq: not required 00:13:56.413 portid: 0 00:13:56.413 trsvcid: 4420 00:13:56.413 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:56.413 traddr: 10.0.0.2 00:13:56.413 eflags: none 00:13:56.413 sectype: none 00:13:56.413 19:12:14 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:56.413 19:12:14 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:56.413 19:12:14 -- nvmf/common.sh@510 -- # local dev _ 00:13:56.413 19:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:56.413 19:12:14 -- nvmf/common.sh@509 -- # nvme list 00:13:56.413 19:12:14 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:56.413 19:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:56.413 19:12:14 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:56.413 19:12:14 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:56.413 19:12:14 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:56.413 19:12:14 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:56.977 19:12:15 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:56.977 19:12:15 -- common/autotest_common.sh@1187 -- # local i=0 00:13:56.977 19:12:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:56.977 19:12:15 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:56.977 19:12:15 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:56.977 19:12:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:58.874 19:12:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:58.874 19:12:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:58.874 19:12:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:59.132 19:12:17 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:13:59.132 19:12:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:59.132 19:12:17 -- common/autotest_common.sh@1197 -- # return 0 00:13:59.132 19:12:17 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:59.132 19:12:17 -- nvmf/common.sh@510 -- # local dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@509 -- # nvme list 00:13:59.132 19:12:17 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:59.132 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:59.132 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:59.132 19:12:17 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:59.132 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:59.132 19:12:17 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:59.132 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.132 19:12:17 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:13:59.132 /dev/nvme0n2 ]] 00:13:59.132 19:12:17 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:59.132 19:12:17 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:59.132 19:12:17 -- nvmf/common.sh@510 -- # local dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.132 19:12:17 -- nvmf/common.sh@509 -- # nvme list 00:13:59.390 19:12:17 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:59.390 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.390 19:12:17 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:59.390 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.390 19:12:17 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:59.390 19:12:17 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:59.390 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.390 19:12:17 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:59.390 19:12:17 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:59.390 19:12:17 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:59.390 19:12:17 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:59.390 19:12:17 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:59.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:59.649 19:12:18 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:59.649 19:12:18 -- common/autotest_common.sh@1208 -- # local i=0 00:13:59.649 19:12:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:59.649 19:12:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:59.649 19:12:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:59.649 19:12:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:59.649 19:12:18 -- common/autotest_common.sh@1220 -- # return 0 00:13:59.649 19:12:18 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:59.649 19:12:18 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:59.649 19:12:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.649 19:12:18 -- common/autotest_common.sh@10 -- # set +x 00:13:59.649 19:12:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.649 19:12:18 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:59.649 19:12:18 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:59.649 19:12:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:59.649 19:12:18 -- nvmf/common.sh@116 -- # sync 00:13:59.649 19:12:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:59.649 19:12:18 -- nvmf/common.sh@119 -- # set +e 00:13:59.649 19:12:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:59.649 19:12:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:59.649 rmmod nvme_tcp 00:13:59.649 rmmod nvme_fabrics 00:13:59.649 rmmod nvme_keyring 00:13:59.649 19:12:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:59.649 19:12:18 -- nvmf/common.sh@123 -- # set -e 00:13:59.649 19:12:18 -- nvmf/common.sh@124 -- # return 0 00:13:59.649 19:12:18 -- nvmf/common.sh@477 -- # '[' -n 3414808 ']' 00:13:59.649 19:12:18 -- nvmf/common.sh@478 -- # killprocess 3414808 00:13:59.649 19:12:18 -- common/autotest_common.sh@936 -- # '[' -z 3414808 ']' 00:13:59.649 19:12:18 -- common/autotest_common.sh@940 -- # kill -0 3414808 00:13:59.649 19:12:18 -- common/autotest_common.sh@941 -- # uname 00:13:59.649 19:12:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:59.649 19:12:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3414808 00:13:59.649 19:12:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:59.649 19:12:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:59.649 19:12:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3414808' 00:13:59.649 killing process with pid 3414808 00:13:59.649 19:12:18 -- common/autotest_common.sh@955 -- # kill 3414808 00:13:59.649 19:12:18 -- common/autotest_common.sh@960 -- # wait 3414808 00:13:59.908 19:12:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:59.908 19:12:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:59.908 19:12:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:59.908 19:12:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:59.908 19:12:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:59.908 19:12:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.908 19:12:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.908 19:12:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:02.438 19:12:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:02.438 00:14:02.438 real 0m9.531s 00:14:02.438 user 0m19.768s 00:14:02.438 sys 0m2.319s 00:14:02.438 19:12:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:02.438 19:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:02.438 ************************************ 00:14:02.438 END TEST nvmf_nvme_cli 00:14:02.438 ************************************ 00:14:02.438 19:12:20 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:02.438 19:12:20 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:02.438 19:12:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:02.438 19:12:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:02.438 19:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:02.438 ************************************ 00:14:02.438 START TEST nvmf_host_management 00:14:02.438 ************************************ 00:14:02.438 19:12:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:02.438 * Looking for test storage... 00:14:02.438 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:02.438 19:12:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:02.438 19:12:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:02.438 19:12:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:02.438 19:12:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:02.438 19:12:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:02.438 19:12:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:02.438 19:12:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:02.438 19:12:20 -- scripts/common.sh@335 -- # IFS=.-: 00:14:02.438 19:12:20 -- scripts/common.sh@335 -- # read -ra ver1 00:14:02.438 19:12:20 -- scripts/common.sh@336 -- # IFS=.-: 00:14:02.438 19:12:20 -- scripts/common.sh@336 -- # read -ra ver2 00:14:02.438 19:12:20 -- scripts/common.sh@337 -- # local 'op=<' 00:14:02.438 19:12:20 -- scripts/common.sh@339 -- # ver1_l=2 00:14:02.438 19:12:20 -- scripts/common.sh@340 -- # ver2_l=1 00:14:02.438 19:12:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:02.438 19:12:20 -- scripts/common.sh@343 -- # case "$op" in 00:14:02.438 19:12:20 -- scripts/common.sh@344 -- # : 1 00:14:02.438 19:12:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:02.438 19:12:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:02.438 19:12:20 -- scripts/common.sh@364 -- # decimal 1 00:14:02.438 19:12:20 -- scripts/common.sh@352 -- # local d=1 00:14:02.438 19:12:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:02.438 19:12:20 -- scripts/common.sh@354 -- # echo 1 00:14:02.438 19:12:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:02.438 19:12:20 -- scripts/common.sh@365 -- # decimal 2 00:14:02.438 19:12:20 -- scripts/common.sh@352 -- # local d=2 00:14:02.438 19:12:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:02.438 19:12:20 -- scripts/common.sh@354 -- # echo 2 00:14:02.438 19:12:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:02.438 19:12:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:02.438 19:12:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:02.438 19:12:20 -- scripts/common.sh@367 -- # return 0 00:14:02.438 19:12:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:02.438 19:12:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:02.438 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:02.438 --rc genhtml_branch_coverage=1 00:14:02.438 --rc genhtml_function_coverage=1 00:14:02.438 --rc genhtml_legend=1 00:14:02.438 --rc geninfo_all_blocks=1 00:14:02.438 --rc geninfo_unexecuted_blocks=1 00:14:02.438 00:14:02.438 ' 00:14:02.438 19:12:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:02.438 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:02.438 --rc genhtml_branch_coverage=1 00:14:02.438 --rc genhtml_function_coverage=1 00:14:02.438 --rc genhtml_legend=1 00:14:02.438 --rc geninfo_all_blocks=1 00:14:02.438 --rc geninfo_unexecuted_blocks=1 00:14:02.438 00:14:02.438 ' 00:14:02.438 19:12:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:02.438 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:02.438 --rc genhtml_branch_coverage=1 00:14:02.438 --rc genhtml_function_coverage=1 00:14:02.438 --rc genhtml_legend=1 00:14:02.438 --rc geninfo_all_blocks=1 00:14:02.438 --rc geninfo_unexecuted_blocks=1 00:14:02.438 00:14:02.438 ' 00:14:02.438 19:12:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:02.438 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:02.438 --rc genhtml_branch_coverage=1 00:14:02.438 --rc genhtml_function_coverage=1 00:14:02.438 --rc genhtml_legend=1 00:14:02.438 --rc geninfo_all_blocks=1 00:14:02.438 --rc geninfo_unexecuted_blocks=1 00:14:02.438 00:14:02.438 ' 00:14:02.439 19:12:20 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:02.439 19:12:20 -- nvmf/common.sh@7 -- # uname -s 00:14:02.439 19:12:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:02.439 19:12:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:02.439 19:12:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:02.439 19:12:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:02.439 19:12:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:02.439 19:12:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:02.439 19:12:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:02.439 19:12:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:02.439 19:12:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:02.439 19:12:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:02.439 19:12:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:02.439 19:12:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:02.439 19:12:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:02.439 19:12:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:02.439 19:12:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:02.439 19:12:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:02.439 19:12:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:02.439 19:12:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:02.439 19:12:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:02.439 19:12:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:02.439 19:12:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:02.439 19:12:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:02.439 19:12:20 -- paths/export.sh@5 -- # export PATH 00:14:02.439 19:12:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:02.439 19:12:20 -- nvmf/common.sh@46 -- # : 0 00:14:02.439 19:12:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:02.439 19:12:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:02.439 19:12:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:02.439 19:12:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:02.439 19:12:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:02.439 19:12:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:02.439 19:12:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:02.439 19:12:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:02.439 19:12:20 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:02.439 19:12:20 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:02.439 19:12:20 -- target/host_management.sh@104 -- # nvmftestinit 00:14:02.439 19:12:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:02.439 19:12:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:02.439 19:12:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:02.439 19:12:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:02.439 19:12:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:02.439 19:12:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:02.439 19:12:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:02.439 19:12:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:02.439 19:12:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:02.439 19:12:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:02.439 19:12:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:02.439 19:12:20 -- common/autotest_common.sh@10 -- # set +x 00:14:04.339 19:12:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:04.339 19:12:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:04.339 19:12:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:04.339 19:12:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:04.339 19:12:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:04.339 19:12:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:04.339 19:12:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:04.339 19:12:22 -- nvmf/common.sh@294 -- # net_devs=() 00:14:04.339 19:12:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:04.339 19:12:22 -- nvmf/common.sh@295 -- # e810=() 00:14:04.339 19:12:22 -- nvmf/common.sh@295 -- # local -ga e810 00:14:04.339 19:12:22 -- nvmf/common.sh@296 -- # x722=() 00:14:04.339 19:12:22 -- nvmf/common.sh@296 -- # local -ga x722 00:14:04.340 19:12:22 -- nvmf/common.sh@297 -- # mlx=() 00:14:04.340 19:12:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:04.340 19:12:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:04.340 19:12:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:04.340 19:12:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:04.340 19:12:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:04.340 19:12:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:04.340 19:12:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:04.340 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:04.340 19:12:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:04.340 19:12:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:04.340 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:04.340 19:12:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:04.340 19:12:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:04.340 19:12:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.340 19:12:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:04.340 19:12:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.340 19:12:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:04.340 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:04.340 19:12:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.340 19:12:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:04.340 19:12:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:04.340 19:12:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:04.340 19:12:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:04.340 19:12:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:04.340 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:04.340 19:12:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:04.340 19:12:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:04.340 19:12:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:04.340 19:12:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:04.340 19:12:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:04.340 19:12:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:04.340 19:12:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:04.340 19:12:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:04.340 19:12:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:04.340 19:12:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:04.340 19:12:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:04.340 19:12:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:04.340 19:12:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:04.340 19:12:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:04.340 19:12:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:04.340 19:12:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:04.340 19:12:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:04.340 19:12:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:04.340 19:12:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:04.340 19:12:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:04.340 19:12:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:04.340 19:12:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:04.340 19:12:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:04.340 19:12:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:04.340 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:04.340 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:14:04.340 00:14:04.340 --- 10.0.0.2 ping statistics --- 00:14:04.340 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:04.340 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:14:04.340 19:12:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:04.340 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:04.340 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:14:04.340 00:14:04.340 --- 10.0.0.1 ping statistics --- 00:14:04.340 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:04.340 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:14:04.340 19:12:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:04.340 19:12:22 -- nvmf/common.sh@410 -- # return 0 00:14:04.340 19:12:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:04.340 19:12:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:04.340 19:12:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:04.340 19:12:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:04.340 19:12:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:04.340 19:12:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:04.340 19:12:22 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:04.340 19:12:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:04.340 19:12:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:04.340 19:12:22 -- common/autotest_common.sh@10 -- # set +x 00:14:04.340 ************************************ 00:14:04.340 START TEST nvmf_host_management 00:14:04.340 ************************************ 00:14:04.340 19:12:22 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:04.340 19:12:22 -- target/host_management.sh@69 -- # starttarget 00:14:04.340 19:12:22 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:04.340 19:12:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:04.340 19:12:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:04.340 19:12:22 -- common/autotest_common.sh@10 -- # set +x 00:14:04.340 19:12:22 -- nvmf/common.sh@469 -- # nvmfpid=3417461 00:14:04.340 19:12:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:04.340 19:12:22 -- nvmf/common.sh@470 -- # waitforlisten 3417461 00:14:04.340 19:12:22 -- common/autotest_common.sh@829 -- # '[' -z 3417461 ']' 00:14:04.340 19:12:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:04.340 19:12:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:04.340 19:12:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:04.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:04.340 19:12:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:04.340 19:12:22 -- common/autotest_common.sh@10 -- # set +x 00:14:04.599 [2024-11-18 19:12:22.945163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:04.599 [2024-11-18 19:12:22.945241] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:04.599 EAL: No free 2048 kB hugepages reported on node 1 00:14:04.599 [2024-11-18 19:12:23.011689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:04.599 [2024-11-18 19:12:23.127295] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:04.599 [2024-11-18 19:12:23.127447] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:04.599 [2024-11-18 19:12:23.127467] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:04.599 [2024-11-18 19:12:23.127482] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:04.599 [2024-11-18 19:12:23.127600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:04.599 [2024-11-18 19:12:23.127648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:04.599 [2024-11-18 19:12:23.127698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:04.599 [2024-11-18 19:12:23.127701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:05.532 19:12:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:05.532 19:12:23 -- common/autotest_common.sh@862 -- # return 0 00:14:05.532 19:12:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:05.532 19:12:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:05.533 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 19:12:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:05.533 19:12:23 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:05.533 19:12:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.533 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 [2024-11-18 19:12:23.940174] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:05.533 19:12:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.533 19:12:23 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:05.533 19:12:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:05.533 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 19:12:23 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:05.533 19:12:23 -- target/host_management.sh@23 -- # cat 00:14:05.533 19:12:23 -- target/host_management.sh@30 -- # rpc_cmd 00:14:05.533 19:12:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.533 19:12:23 -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 Malloc0 00:14:05.533 [2024-11-18 19:12:24.001323] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:05.533 19:12:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.533 19:12:24 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:05.533 19:12:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:05.533 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 19:12:24 -- target/host_management.sh@73 -- # perfpid=3417641 00:14:05.533 19:12:24 -- target/host_management.sh@74 -- # waitforlisten 3417641 /var/tmp/bdevperf.sock 00:14:05.533 19:12:24 -- common/autotest_common.sh@829 -- # '[' -z 3417641 ']' 00:14:05.533 19:12:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:05.533 19:12:24 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:05.533 19:12:24 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:05.533 19:12:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:05.533 19:12:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:05.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:05.533 19:12:24 -- nvmf/common.sh@520 -- # config=() 00:14:05.533 19:12:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:05.533 19:12:24 -- nvmf/common.sh@520 -- # local subsystem config 00:14:05.533 19:12:24 -- common/autotest_common.sh@10 -- # set +x 00:14:05.533 19:12:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:05.533 19:12:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:05.533 { 00:14:05.533 "params": { 00:14:05.533 "name": "Nvme$subsystem", 00:14:05.533 "trtype": "$TEST_TRANSPORT", 00:14:05.533 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:05.533 "adrfam": "ipv4", 00:14:05.533 "trsvcid": "$NVMF_PORT", 00:14:05.533 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:05.533 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:05.533 "hdgst": ${hdgst:-false}, 00:14:05.533 "ddgst": ${ddgst:-false} 00:14:05.533 }, 00:14:05.533 "method": "bdev_nvme_attach_controller" 00:14:05.533 } 00:14:05.533 EOF 00:14:05.533 )") 00:14:05.533 19:12:24 -- nvmf/common.sh@542 -- # cat 00:14:05.533 19:12:24 -- nvmf/common.sh@544 -- # jq . 00:14:05.533 19:12:24 -- nvmf/common.sh@545 -- # IFS=, 00:14:05.533 19:12:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:05.533 "params": { 00:14:05.533 "name": "Nvme0", 00:14:05.533 "trtype": "tcp", 00:14:05.533 "traddr": "10.0.0.2", 00:14:05.533 "adrfam": "ipv4", 00:14:05.533 "trsvcid": "4420", 00:14:05.533 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:05.533 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:05.533 "hdgst": false, 00:14:05.533 "ddgst": false 00:14:05.533 }, 00:14:05.533 "method": "bdev_nvme_attach_controller" 00:14:05.533 }' 00:14:05.533 [2024-11-18 19:12:24.076435] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:05.533 [2024-11-18 19:12:24.076515] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3417641 ] 00:14:05.533 EAL: No free 2048 kB hugepages reported on node 1 00:14:05.533 [2024-11-18 19:12:24.136782] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:05.791 [2024-11-18 19:12:24.245683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:06.049 Running I/O for 10 seconds... 00:14:06.617 19:12:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:06.617 19:12:25 -- common/autotest_common.sh@862 -- # return 0 00:14:06.617 19:12:25 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:06.617 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.617 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:14:06.617 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.617 19:12:25 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:06.617 19:12:25 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:06.617 19:12:25 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:06.617 19:12:25 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:06.617 19:12:25 -- target/host_management.sh@52 -- # local ret=1 00:14:06.617 19:12:25 -- target/host_management.sh@53 -- # local i 00:14:06.617 19:12:25 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:06.617 19:12:25 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:06.617 19:12:25 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:06.617 19:12:25 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:06.617 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.617 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:14:06.617 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.617 19:12:25 -- target/host_management.sh@55 -- # read_io_count=1887 00:14:06.617 19:12:25 -- target/host_management.sh@58 -- # '[' 1887 -ge 100 ']' 00:14:06.617 19:12:25 -- target/host_management.sh@59 -- # ret=0 00:14:06.617 19:12:25 -- target/host_management.sh@60 -- # break 00:14:06.617 19:12:25 -- target/host_management.sh@64 -- # return 0 00:14:06.617 19:12:25 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:06.617 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.617 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:14:06.617 [2024-11-18 19:12:25.109320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.617 [2024-11-18 19:12:25.109417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.617 [2024-11-18 19:12:25.109433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.617 [2024-11-18 19:12:25.109446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.617 [2024-11-18 19:12:25.109465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.617 [2024-11-18 19:12:25.109478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.617 [2024-11-18 19:12:25.109491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xea9e60 is same with the state(5) to be set 00:14:06.618 [2024-11-18 19:12:25.109941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:2048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.109980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:2304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:2560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:2688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:125312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:125568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:125696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:125952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:126208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:126592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:126976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:127232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:127360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:127488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:127616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:128000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:128128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:128512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:128896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:129024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:2816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:2944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:3072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:3200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:3328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.618 [2024-11-18 19:12:25.110761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.618 [2024-11-18 19:12:25.110777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.110806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:3584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.110840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:3712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.110869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:3840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.110906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:3968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.110935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.110972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.110986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:4480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:4608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:4736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:4864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:4992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:5376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:5760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:5888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:129408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:6016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:6144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:6272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:6400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:6528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:129664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:130176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:130560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:1536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:1664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:1792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:06.619 [2024-11-18 19:12:25.111917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:06.619 [2024-11-18 19:12:25.111940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd1b030 is same with the state(5) to be set 00:14:06.619 [2024-11-18 19:12:25.112015] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xd1b030 was disconnected and freed. reset controller. 00:14:06.620 [2024-11-18 19:12:25.113159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:06.620 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.620 19:12:25 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:06.620 19:12:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.620 19:12:25 -- common/autotest_common.sh@10 -- # set +x 00:14:06.620 task offset: 2048 on job bdev=Nvme0n1 fails 00:14:06.620 00:14:06.620 Latency(us) 00:14:06.620 [2024-11-18T18:12:25.225Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:06.620 [2024-11-18T18:12:25.225Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:06.620 [2024-11-18T18:12:25.225Z] Job: Nvme0n1 ended in about 0.53 seconds with error 00:14:06.620 Verification LBA range: start 0x0 length 0x400 00:14:06.620 Nvme0n1 : 0.53 3872.36 242.02 121.72 0.00 15761.56 3325.35 23495.87 00:14:06.620 [2024-11-18T18:12:25.225Z] =================================================================================================================== 00:14:06.620 [2024-11-18T18:12:25.225Z] Total : 3872.36 242.02 121.72 0.00 15761.56 3325.35 23495.87 00:14:06.620 [2024-11-18 19:12:25.115099] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:06.620 [2024-11-18 19:12:25.115128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd1d160 (9): Bad file descriptor 00:14:06.620 19:12:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.620 19:12:25 -- target/host_management.sh@87 -- # sleep 1 00:14:06.620 [2024-11-18 19:12:25.217763] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:07.553 19:12:26 -- target/host_management.sh@91 -- # kill -9 3417641 00:14:07.553 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3417641) - No such process 00:14:07.553 19:12:26 -- target/host_management.sh@91 -- # true 00:14:07.553 19:12:26 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:07.554 19:12:26 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:07.554 19:12:26 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:07.554 19:12:26 -- nvmf/common.sh@520 -- # config=() 00:14:07.554 19:12:26 -- nvmf/common.sh@520 -- # local subsystem config 00:14:07.554 19:12:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:07.554 19:12:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:07.554 { 00:14:07.554 "params": { 00:14:07.554 "name": "Nvme$subsystem", 00:14:07.554 "trtype": "$TEST_TRANSPORT", 00:14:07.554 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:07.554 "adrfam": "ipv4", 00:14:07.554 "trsvcid": "$NVMF_PORT", 00:14:07.554 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:07.554 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:07.554 "hdgst": ${hdgst:-false}, 00:14:07.554 "ddgst": ${ddgst:-false} 00:14:07.554 }, 00:14:07.554 "method": "bdev_nvme_attach_controller" 00:14:07.554 } 00:14:07.554 EOF 00:14:07.554 )") 00:14:07.554 19:12:26 -- nvmf/common.sh@542 -- # cat 00:14:07.554 19:12:26 -- nvmf/common.sh@544 -- # jq . 00:14:07.554 19:12:26 -- nvmf/common.sh@545 -- # IFS=, 00:14:07.554 19:12:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:07.554 "params": { 00:14:07.554 "name": "Nvme0", 00:14:07.554 "trtype": "tcp", 00:14:07.554 "traddr": "10.0.0.2", 00:14:07.554 "adrfam": "ipv4", 00:14:07.554 "trsvcid": "4420", 00:14:07.554 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:07.554 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:07.554 "hdgst": false, 00:14:07.554 "ddgst": false 00:14:07.554 }, 00:14:07.554 "method": "bdev_nvme_attach_controller" 00:14:07.554 }' 00:14:07.812 [2024-11-18 19:12:26.166164] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:07.812 [2024-11-18 19:12:26.166239] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3417922 ] 00:14:07.812 EAL: No free 2048 kB hugepages reported on node 1 00:14:07.812 [2024-11-18 19:12:26.225554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:07.812 [2024-11-18 19:12:26.332664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:08.070 Running I/O for 1 seconds... 00:14:09.005 00:14:09.005 Latency(us) 00:14:09.005 [2024-11-18T18:12:27.610Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:09.005 [2024-11-18T18:12:27.610Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:09.005 Verification LBA range: start 0x0 length 0x400 00:14:09.005 Nvme0n1 : 1.02 3820.01 238.75 0.00 0.00 16468.39 1601.99 23592.96 00:14:09.005 [2024-11-18T18:12:27.610Z] =================================================================================================================== 00:14:09.005 [2024-11-18T18:12:27.610Z] Total : 3820.01 238.75 0.00 0.00 16468.39 1601.99 23592.96 00:14:09.263 19:12:27 -- target/host_management.sh@101 -- # stoptarget 00:14:09.263 19:12:27 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:09.263 19:12:27 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:09.263 19:12:27 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:09.263 19:12:27 -- target/host_management.sh@40 -- # nvmftestfini 00:14:09.263 19:12:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:09.263 19:12:27 -- nvmf/common.sh@116 -- # sync 00:14:09.263 19:12:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:09.263 19:12:27 -- nvmf/common.sh@119 -- # set +e 00:14:09.263 19:12:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:09.263 19:12:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:09.263 rmmod nvme_tcp 00:14:09.263 rmmod nvme_fabrics 00:14:09.263 rmmod nvme_keyring 00:14:09.521 19:12:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:09.521 19:12:27 -- nvmf/common.sh@123 -- # set -e 00:14:09.521 19:12:27 -- nvmf/common.sh@124 -- # return 0 00:14:09.521 19:12:27 -- nvmf/common.sh@477 -- # '[' -n 3417461 ']' 00:14:09.521 19:12:27 -- nvmf/common.sh@478 -- # killprocess 3417461 00:14:09.521 19:12:27 -- common/autotest_common.sh@936 -- # '[' -z 3417461 ']' 00:14:09.521 19:12:27 -- common/autotest_common.sh@940 -- # kill -0 3417461 00:14:09.521 19:12:27 -- common/autotest_common.sh@941 -- # uname 00:14:09.521 19:12:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:09.521 19:12:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3417461 00:14:09.521 19:12:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:09.521 19:12:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:09.521 19:12:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3417461' 00:14:09.521 killing process with pid 3417461 00:14:09.521 19:12:27 -- common/autotest_common.sh@955 -- # kill 3417461 00:14:09.521 19:12:27 -- common/autotest_common.sh@960 -- # wait 3417461 00:14:09.780 [2024-11-18 19:12:28.178823] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:09.780 19:12:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:09.780 19:12:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:09.780 19:12:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:09.780 19:12:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:09.780 19:12:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:09.780 19:12:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:09.780 19:12:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:09.780 19:12:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:11.681 19:12:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:11.681 00:14:11.681 real 0m7.360s 00:14:11.681 user 0m22.807s 00:14:11.681 sys 0m1.369s 00:14:11.681 19:12:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:11.681 19:12:30 -- common/autotest_common.sh@10 -- # set +x 00:14:11.681 ************************************ 00:14:11.681 END TEST nvmf_host_management 00:14:11.681 ************************************ 00:14:11.681 19:12:30 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:11.681 00:14:11.681 real 0m9.704s 00:14:11.681 user 0m23.668s 00:14:11.681 sys 0m2.878s 00:14:11.681 19:12:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:11.681 19:12:30 -- common/autotest_common.sh@10 -- # set +x 00:14:11.681 ************************************ 00:14:11.681 END TEST nvmf_host_management 00:14:11.681 ************************************ 00:14:11.940 19:12:30 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:11.940 19:12:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:11.940 19:12:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:11.940 19:12:30 -- common/autotest_common.sh@10 -- # set +x 00:14:11.940 ************************************ 00:14:11.940 START TEST nvmf_lvol 00:14:11.940 ************************************ 00:14:11.940 19:12:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:11.940 * Looking for test storage... 00:14:11.940 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:11.940 19:12:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:11.940 19:12:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:11.940 19:12:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:11.940 19:12:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:11.940 19:12:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:11.940 19:12:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:11.940 19:12:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:11.940 19:12:30 -- scripts/common.sh@335 -- # IFS=.-: 00:14:11.940 19:12:30 -- scripts/common.sh@335 -- # read -ra ver1 00:14:11.940 19:12:30 -- scripts/common.sh@336 -- # IFS=.-: 00:14:11.940 19:12:30 -- scripts/common.sh@336 -- # read -ra ver2 00:14:11.940 19:12:30 -- scripts/common.sh@337 -- # local 'op=<' 00:14:11.940 19:12:30 -- scripts/common.sh@339 -- # ver1_l=2 00:14:11.940 19:12:30 -- scripts/common.sh@340 -- # ver2_l=1 00:14:11.940 19:12:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:11.940 19:12:30 -- scripts/common.sh@343 -- # case "$op" in 00:14:11.940 19:12:30 -- scripts/common.sh@344 -- # : 1 00:14:11.940 19:12:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:11.940 19:12:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:11.940 19:12:30 -- scripts/common.sh@364 -- # decimal 1 00:14:11.940 19:12:30 -- scripts/common.sh@352 -- # local d=1 00:14:11.940 19:12:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:11.940 19:12:30 -- scripts/common.sh@354 -- # echo 1 00:14:11.940 19:12:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:11.940 19:12:30 -- scripts/common.sh@365 -- # decimal 2 00:14:11.940 19:12:30 -- scripts/common.sh@352 -- # local d=2 00:14:11.940 19:12:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:11.940 19:12:30 -- scripts/common.sh@354 -- # echo 2 00:14:11.940 19:12:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:11.940 19:12:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:11.940 19:12:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:11.940 19:12:30 -- scripts/common.sh@367 -- # return 0 00:14:11.940 19:12:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:11.940 19:12:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:11.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.940 --rc genhtml_branch_coverage=1 00:14:11.940 --rc genhtml_function_coverage=1 00:14:11.940 --rc genhtml_legend=1 00:14:11.940 --rc geninfo_all_blocks=1 00:14:11.940 --rc geninfo_unexecuted_blocks=1 00:14:11.940 00:14:11.940 ' 00:14:11.940 19:12:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:11.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.940 --rc genhtml_branch_coverage=1 00:14:11.940 --rc genhtml_function_coverage=1 00:14:11.940 --rc genhtml_legend=1 00:14:11.940 --rc geninfo_all_blocks=1 00:14:11.940 --rc geninfo_unexecuted_blocks=1 00:14:11.940 00:14:11.940 ' 00:14:11.940 19:12:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:11.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.940 --rc genhtml_branch_coverage=1 00:14:11.940 --rc genhtml_function_coverage=1 00:14:11.940 --rc genhtml_legend=1 00:14:11.940 --rc geninfo_all_blocks=1 00:14:11.940 --rc geninfo_unexecuted_blocks=1 00:14:11.940 00:14:11.940 ' 00:14:11.940 19:12:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:11.940 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:11.940 --rc genhtml_branch_coverage=1 00:14:11.940 --rc genhtml_function_coverage=1 00:14:11.940 --rc genhtml_legend=1 00:14:11.940 --rc geninfo_all_blocks=1 00:14:11.940 --rc geninfo_unexecuted_blocks=1 00:14:11.940 00:14:11.940 ' 00:14:11.940 19:12:30 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:11.940 19:12:30 -- nvmf/common.sh@7 -- # uname -s 00:14:11.940 19:12:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:11.940 19:12:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:11.940 19:12:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:11.940 19:12:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:11.940 19:12:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:11.940 19:12:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:11.940 19:12:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:11.940 19:12:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:11.940 19:12:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:11.940 19:12:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:11.940 19:12:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:11.940 19:12:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:11.940 19:12:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:11.940 19:12:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:11.940 19:12:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:11.940 19:12:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:11.940 19:12:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:11.940 19:12:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:11.940 19:12:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:11.940 19:12:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.940 19:12:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.940 19:12:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.940 19:12:30 -- paths/export.sh@5 -- # export PATH 00:14:11.940 19:12:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:11.940 19:12:30 -- nvmf/common.sh@46 -- # : 0 00:14:11.940 19:12:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:11.941 19:12:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:11.941 19:12:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:11.941 19:12:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:11.941 19:12:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:11.941 19:12:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:11.941 19:12:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:11.941 19:12:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:11.941 19:12:30 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:11.941 19:12:30 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:11.941 19:12:30 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:11.941 19:12:30 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:11.941 19:12:30 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:11.941 19:12:30 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:11.941 19:12:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:11.941 19:12:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:11.941 19:12:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:11.941 19:12:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:11.941 19:12:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:11.941 19:12:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:11.941 19:12:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:11.941 19:12:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:11.941 19:12:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:11.941 19:12:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:11.941 19:12:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:11.941 19:12:30 -- common/autotest_common.sh@10 -- # set +x 00:14:13.840 19:12:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:13.840 19:12:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:13.840 19:12:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:13.840 19:12:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:13.840 19:12:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:13.840 19:12:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:13.840 19:12:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:13.840 19:12:32 -- nvmf/common.sh@294 -- # net_devs=() 00:14:13.840 19:12:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:13.840 19:12:32 -- nvmf/common.sh@295 -- # e810=() 00:14:13.840 19:12:32 -- nvmf/common.sh@295 -- # local -ga e810 00:14:13.840 19:12:32 -- nvmf/common.sh@296 -- # x722=() 00:14:13.840 19:12:32 -- nvmf/common.sh@296 -- # local -ga x722 00:14:13.840 19:12:32 -- nvmf/common.sh@297 -- # mlx=() 00:14:13.840 19:12:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:13.840 19:12:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:13.840 19:12:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:13.840 19:12:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:13.840 19:12:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:13.840 19:12:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:13.840 19:12:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:13.840 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:13.840 19:12:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:13.840 19:12:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:13.840 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:13.840 19:12:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:13.840 19:12:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:13.840 19:12:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:13.840 19:12:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.840 19:12:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:13.840 19:12:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.840 19:12:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:13.840 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:13.840 19:12:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.840 19:12:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:13.840 19:12:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.841 19:12:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:13.841 19:12:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.841 19:12:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:13.841 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:13.841 19:12:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.841 19:12:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:13.841 19:12:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:13.841 19:12:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:13.841 19:12:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:13.841 19:12:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:13.841 19:12:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:13.841 19:12:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:13.841 19:12:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:13.841 19:12:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:13.841 19:12:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:13.841 19:12:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:13.841 19:12:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:13.841 19:12:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:13.841 19:12:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:13.841 19:12:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:14.099 19:12:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:14.099 19:12:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:14.099 19:12:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:14.099 19:12:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:14.099 19:12:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:14.099 19:12:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:14.099 19:12:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:14.099 19:12:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:14.099 19:12:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:14.099 19:12:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:14.099 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:14.099 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:14:14.099 00:14:14.099 --- 10.0.0.2 ping statistics --- 00:14:14.099 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.099 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:14:14.099 19:12:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:14.099 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:14.099 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:14:14.099 00:14:14.099 --- 10.0.0.1 ping statistics --- 00:14:14.099 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.099 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:14:14.099 19:12:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:14.099 19:12:32 -- nvmf/common.sh@410 -- # return 0 00:14:14.099 19:12:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:14.099 19:12:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:14.099 19:12:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:14.099 19:12:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:14.099 19:12:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:14.099 19:12:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:14.099 19:12:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:14.099 19:12:32 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:14.099 19:12:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:14.099 19:12:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:14.099 19:12:32 -- common/autotest_common.sh@10 -- # set +x 00:14:14.100 19:12:32 -- nvmf/common.sh@469 -- # nvmfpid=3420044 00:14:14.100 19:12:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:14.100 19:12:32 -- nvmf/common.sh@470 -- # waitforlisten 3420044 00:14:14.100 19:12:32 -- common/autotest_common.sh@829 -- # '[' -z 3420044 ']' 00:14:14.100 19:12:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:14.100 19:12:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:14.100 19:12:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:14.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:14.100 19:12:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:14.100 19:12:32 -- common/autotest_common.sh@10 -- # set +x 00:14:14.100 [2024-11-18 19:12:32.638957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:14.100 [2024-11-18 19:12:32.639037] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:14.100 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.358 [2024-11-18 19:12:32.707457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:14.358 [2024-11-18 19:12:32.822811] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:14.358 [2024-11-18 19:12:32.822976] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:14.358 [2024-11-18 19:12:32.823002] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:14.358 [2024-11-18 19:12:32.823035] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:14.358 [2024-11-18 19:12:32.823110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:14.358 [2024-11-18 19:12:32.823178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:14.358 [2024-11-18 19:12:32.823196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:15.290 19:12:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:15.290 19:12:33 -- common/autotest_common.sh@862 -- # return 0 00:14:15.290 19:12:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:15.290 19:12:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:15.290 19:12:33 -- common/autotest_common.sh@10 -- # set +x 00:14:15.291 19:12:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:15.291 19:12:33 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:15.291 [2024-11-18 19:12:33.891210] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:15.548 19:12:33 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:15.806 19:12:34 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:15.806 19:12:34 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:16.065 19:12:34 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:16.065 19:12:34 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:16.323 19:12:34 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:16.581 19:12:35 -- target/nvmf_lvol.sh@29 -- # lvs=89c8d16a-97e6-444c-b502-a9c2ae2dc365 00:14:16.581 19:12:35 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 89c8d16a-97e6-444c-b502-a9c2ae2dc365 lvol 20 00:14:16.838 19:12:35 -- target/nvmf_lvol.sh@32 -- # lvol=d4e0f07c-668e-4493-a7f8-74fd16b6e6b0 00:14:16.838 19:12:35 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:17.095 19:12:35 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 d4e0f07c-668e-4493-a7f8-74fd16b6e6b0 00:14:17.353 19:12:35 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:17.610 [2024-11-18 19:12:36.041961] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:17.610 19:12:36 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:17.868 19:12:36 -- target/nvmf_lvol.sh@42 -- # perf_pid=3420612 00:14:17.868 19:12:36 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:17.868 19:12:36 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:17.868 EAL: No free 2048 kB hugepages reported on node 1 00:14:18.804 19:12:37 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot d4e0f07c-668e-4493-a7f8-74fd16b6e6b0 MY_SNAPSHOT 00:14:19.370 19:12:37 -- target/nvmf_lvol.sh@47 -- # snapshot=f9799d76-2fe7-4397-8f9b-5119215d0e2f 00:14:19.370 19:12:37 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize d4e0f07c-668e-4493-a7f8-74fd16b6e6b0 30 00:14:19.628 19:12:37 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone f9799d76-2fe7-4397-8f9b-5119215d0e2f MY_CLONE 00:14:19.886 19:12:38 -- target/nvmf_lvol.sh@49 -- # clone=88bc8fcb-706b-49a8-9cc9-a383b6ffab41 00:14:19.886 19:12:38 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 88bc8fcb-706b-49a8-9cc9-a383b6ffab41 00:14:20.451 19:12:38 -- target/nvmf_lvol.sh@53 -- # wait 3420612 00:14:28.570 Initializing NVMe Controllers 00:14:28.570 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:28.570 Controller IO queue size 128, less than required. 00:14:28.570 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:28.570 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:28.570 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:28.570 Initialization complete. Launching workers. 00:14:28.570 ======================================================== 00:14:28.570 Latency(us) 00:14:28.570 Device Information : IOPS MiB/s Average min max 00:14:28.570 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10596.70 41.39 12083.89 1954.83 86927.20 00:14:28.570 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10563.10 41.26 12126.06 2138.85 66992.55 00:14:28.570 ======================================================== 00:14:28.570 Total : 21159.80 82.66 12104.94 1954.83 86927.20 00:14:28.570 00:14:28.570 19:12:46 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:28.570 19:12:47 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete d4e0f07c-668e-4493-a7f8-74fd16b6e6b0 00:14:28.828 19:12:47 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 89c8d16a-97e6-444c-b502-a9c2ae2dc365 00:14:29.085 19:12:47 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:29.085 19:12:47 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:29.085 19:12:47 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:29.085 19:12:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:29.085 19:12:47 -- nvmf/common.sh@116 -- # sync 00:14:29.085 19:12:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:29.085 19:12:47 -- nvmf/common.sh@119 -- # set +e 00:14:29.085 19:12:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:29.085 19:12:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:29.085 rmmod nvme_tcp 00:14:29.085 rmmod nvme_fabrics 00:14:29.085 rmmod nvme_keyring 00:14:29.085 19:12:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:29.085 19:12:47 -- nvmf/common.sh@123 -- # set -e 00:14:29.085 19:12:47 -- nvmf/common.sh@124 -- # return 0 00:14:29.085 19:12:47 -- nvmf/common.sh@477 -- # '[' -n 3420044 ']' 00:14:29.085 19:12:47 -- nvmf/common.sh@478 -- # killprocess 3420044 00:14:29.085 19:12:47 -- common/autotest_common.sh@936 -- # '[' -z 3420044 ']' 00:14:29.085 19:12:47 -- common/autotest_common.sh@940 -- # kill -0 3420044 00:14:29.085 19:12:47 -- common/autotest_common.sh@941 -- # uname 00:14:29.085 19:12:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:29.085 19:12:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3420044 00:14:29.085 19:12:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:29.085 19:12:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:29.085 19:12:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3420044' 00:14:29.085 killing process with pid 3420044 00:14:29.085 19:12:47 -- common/autotest_common.sh@955 -- # kill 3420044 00:14:29.085 19:12:47 -- common/autotest_common.sh@960 -- # wait 3420044 00:14:29.345 19:12:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:29.345 19:12:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:29.345 19:12:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:29.345 19:12:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:29.345 19:12:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:29.345 19:12:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:29.345 19:12:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:29.345 19:12:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.876 19:12:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:31.876 00:14:31.876 real 0m19.662s 00:14:31.876 user 1m7.505s 00:14:31.876 sys 0m5.166s 00:14:31.876 19:12:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:31.876 19:12:49 -- common/autotest_common.sh@10 -- # set +x 00:14:31.876 ************************************ 00:14:31.876 END TEST nvmf_lvol 00:14:31.876 ************************************ 00:14:31.876 19:12:49 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:31.876 19:12:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:31.876 19:12:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:31.876 19:12:49 -- common/autotest_common.sh@10 -- # set +x 00:14:31.876 ************************************ 00:14:31.876 START TEST nvmf_lvs_grow 00:14:31.876 ************************************ 00:14:31.876 19:12:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:31.876 * Looking for test storage... 00:14:31.876 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:31.876 19:12:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:31.876 19:12:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:31.876 19:12:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:31.876 19:12:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:31.876 19:12:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:31.876 19:12:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:31.876 19:12:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:31.876 19:12:50 -- scripts/common.sh@335 -- # IFS=.-: 00:14:31.876 19:12:50 -- scripts/common.sh@335 -- # read -ra ver1 00:14:31.876 19:12:50 -- scripts/common.sh@336 -- # IFS=.-: 00:14:31.876 19:12:50 -- scripts/common.sh@336 -- # read -ra ver2 00:14:31.876 19:12:50 -- scripts/common.sh@337 -- # local 'op=<' 00:14:31.876 19:12:50 -- scripts/common.sh@339 -- # ver1_l=2 00:14:31.876 19:12:50 -- scripts/common.sh@340 -- # ver2_l=1 00:14:31.876 19:12:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:31.876 19:12:50 -- scripts/common.sh@343 -- # case "$op" in 00:14:31.876 19:12:50 -- scripts/common.sh@344 -- # : 1 00:14:31.876 19:12:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:31.876 19:12:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:31.876 19:12:50 -- scripts/common.sh@364 -- # decimal 1 00:14:31.876 19:12:50 -- scripts/common.sh@352 -- # local d=1 00:14:31.876 19:12:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:31.876 19:12:50 -- scripts/common.sh@354 -- # echo 1 00:14:31.876 19:12:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:31.876 19:12:50 -- scripts/common.sh@365 -- # decimal 2 00:14:31.876 19:12:50 -- scripts/common.sh@352 -- # local d=2 00:14:31.876 19:12:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:31.876 19:12:50 -- scripts/common.sh@354 -- # echo 2 00:14:31.876 19:12:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:31.877 19:12:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:31.877 19:12:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:31.877 19:12:50 -- scripts/common.sh@367 -- # return 0 00:14:31.877 19:12:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:31.877 19:12:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:31.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.877 --rc genhtml_branch_coverage=1 00:14:31.877 --rc genhtml_function_coverage=1 00:14:31.877 --rc genhtml_legend=1 00:14:31.877 --rc geninfo_all_blocks=1 00:14:31.877 --rc geninfo_unexecuted_blocks=1 00:14:31.877 00:14:31.877 ' 00:14:31.877 19:12:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:31.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.877 --rc genhtml_branch_coverage=1 00:14:31.877 --rc genhtml_function_coverage=1 00:14:31.877 --rc genhtml_legend=1 00:14:31.877 --rc geninfo_all_blocks=1 00:14:31.877 --rc geninfo_unexecuted_blocks=1 00:14:31.877 00:14:31.877 ' 00:14:31.877 19:12:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:31.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.877 --rc genhtml_branch_coverage=1 00:14:31.877 --rc genhtml_function_coverage=1 00:14:31.877 --rc genhtml_legend=1 00:14:31.877 --rc geninfo_all_blocks=1 00:14:31.877 --rc geninfo_unexecuted_blocks=1 00:14:31.877 00:14:31.877 ' 00:14:31.877 19:12:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:31.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:31.877 --rc genhtml_branch_coverage=1 00:14:31.877 --rc genhtml_function_coverage=1 00:14:31.877 --rc genhtml_legend=1 00:14:31.877 --rc geninfo_all_blocks=1 00:14:31.877 --rc geninfo_unexecuted_blocks=1 00:14:31.877 00:14:31.877 ' 00:14:31.877 19:12:50 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:31.877 19:12:50 -- nvmf/common.sh@7 -- # uname -s 00:14:31.877 19:12:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:31.877 19:12:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:31.877 19:12:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:31.877 19:12:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:31.877 19:12:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:31.877 19:12:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:31.877 19:12:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:31.877 19:12:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:31.877 19:12:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:31.877 19:12:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:31.877 19:12:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:31.877 19:12:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:31.877 19:12:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:31.877 19:12:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:31.877 19:12:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:31.877 19:12:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:31.877 19:12:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:31.877 19:12:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:31.877 19:12:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:31.877 19:12:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.877 19:12:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.877 19:12:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.877 19:12:50 -- paths/export.sh@5 -- # export PATH 00:14:31.877 19:12:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:31.877 19:12:50 -- nvmf/common.sh@46 -- # : 0 00:14:31.877 19:12:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:31.877 19:12:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:31.877 19:12:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:31.877 19:12:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:31.877 19:12:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:31.877 19:12:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:31.877 19:12:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:31.877 19:12:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:31.877 19:12:50 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:31.877 19:12:50 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:31.877 19:12:50 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:31.877 19:12:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:31.877 19:12:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:31.877 19:12:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:31.877 19:12:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:31.877 19:12:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:31.877 19:12:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:31.877 19:12:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:31.877 19:12:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:31.877 19:12:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:31.877 19:12:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:31.877 19:12:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:31.877 19:12:50 -- common/autotest_common.sh@10 -- # set +x 00:14:33.777 19:12:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:33.777 19:12:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:33.777 19:12:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:33.778 19:12:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:33.778 19:12:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:33.778 19:12:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:33.778 19:12:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:33.778 19:12:52 -- nvmf/common.sh@294 -- # net_devs=() 00:14:33.778 19:12:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:33.778 19:12:52 -- nvmf/common.sh@295 -- # e810=() 00:14:33.778 19:12:52 -- nvmf/common.sh@295 -- # local -ga e810 00:14:33.778 19:12:52 -- nvmf/common.sh@296 -- # x722=() 00:14:33.778 19:12:52 -- nvmf/common.sh@296 -- # local -ga x722 00:14:33.778 19:12:52 -- nvmf/common.sh@297 -- # mlx=() 00:14:33.778 19:12:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:33.778 19:12:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:33.778 19:12:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:33.778 19:12:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:33.778 19:12:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:33.778 19:12:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:33.778 19:12:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:33.778 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:33.778 19:12:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:33.778 19:12:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:33.778 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:33.778 19:12:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:33.778 19:12:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:33.778 19:12:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:33.778 19:12:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:33.778 19:12:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:33.778 19:12:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:33.778 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:33.778 19:12:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:33.778 19:12:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:33.778 19:12:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:33.778 19:12:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:33.778 19:12:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:33.778 19:12:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:33.778 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:33.778 19:12:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:33.778 19:12:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:33.778 19:12:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:33.778 19:12:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:33.778 19:12:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:33.778 19:12:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:33.778 19:12:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:33.778 19:12:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:33.778 19:12:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:33.778 19:12:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:33.778 19:12:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:33.778 19:12:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:33.778 19:12:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:33.778 19:12:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:33.778 19:12:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:33.778 19:12:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:33.778 19:12:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:33.778 19:12:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:33.778 19:12:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:33.778 19:12:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:33.778 19:12:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:33.778 19:12:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:33.778 19:12:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:33.778 19:12:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:33.778 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:33.778 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:14:33.778 00:14:33.778 --- 10.0.0.2 ping statistics --- 00:14:33.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:33.778 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:14:33.778 19:12:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:33.778 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:33.778 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:14:33.778 00:14:33.778 --- 10.0.0.1 ping statistics --- 00:14:33.778 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:33.778 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:14:33.778 19:12:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:33.778 19:12:52 -- nvmf/common.sh@410 -- # return 0 00:14:33.778 19:12:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:33.778 19:12:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:33.778 19:12:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:33.778 19:12:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:33.778 19:12:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:33.778 19:12:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:33.778 19:12:52 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:33.778 19:12:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:33.778 19:12:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:33.778 19:12:52 -- common/autotest_common.sh@10 -- # set +x 00:14:33.778 19:12:52 -- nvmf/common.sh@469 -- # nvmfpid=3423928 00:14:33.778 19:12:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:33.778 19:12:52 -- nvmf/common.sh@470 -- # waitforlisten 3423928 00:14:33.778 19:12:52 -- common/autotest_common.sh@829 -- # '[' -z 3423928 ']' 00:14:33.778 19:12:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:33.778 19:12:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:33.778 19:12:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:33.778 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:33.778 19:12:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:33.778 19:12:52 -- common/autotest_common.sh@10 -- # set +x 00:14:33.778 [2024-11-18 19:12:52.344002] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:33.778 [2024-11-18 19:12:52.344076] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:33.778 EAL: No free 2048 kB hugepages reported on node 1 00:14:34.035 [2024-11-18 19:12:52.407455] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:34.036 [2024-11-18 19:12:52.511275] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:34.036 [2024-11-18 19:12:52.511429] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:34.036 [2024-11-18 19:12:52.511446] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:34.036 [2024-11-18 19:12:52.511459] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:34.036 [2024-11-18 19:12:52.511485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:34.968 19:12:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:34.968 19:12:53 -- common/autotest_common.sh@862 -- # return 0 00:14:34.968 19:12:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:34.968 19:12:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:34.968 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:34.968 19:12:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:34.968 19:12:53 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:35.225 [2024-11-18 19:12:53.628418] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:35.225 19:12:53 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:35.225 19:12:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:35.225 19:12:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:35.225 19:12:53 -- common/autotest_common.sh@10 -- # set +x 00:14:35.225 ************************************ 00:14:35.225 START TEST lvs_grow_clean 00:14:35.225 ************************************ 00:14:35.226 19:12:53 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:35.226 19:12:53 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:35.484 19:12:53 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:35.484 19:12:53 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:35.743 19:12:54 -- target/nvmf_lvs_grow.sh@28 -- # lvs=bfd54a16-8872-475e-bf97-dee467eebc22 00:14:35.743 19:12:54 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:35.743 19:12:54 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:36.002 19:12:54 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:36.002 19:12:54 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:36.002 19:12:54 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u bfd54a16-8872-475e-bf97-dee467eebc22 lvol 150 00:14:36.261 19:12:54 -- target/nvmf_lvs_grow.sh@33 -- # lvol=13442373-e5e2-485e-92ee-629a03d8d7cc 00:14:36.261 19:12:54 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:36.261 19:12:54 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:36.520 [2024-11-18 19:12:55.001979] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:36.520 [2024-11-18 19:12:55.002071] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:36.520 true 00:14:36.520 19:12:55 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:36.520 19:12:55 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:36.778 19:12:55 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:36.778 19:12:55 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:37.037 19:12:55 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 13442373-e5e2-485e-92ee-629a03d8d7cc 00:14:37.296 19:12:55 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:37.554 [2024-11-18 19:12:56.061244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:37.554 19:12:56 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:37.812 19:12:56 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3424387 00:14:37.812 19:12:56 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:37.812 19:12:56 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:37.812 19:12:56 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3424387 /var/tmp/bdevperf.sock 00:14:37.812 19:12:56 -- common/autotest_common.sh@829 -- # '[' -z 3424387 ']' 00:14:37.812 19:12:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:37.812 19:12:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:37.812 19:12:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:37.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:37.812 19:12:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:37.812 19:12:56 -- common/autotest_common.sh@10 -- # set +x 00:14:37.812 [2024-11-18 19:12:56.367579] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:37.812 [2024-11-18 19:12:56.367677] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3424387 ] 00:14:37.812 EAL: No free 2048 kB hugepages reported on node 1 00:14:38.071 [2024-11-18 19:12:56.428118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:38.071 [2024-11-18 19:12:56.544433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:39.006 19:12:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:39.006 19:12:57 -- common/autotest_common.sh@862 -- # return 0 00:14:39.006 19:12:57 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:39.264 Nvme0n1 00:14:39.264 19:12:57 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:39.523 [ 00:14:39.523 { 00:14:39.523 "name": "Nvme0n1", 00:14:39.523 "aliases": [ 00:14:39.523 "13442373-e5e2-485e-92ee-629a03d8d7cc" 00:14:39.523 ], 00:14:39.523 "product_name": "NVMe disk", 00:14:39.523 "block_size": 4096, 00:14:39.523 "num_blocks": 38912, 00:14:39.523 "uuid": "13442373-e5e2-485e-92ee-629a03d8d7cc", 00:14:39.523 "assigned_rate_limits": { 00:14:39.523 "rw_ios_per_sec": 0, 00:14:39.523 "rw_mbytes_per_sec": 0, 00:14:39.523 "r_mbytes_per_sec": 0, 00:14:39.523 "w_mbytes_per_sec": 0 00:14:39.523 }, 00:14:39.523 "claimed": false, 00:14:39.523 "zoned": false, 00:14:39.523 "supported_io_types": { 00:14:39.523 "read": true, 00:14:39.523 "write": true, 00:14:39.523 "unmap": true, 00:14:39.523 "write_zeroes": true, 00:14:39.523 "flush": true, 00:14:39.523 "reset": true, 00:14:39.523 "compare": true, 00:14:39.523 "compare_and_write": true, 00:14:39.523 "abort": true, 00:14:39.523 "nvme_admin": true, 00:14:39.523 "nvme_io": true 00:14:39.523 }, 00:14:39.523 "driver_specific": { 00:14:39.523 "nvme": [ 00:14:39.523 { 00:14:39.523 "trid": { 00:14:39.523 "trtype": "TCP", 00:14:39.523 "adrfam": "IPv4", 00:14:39.523 "traddr": "10.0.0.2", 00:14:39.523 "trsvcid": "4420", 00:14:39.523 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:39.523 }, 00:14:39.523 "ctrlr_data": { 00:14:39.523 "cntlid": 1, 00:14:39.523 "vendor_id": "0x8086", 00:14:39.523 "model_number": "SPDK bdev Controller", 00:14:39.523 "serial_number": "SPDK0", 00:14:39.523 "firmware_revision": "24.01.1", 00:14:39.523 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:39.523 "oacs": { 00:14:39.523 "security": 0, 00:14:39.523 "format": 0, 00:14:39.523 "firmware": 0, 00:14:39.523 "ns_manage": 0 00:14:39.523 }, 00:14:39.523 "multi_ctrlr": true, 00:14:39.523 "ana_reporting": false 00:14:39.523 }, 00:14:39.523 "vs": { 00:14:39.523 "nvme_version": "1.3" 00:14:39.523 }, 00:14:39.523 "ns_data": { 00:14:39.523 "id": 1, 00:14:39.523 "can_share": true 00:14:39.523 } 00:14:39.523 } 00:14:39.523 ], 00:14:39.523 "mp_policy": "active_passive" 00:14:39.523 } 00:14:39.523 } 00:14:39.523 ] 00:14:39.523 19:12:58 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3424650 00:14:39.523 19:12:58 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:39.523 19:12:58 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:39.781 Running I/O for 10 seconds... 00:14:40.752 Latency(us) 00:14:40.752 [2024-11-18T18:12:59.357Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:40.753 [2024-11-18T18:12:59.358Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.753 Nvme0n1 : 1.00 15010.00 58.63 0.00 0.00 0.00 0.00 0.00 00:14:40.753 [2024-11-18T18:12:59.358Z] =================================================================================================================== 00:14:40.753 [2024-11-18T18:12:59.358Z] Total : 15010.00 58.63 0.00 0.00 0.00 0.00 0.00 00:14:40.753 00:14:41.759 19:13:00 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:41.759 [2024-11-18T18:13:00.364Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.759 Nvme0n1 : 2.00 15102.50 58.99 0.00 0.00 0.00 0.00 0.00 00:14:41.759 [2024-11-18T18:13:00.364Z] =================================================================================================================== 00:14:41.759 [2024-11-18T18:13:00.364Z] Total : 15102.50 58.99 0.00 0.00 0.00 0.00 0.00 00:14:41.759 00:14:41.759 true 00:14:41.759 19:13:00 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:41.759 19:13:00 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:42.019 19:13:00 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:42.019 19:13:00 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:42.019 19:13:00 -- target/nvmf_lvs_grow.sh@65 -- # wait 3424650 00:14:42.953 [2024-11-18T18:13:01.558Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.953 Nvme0n1 : 3.00 15184.33 59.31 0.00 0.00 0.00 0.00 0.00 00:14:42.953 [2024-11-18T18:13:01.558Z] =================================================================================================================== 00:14:42.953 [2024-11-18T18:13:01.558Z] Total : 15184.33 59.31 0.00 0.00 0.00 0.00 0.00 00:14:42.953 00:14:43.886 [2024-11-18T18:13:02.491Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.886 Nvme0n1 : 4.00 15297.50 59.76 0.00 0.00 0.00 0.00 0.00 00:14:43.886 [2024-11-18T18:13:02.491Z] =================================================================================================================== 00:14:43.886 [2024-11-18T18:13:02.491Z] Total : 15297.50 59.76 0.00 0.00 0.00 0.00 0.00 00:14:43.886 00:14:44.819 [2024-11-18T18:13:03.424Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.819 Nvme0n1 : 5.00 15375.00 60.06 0.00 0.00 0.00 0.00 0.00 00:14:44.819 [2024-11-18T18:13:03.424Z] =================================================================================================================== 00:14:44.819 [2024-11-18T18:13:03.425Z] Total : 15375.00 60.06 0.00 0.00 0.00 0.00 0.00 00:14:44.820 00:14:45.754 [2024-11-18T18:13:04.359Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.754 Nvme0n1 : 6.00 15447.83 60.34 0.00 0.00 0.00 0.00 0.00 00:14:45.754 [2024-11-18T18:13:04.359Z] =================================================================================================================== 00:14:45.754 [2024-11-18T18:13:04.359Z] Total : 15447.83 60.34 0.00 0.00 0.00 0.00 0.00 00:14:45.754 00:14:46.689 [2024-11-18T18:13:05.294Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.689 Nvme0n1 : 7.00 15506.29 60.57 0.00 0.00 0.00 0.00 0.00 00:14:46.689 [2024-11-18T18:13:05.294Z] =================================================================================================================== 00:14:46.689 [2024-11-18T18:13:05.294Z] Total : 15506.29 60.57 0.00 0.00 0.00 0.00 0.00 00:14:46.689 00:14:47.624 [2024-11-18T18:13:06.229Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.624 Nvme0n1 : 8.00 15611.50 60.98 0.00 0.00 0.00 0.00 0.00 00:14:47.624 [2024-11-18T18:13:06.229Z] =================================================================================================================== 00:14:47.624 [2024-11-18T18:13:06.229Z] Total : 15611.50 60.98 0.00 0.00 0.00 0.00 0.00 00:14:47.624 00:14:48.999 [2024-11-18T18:13:07.604Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.999 Nvme0n1 : 9.00 15639.22 61.09 0.00 0.00 0.00 0.00 0.00 00:14:48.999 [2024-11-18T18:13:07.604Z] =================================================================================================================== 00:14:48.999 [2024-11-18T18:13:07.604Z] Total : 15639.22 61.09 0.00 0.00 0.00 0.00 0.00 00:14:48.999 00:14:49.934 [2024-11-18T18:13:08.539Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.934 Nvme0n1 : 10.00 15656.90 61.16 0.00 0.00 0.00 0.00 0.00 00:14:49.934 [2024-11-18T18:13:08.539Z] =================================================================================================================== 00:14:49.934 [2024-11-18T18:13:08.539Z] Total : 15656.90 61.16 0.00 0.00 0.00 0.00 0.00 00:14:49.934 00:14:49.934 00:14:49.934 Latency(us) 00:14:49.934 [2024-11-18T18:13:08.539Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:49.934 [2024-11-18T18:13:08.539Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.934 Nvme0n1 : 10.00 15664.12 61.19 0.00 0.00 8167.20 2160.26 16893.72 00:14:49.934 [2024-11-18T18:13:08.539Z] =================================================================================================================== 00:14:49.934 [2024-11-18T18:13:08.539Z] Total : 15664.12 61.19 0.00 0.00 8167.20 2160.26 16893.72 00:14:49.934 0 00:14:49.934 19:13:08 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3424387 00:14:49.934 19:13:08 -- common/autotest_common.sh@936 -- # '[' -z 3424387 ']' 00:14:49.934 19:13:08 -- common/autotest_common.sh@940 -- # kill -0 3424387 00:14:49.934 19:13:08 -- common/autotest_common.sh@941 -- # uname 00:14:49.934 19:13:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:49.934 19:13:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3424387 00:14:49.934 19:13:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:49.934 19:13:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:49.934 19:13:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3424387' 00:14:49.934 killing process with pid 3424387 00:14:49.934 19:13:08 -- common/autotest_common.sh@955 -- # kill 3424387 00:14:49.934 Received shutdown signal, test time was about 10.000000 seconds 00:14:49.934 00:14:49.934 Latency(us) 00:14:49.934 [2024-11-18T18:13:08.539Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:49.934 [2024-11-18T18:13:08.539Z] =================================================================================================================== 00:14:49.934 [2024-11-18T18:13:08.539Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:49.934 19:13:08 -- common/autotest_common.sh@960 -- # wait 3424387 00:14:50.193 19:13:08 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:50.451 19:13:08 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:50.451 19:13:08 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:50.711 19:13:09 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:50.711 19:13:09 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:50.711 19:13:09 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:50.971 [2024-11-18 19:13:09.328392] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:50.971 19:13:09 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:50.971 19:13:09 -- common/autotest_common.sh@650 -- # local es=0 00:14:50.971 19:13:09 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:50.971 19:13:09 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.971 19:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:50.971 19:13:09 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.971 19:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:50.971 19:13:09 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.971 19:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:50.971 19:13:09 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:50.971 19:13:09 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:50.971 19:13:09 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:51.230 request: 00:14:51.230 { 00:14:51.230 "uuid": "bfd54a16-8872-475e-bf97-dee467eebc22", 00:14:51.230 "method": "bdev_lvol_get_lvstores", 00:14:51.230 "req_id": 1 00:14:51.230 } 00:14:51.230 Got JSON-RPC error response 00:14:51.230 response: 00:14:51.230 { 00:14:51.230 "code": -19, 00:14:51.230 "message": "No such device" 00:14:51.230 } 00:14:51.230 19:13:09 -- common/autotest_common.sh@653 -- # es=1 00:14:51.230 19:13:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:51.230 19:13:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:51.230 19:13:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:51.230 19:13:09 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:51.489 aio_bdev 00:14:51.489 19:13:09 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 13442373-e5e2-485e-92ee-629a03d8d7cc 00:14:51.489 19:13:09 -- common/autotest_common.sh@897 -- # local bdev_name=13442373-e5e2-485e-92ee-629a03d8d7cc 00:14:51.489 19:13:09 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:51.489 19:13:09 -- common/autotest_common.sh@899 -- # local i 00:14:51.489 19:13:09 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:51.489 19:13:09 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:51.489 19:13:09 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:51.748 19:13:10 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 13442373-e5e2-485e-92ee-629a03d8d7cc -t 2000 00:14:52.006 [ 00:14:52.006 { 00:14:52.006 "name": "13442373-e5e2-485e-92ee-629a03d8d7cc", 00:14:52.006 "aliases": [ 00:14:52.006 "lvs/lvol" 00:14:52.006 ], 00:14:52.006 "product_name": "Logical Volume", 00:14:52.006 "block_size": 4096, 00:14:52.006 "num_blocks": 38912, 00:14:52.006 "uuid": "13442373-e5e2-485e-92ee-629a03d8d7cc", 00:14:52.006 "assigned_rate_limits": { 00:14:52.006 "rw_ios_per_sec": 0, 00:14:52.006 "rw_mbytes_per_sec": 0, 00:14:52.006 "r_mbytes_per_sec": 0, 00:14:52.006 "w_mbytes_per_sec": 0 00:14:52.006 }, 00:14:52.006 "claimed": false, 00:14:52.006 "zoned": false, 00:14:52.006 "supported_io_types": { 00:14:52.006 "read": true, 00:14:52.006 "write": true, 00:14:52.006 "unmap": true, 00:14:52.006 "write_zeroes": true, 00:14:52.006 "flush": false, 00:14:52.006 "reset": true, 00:14:52.006 "compare": false, 00:14:52.006 "compare_and_write": false, 00:14:52.006 "abort": false, 00:14:52.006 "nvme_admin": false, 00:14:52.006 "nvme_io": false 00:14:52.006 }, 00:14:52.006 "driver_specific": { 00:14:52.006 "lvol": { 00:14:52.006 "lvol_store_uuid": "bfd54a16-8872-475e-bf97-dee467eebc22", 00:14:52.006 "base_bdev": "aio_bdev", 00:14:52.006 "thin_provision": false, 00:14:52.006 "snapshot": false, 00:14:52.006 "clone": false, 00:14:52.006 "esnap_clone": false 00:14:52.006 } 00:14:52.006 } 00:14:52.006 } 00:14:52.006 ] 00:14:52.006 19:13:10 -- common/autotest_common.sh@905 -- # return 0 00:14:52.006 19:13:10 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:52.006 19:13:10 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:52.264 19:13:10 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:52.265 19:13:10 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:52.265 19:13:10 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:52.524 19:13:10 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:52.524 19:13:10 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 13442373-e5e2-485e-92ee-629a03d8d7cc 00:14:52.782 19:13:11 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u bfd54a16-8872-475e-bf97-dee467eebc22 00:14:53.040 19:13:11 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:53.299 00:14:53.299 real 0m18.100s 00:14:53.299 user 0m17.811s 00:14:53.299 sys 0m1.839s 00:14:53.299 19:13:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:53.299 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:14:53.299 ************************************ 00:14:53.299 END TEST lvs_grow_clean 00:14:53.299 ************************************ 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:53.299 19:13:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:53.299 19:13:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:53.299 19:13:11 -- common/autotest_common.sh@10 -- # set +x 00:14:53.299 ************************************ 00:14:53.299 START TEST lvs_grow_dirty 00:14:53.299 ************************************ 00:14:53.299 19:13:11 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:53.299 19:13:11 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:53.558 19:13:12 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:53.558 19:13:12 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:53.817 19:13:12 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:14:53.817 19:13:12 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:14:53.817 19:13:12 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:54.075 19:13:12 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:54.075 19:13:12 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:54.075 19:13:12 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e04ccb01-e028-4f64-a6b5-f9571530b9ba lvol 150 00:14:54.333 19:13:12 -- target/nvmf_lvs_grow.sh@33 -- # lvol=e5bede3e-1f99-4196-923f-4240958cb015 00:14:54.333 19:13:12 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.334 19:13:12 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:54.592 [2024-11-18 19:13:13.066989] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:54.592 [2024-11-18 19:13:13.067074] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:54.592 true 00:14:54.592 19:13:13 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:14:54.592 19:13:13 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:54.850 19:13:13 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:54.850 19:13:13 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:55.108 19:13:13 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 e5bede3e-1f99-4196-923f-4240958cb015 00:14:55.366 19:13:13 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:55.625 19:13:14 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:55.883 19:13:14 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3426634 00:14:55.883 19:13:14 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:55.883 19:13:14 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:55.883 19:13:14 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3426634 /var/tmp/bdevperf.sock 00:14:55.883 19:13:14 -- common/autotest_common.sh@829 -- # '[' -z 3426634 ']' 00:14:55.883 19:13:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:55.883 19:13:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:55.883 19:13:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:55.883 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:55.883 19:13:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:55.883 19:13:14 -- common/autotest_common.sh@10 -- # set +x 00:14:55.883 [2024-11-18 19:13:14.431517] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:55.883 [2024-11-18 19:13:14.431598] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3426634 ] 00:14:55.883 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.142 [2024-11-18 19:13:14.492526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.142 [2024-11-18 19:13:14.613056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:57.076 19:13:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:57.076 19:13:15 -- common/autotest_common.sh@862 -- # return 0 00:14:57.076 19:13:15 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:57.334 Nvme0n1 00:14:57.334 19:13:15 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:57.592 [ 00:14:57.592 { 00:14:57.592 "name": "Nvme0n1", 00:14:57.592 "aliases": [ 00:14:57.592 "e5bede3e-1f99-4196-923f-4240958cb015" 00:14:57.592 ], 00:14:57.592 "product_name": "NVMe disk", 00:14:57.592 "block_size": 4096, 00:14:57.592 "num_blocks": 38912, 00:14:57.592 "uuid": "e5bede3e-1f99-4196-923f-4240958cb015", 00:14:57.592 "assigned_rate_limits": { 00:14:57.592 "rw_ios_per_sec": 0, 00:14:57.592 "rw_mbytes_per_sec": 0, 00:14:57.592 "r_mbytes_per_sec": 0, 00:14:57.592 "w_mbytes_per_sec": 0 00:14:57.592 }, 00:14:57.592 "claimed": false, 00:14:57.592 "zoned": false, 00:14:57.592 "supported_io_types": { 00:14:57.592 "read": true, 00:14:57.592 "write": true, 00:14:57.592 "unmap": true, 00:14:57.592 "write_zeroes": true, 00:14:57.592 "flush": true, 00:14:57.592 "reset": true, 00:14:57.592 "compare": true, 00:14:57.592 "compare_and_write": true, 00:14:57.592 "abort": true, 00:14:57.592 "nvme_admin": true, 00:14:57.592 "nvme_io": true 00:14:57.592 }, 00:14:57.592 "driver_specific": { 00:14:57.592 "nvme": [ 00:14:57.592 { 00:14:57.592 "trid": { 00:14:57.592 "trtype": "TCP", 00:14:57.592 "adrfam": "IPv4", 00:14:57.592 "traddr": "10.0.0.2", 00:14:57.592 "trsvcid": "4420", 00:14:57.592 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:57.592 }, 00:14:57.592 "ctrlr_data": { 00:14:57.592 "cntlid": 1, 00:14:57.592 "vendor_id": "0x8086", 00:14:57.592 "model_number": "SPDK bdev Controller", 00:14:57.592 "serial_number": "SPDK0", 00:14:57.592 "firmware_revision": "24.01.1", 00:14:57.592 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:57.592 "oacs": { 00:14:57.592 "security": 0, 00:14:57.592 "format": 0, 00:14:57.592 "firmware": 0, 00:14:57.592 "ns_manage": 0 00:14:57.592 }, 00:14:57.592 "multi_ctrlr": true, 00:14:57.592 "ana_reporting": false 00:14:57.592 }, 00:14:57.592 "vs": { 00:14:57.592 "nvme_version": "1.3" 00:14:57.592 }, 00:14:57.592 "ns_data": { 00:14:57.592 "id": 1, 00:14:57.592 "can_share": true 00:14:57.592 } 00:14:57.592 } 00:14:57.592 ], 00:14:57.592 "mp_policy": "active_passive" 00:14:57.592 } 00:14:57.592 } 00:14:57.592 ] 00:14:57.592 19:13:16 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3426900 00:14:57.592 19:13:16 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:57.592 19:13:16 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:57.850 Running I/O for 10 seconds... 00:14:58.784 Latency(us) 00:14:58.784 [2024-11-18T18:13:17.389Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.784 [2024-11-18T18:13:17.389Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.784 Nvme0n1 : 1.00 14696.00 57.41 0.00 0.00 0.00 0.00 0.00 00:14:58.784 [2024-11-18T18:13:17.389Z] =================================================================================================================== 00:14:58.784 [2024-11-18T18:13:17.389Z] Total : 14696.00 57.41 0.00 0.00 0.00 0.00 0.00 00:14:58.784 00:14:59.718 19:13:18 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:14:59.718 [2024-11-18T18:13:18.323Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.718 Nvme0n1 : 2.00 14837.50 57.96 0.00 0.00 0.00 0.00 0.00 00:14:59.718 [2024-11-18T18:13:18.323Z] =================================================================================================================== 00:14:59.718 [2024-11-18T18:13:18.323Z] Total : 14837.50 57.96 0.00 0.00 0.00 0.00 0.00 00:14:59.718 00:14:59.976 true 00:14:59.976 19:13:18 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:14:59.976 19:13:18 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:00.233 19:13:18 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:00.233 19:13:18 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:00.233 19:13:18 -- target/nvmf_lvs_grow.sh@65 -- # wait 3426900 00:15:00.804 [2024-11-18T18:13:19.409Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.804 Nvme0n1 : 3.00 14955.00 58.42 0.00 0.00 0.00 0.00 0.00 00:15:00.804 [2024-11-18T18:13:19.409Z] =================================================================================================================== 00:15:00.804 [2024-11-18T18:13:19.410Z] Total : 14955.00 58.42 0.00 0.00 0.00 0.00 0.00 00:15:00.805 00:15:01.737 [2024-11-18T18:13:20.342Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.737 Nvme0n1 : 4.00 15047.25 58.78 0.00 0.00 0.00 0.00 0.00 00:15:01.737 [2024-11-18T18:13:20.342Z] =================================================================================================================== 00:15:01.737 [2024-11-18T18:13:20.342Z] Total : 15047.25 58.78 0.00 0.00 0.00 0.00 0.00 00:15:01.737 00:15:03.110 [2024-11-18T18:13:21.715Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.110 Nvme0n1 : 5.00 15124.20 59.08 0.00 0.00 0.00 0.00 0.00 00:15:03.110 [2024-11-18T18:13:21.715Z] =================================================================================================================== 00:15:03.110 [2024-11-18T18:13:21.715Z] Total : 15124.20 59.08 0.00 0.00 0.00 0.00 0.00 00:15:03.110 00:15:04.044 [2024-11-18T18:13:22.649Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.044 Nvme0n1 : 6.00 15186.83 59.32 0.00 0.00 0.00 0.00 0.00 00:15:04.044 [2024-11-18T18:13:22.649Z] =================================================================================================================== 00:15:04.044 [2024-11-18T18:13:22.649Z] Total : 15186.83 59.32 0.00 0.00 0.00 0.00 0.00 00:15:04.044 00:15:04.978 [2024-11-18T18:13:23.583Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.978 Nvme0n1 : 7.00 15259.00 59.61 0.00 0.00 0.00 0.00 0.00 00:15:04.978 [2024-11-18T18:13:23.583Z] =================================================================================================================== 00:15:04.978 [2024-11-18T18:13:23.583Z] Total : 15259.00 59.61 0.00 0.00 0.00 0.00 0.00 00:15:04.978 00:15:05.934 [2024-11-18T18:13:24.539Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.934 Nvme0n1 : 8.00 15337.50 59.91 0.00 0.00 0.00 0.00 0.00 00:15:05.934 [2024-11-18T18:13:24.539Z] =================================================================================================================== 00:15:05.934 [2024-11-18T18:13:24.539Z] Total : 15337.50 59.91 0.00 0.00 0.00 0.00 0.00 00:15:05.934 00:15:06.914 [2024-11-18T18:13:25.519Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.914 Nvme0n1 : 9.00 15356.89 59.99 0.00 0.00 0.00 0.00 0.00 00:15:06.914 [2024-11-18T18:13:25.519Z] =================================================================================================================== 00:15:06.914 [2024-11-18T18:13:25.519Z] Total : 15356.89 59.99 0.00 0.00 0.00 0.00 0.00 00:15:06.914 00:15:07.847 [2024-11-18T18:13:26.452Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.847 Nvme0n1 : 10.00 15379.90 60.08 0.00 0.00 0.00 0.00 0.00 00:15:07.847 [2024-11-18T18:13:26.452Z] =================================================================================================================== 00:15:07.847 [2024-11-18T18:13:26.452Z] Total : 15379.90 60.08 0.00 0.00 0.00 0.00 0.00 00:15:07.847 00:15:07.847 00:15:07.847 Latency(us) 00:15:07.847 [2024-11-18T18:13:26.452Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:07.847 [2024-11-18T18:13:26.452Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.847 Nvme0n1 : 10.01 15379.68 60.08 0.00 0.00 8318.20 2827.76 16505.36 00:15:07.847 [2024-11-18T18:13:26.452Z] =================================================================================================================== 00:15:07.847 [2024-11-18T18:13:26.452Z] Total : 15379.68 60.08 0.00 0.00 8318.20 2827.76 16505.36 00:15:07.847 0 00:15:07.847 19:13:26 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3426634 00:15:07.847 19:13:26 -- common/autotest_common.sh@936 -- # '[' -z 3426634 ']' 00:15:07.847 19:13:26 -- common/autotest_common.sh@940 -- # kill -0 3426634 00:15:07.847 19:13:26 -- common/autotest_common.sh@941 -- # uname 00:15:07.847 19:13:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:07.847 19:13:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3426634 00:15:07.847 19:13:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:07.847 19:13:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:07.847 19:13:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3426634' 00:15:07.847 killing process with pid 3426634 00:15:07.847 19:13:26 -- common/autotest_common.sh@955 -- # kill 3426634 00:15:07.847 Received shutdown signal, test time was about 10.000000 seconds 00:15:07.847 00:15:07.847 Latency(us) 00:15:07.847 [2024-11-18T18:13:26.452Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:07.847 [2024-11-18T18:13:26.452Z] =================================================================================================================== 00:15:07.847 [2024-11-18T18:13:26.452Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:07.847 19:13:26 -- common/autotest_common.sh@960 -- # wait 3426634 00:15:08.105 19:13:26 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:08.672 19:13:26 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:08.672 19:13:26 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:08.672 19:13:27 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:08.672 19:13:27 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:08.672 19:13:27 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3423928 00:15:08.672 19:13:27 -- target/nvmf_lvs_grow.sh@74 -- # wait 3423928 00:15:08.672 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3423928 Killed "${NVMF_APP[@]}" "$@" 00:15:08.672 19:13:27 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:08.672 19:13:27 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:08.672 19:13:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:08.672 19:13:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:08.672 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:15:08.930 19:13:27 -- nvmf/common.sh@469 -- # nvmfpid=3428271 00:15:08.930 19:13:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:08.930 19:13:27 -- nvmf/common.sh@470 -- # waitforlisten 3428271 00:15:08.930 19:13:27 -- common/autotest_common.sh@829 -- # '[' -z 3428271 ']' 00:15:08.930 19:13:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:08.930 19:13:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:08.930 19:13:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:08.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:08.930 19:13:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:08.930 19:13:27 -- common/autotest_common.sh@10 -- # set +x 00:15:08.930 [2024-11-18 19:13:27.319001] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:08.930 [2024-11-18 19:13:27.319098] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:08.930 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.930 [2024-11-18 19:13:27.383727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:08.930 [2024-11-18 19:13:27.492632] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:08.930 [2024-11-18 19:13:27.492814] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:08.930 [2024-11-18 19:13:27.492832] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:08.930 [2024-11-18 19:13:27.492844] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:08.930 [2024-11-18 19:13:27.492873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:09.864 19:13:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:09.864 19:13:28 -- common/autotest_common.sh@862 -- # return 0 00:15:09.864 19:13:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:09.864 19:13:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:09.864 19:13:28 -- common/autotest_common.sh@10 -- # set +x 00:15:09.864 19:13:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:09.864 19:13:28 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:10.122 [2024-11-18 19:13:28.598755] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:10.122 [2024-11-18 19:13:28.598896] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:10.122 [2024-11-18 19:13:28.598961] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:10.122 19:13:28 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:10.122 19:13:28 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev e5bede3e-1f99-4196-923f-4240958cb015 00:15:10.122 19:13:28 -- common/autotest_common.sh@897 -- # local bdev_name=e5bede3e-1f99-4196-923f-4240958cb015 00:15:10.122 19:13:28 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:10.122 19:13:28 -- common/autotest_common.sh@899 -- # local i 00:15:10.122 19:13:28 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:10.122 19:13:28 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:10.122 19:13:28 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:10.380 19:13:28 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b e5bede3e-1f99-4196-923f-4240958cb015 -t 2000 00:15:10.638 [ 00:15:10.638 { 00:15:10.638 "name": "e5bede3e-1f99-4196-923f-4240958cb015", 00:15:10.638 "aliases": [ 00:15:10.638 "lvs/lvol" 00:15:10.638 ], 00:15:10.638 "product_name": "Logical Volume", 00:15:10.638 "block_size": 4096, 00:15:10.638 "num_blocks": 38912, 00:15:10.638 "uuid": "e5bede3e-1f99-4196-923f-4240958cb015", 00:15:10.638 "assigned_rate_limits": { 00:15:10.638 "rw_ios_per_sec": 0, 00:15:10.638 "rw_mbytes_per_sec": 0, 00:15:10.638 "r_mbytes_per_sec": 0, 00:15:10.638 "w_mbytes_per_sec": 0 00:15:10.638 }, 00:15:10.638 "claimed": false, 00:15:10.638 "zoned": false, 00:15:10.638 "supported_io_types": { 00:15:10.638 "read": true, 00:15:10.638 "write": true, 00:15:10.638 "unmap": true, 00:15:10.638 "write_zeroes": true, 00:15:10.638 "flush": false, 00:15:10.638 "reset": true, 00:15:10.638 "compare": false, 00:15:10.638 "compare_and_write": false, 00:15:10.638 "abort": false, 00:15:10.638 "nvme_admin": false, 00:15:10.638 "nvme_io": false 00:15:10.638 }, 00:15:10.638 "driver_specific": { 00:15:10.638 "lvol": { 00:15:10.638 "lvol_store_uuid": "e04ccb01-e028-4f64-a6b5-f9571530b9ba", 00:15:10.638 "base_bdev": "aio_bdev", 00:15:10.638 "thin_provision": false, 00:15:10.638 "snapshot": false, 00:15:10.638 "clone": false, 00:15:10.638 "esnap_clone": false 00:15:10.638 } 00:15:10.638 } 00:15:10.638 } 00:15:10.638 ] 00:15:10.638 19:13:29 -- common/autotest_common.sh@905 -- # return 0 00:15:10.638 19:13:29 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:10.638 19:13:29 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:10.895 19:13:29 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:10.895 19:13:29 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:10.895 19:13:29 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:11.153 19:13:29 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:11.153 19:13:29 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:11.411 [2024-11-18 19:13:29.871785] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:11.411 19:13:29 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:11.411 19:13:29 -- common/autotest_common.sh@650 -- # local es=0 00:15:11.411 19:13:29 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:11.411 19:13:29 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.411 19:13:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:11.411 19:13:29 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.411 19:13:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:11.411 19:13:29 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.411 19:13:29 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:11.411 19:13:29 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:11.411 19:13:29 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:11.411 19:13:29 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:11.669 request: 00:15:11.669 { 00:15:11.669 "uuid": "e04ccb01-e028-4f64-a6b5-f9571530b9ba", 00:15:11.669 "method": "bdev_lvol_get_lvstores", 00:15:11.669 "req_id": 1 00:15:11.669 } 00:15:11.669 Got JSON-RPC error response 00:15:11.669 response: 00:15:11.669 { 00:15:11.669 "code": -19, 00:15:11.669 "message": "No such device" 00:15:11.669 } 00:15:11.669 19:13:30 -- common/autotest_common.sh@653 -- # es=1 00:15:11.669 19:13:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:11.669 19:13:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:11.669 19:13:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:11.669 19:13:30 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:11.927 aio_bdev 00:15:11.927 19:13:30 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev e5bede3e-1f99-4196-923f-4240958cb015 00:15:11.927 19:13:30 -- common/autotest_common.sh@897 -- # local bdev_name=e5bede3e-1f99-4196-923f-4240958cb015 00:15:11.927 19:13:30 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:11.927 19:13:30 -- common/autotest_common.sh@899 -- # local i 00:15:11.927 19:13:30 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:11.927 19:13:30 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:11.927 19:13:30 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:12.185 19:13:30 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b e5bede3e-1f99-4196-923f-4240958cb015 -t 2000 00:15:12.442 [ 00:15:12.443 { 00:15:12.443 "name": "e5bede3e-1f99-4196-923f-4240958cb015", 00:15:12.443 "aliases": [ 00:15:12.443 "lvs/lvol" 00:15:12.443 ], 00:15:12.443 "product_name": "Logical Volume", 00:15:12.443 "block_size": 4096, 00:15:12.443 "num_blocks": 38912, 00:15:12.443 "uuid": "e5bede3e-1f99-4196-923f-4240958cb015", 00:15:12.443 "assigned_rate_limits": { 00:15:12.443 "rw_ios_per_sec": 0, 00:15:12.443 "rw_mbytes_per_sec": 0, 00:15:12.443 "r_mbytes_per_sec": 0, 00:15:12.443 "w_mbytes_per_sec": 0 00:15:12.443 }, 00:15:12.443 "claimed": false, 00:15:12.443 "zoned": false, 00:15:12.443 "supported_io_types": { 00:15:12.443 "read": true, 00:15:12.443 "write": true, 00:15:12.443 "unmap": true, 00:15:12.443 "write_zeroes": true, 00:15:12.443 "flush": false, 00:15:12.443 "reset": true, 00:15:12.443 "compare": false, 00:15:12.443 "compare_and_write": false, 00:15:12.443 "abort": false, 00:15:12.443 "nvme_admin": false, 00:15:12.443 "nvme_io": false 00:15:12.443 }, 00:15:12.443 "driver_specific": { 00:15:12.443 "lvol": { 00:15:12.443 "lvol_store_uuid": "e04ccb01-e028-4f64-a6b5-f9571530b9ba", 00:15:12.443 "base_bdev": "aio_bdev", 00:15:12.443 "thin_provision": false, 00:15:12.443 "snapshot": false, 00:15:12.443 "clone": false, 00:15:12.443 "esnap_clone": false 00:15:12.443 } 00:15:12.443 } 00:15:12.443 } 00:15:12.443 ] 00:15:12.443 19:13:30 -- common/autotest_common.sh@905 -- # return 0 00:15:12.443 19:13:30 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:12.443 19:13:30 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:12.701 19:13:31 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:12.701 19:13:31 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:12.701 19:13:31 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:12.960 19:13:31 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:12.960 19:13:31 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e5bede3e-1f99-4196-923f-4240958cb015 00:15:13.218 19:13:31 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e04ccb01-e028-4f64-a6b5-f9571530b9ba 00:15:13.477 19:13:32 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:13.735 19:13:32 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:13.735 00:15:13.735 real 0m20.503s 00:15:13.735 user 0m51.624s 00:15:13.735 sys 0m4.671s 00:15:13.735 19:13:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:13.735 19:13:32 -- common/autotest_common.sh@10 -- # set +x 00:15:13.735 ************************************ 00:15:13.735 END TEST lvs_grow_dirty 00:15:13.735 ************************************ 00:15:13.735 19:13:32 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:13.735 19:13:32 -- common/autotest_common.sh@806 -- # type=--id 00:15:13.735 19:13:32 -- common/autotest_common.sh@807 -- # id=0 00:15:13.735 19:13:32 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:13.735 19:13:32 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:13.735 19:13:32 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:13.735 19:13:32 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:13.735 19:13:32 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:13.735 19:13:32 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:13.735 nvmf_trace.0 00:15:13.735 19:13:32 -- common/autotest_common.sh@821 -- # return 0 00:15:13.735 19:13:32 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:13.735 19:13:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:13.735 19:13:32 -- nvmf/common.sh@116 -- # sync 00:15:13.735 19:13:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:13.735 19:13:32 -- nvmf/common.sh@119 -- # set +e 00:15:13.735 19:13:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:13.735 19:13:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:13.735 rmmod nvme_tcp 00:15:13.993 rmmod nvme_fabrics 00:15:13.993 rmmod nvme_keyring 00:15:13.993 19:13:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:13.993 19:13:32 -- nvmf/common.sh@123 -- # set -e 00:15:13.993 19:13:32 -- nvmf/common.sh@124 -- # return 0 00:15:13.993 19:13:32 -- nvmf/common.sh@477 -- # '[' -n 3428271 ']' 00:15:13.993 19:13:32 -- nvmf/common.sh@478 -- # killprocess 3428271 00:15:13.993 19:13:32 -- common/autotest_common.sh@936 -- # '[' -z 3428271 ']' 00:15:13.993 19:13:32 -- common/autotest_common.sh@940 -- # kill -0 3428271 00:15:13.993 19:13:32 -- common/autotest_common.sh@941 -- # uname 00:15:13.993 19:13:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:13.993 19:13:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3428271 00:15:13.993 19:13:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:13.993 19:13:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:13.993 19:13:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3428271' 00:15:13.993 killing process with pid 3428271 00:15:13.993 19:13:32 -- common/autotest_common.sh@955 -- # kill 3428271 00:15:13.993 19:13:32 -- common/autotest_common.sh@960 -- # wait 3428271 00:15:14.252 19:13:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:14.252 19:13:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:14.252 19:13:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:14.252 19:13:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:14.252 19:13:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:14.252 19:13:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:14.252 19:13:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:14.252 19:13:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:16.155 19:13:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:16.155 00:15:16.155 real 0m44.720s 00:15:16.155 user 1m16.222s 00:15:16.155 sys 0m8.413s 00:15:16.155 19:13:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:16.155 19:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:16.155 ************************************ 00:15:16.155 END TEST nvmf_lvs_grow 00:15:16.155 ************************************ 00:15:16.155 19:13:34 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:16.155 19:13:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:16.155 19:13:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:16.155 19:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:16.155 ************************************ 00:15:16.155 START TEST nvmf_bdev_io_wait 00:15:16.155 ************************************ 00:15:16.155 19:13:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:16.414 * Looking for test storage... 00:15:16.414 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:16.414 19:13:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:16.414 19:13:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:16.414 19:13:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:16.414 19:13:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:16.414 19:13:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:16.414 19:13:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:16.414 19:13:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:16.414 19:13:34 -- scripts/common.sh@335 -- # IFS=.-: 00:15:16.414 19:13:34 -- scripts/common.sh@335 -- # read -ra ver1 00:15:16.414 19:13:34 -- scripts/common.sh@336 -- # IFS=.-: 00:15:16.414 19:13:34 -- scripts/common.sh@336 -- # read -ra ver2 00:15:16.414 19:13:34 -- scripts/common.sh@337 -- # local 'op=<' 00:15:16.414 19:13:34 -- scripts/common.sh@339 -- # ver1_l=2 00:15:16.414 19:13:34 -- scripts/common.sh@340 -- # ver2_l=1 00:15:16.414 19:13:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:16.414 19:13:34 -- scripts/common.sh@343 -- # case "$op" in 00:15:16.414 19:13:34 -- scripts/common.sh@344 -- # : 1 00:15:16.414 19:13:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:16.414 19:13:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:16.414 19:13:34 -- scripts/common.sh@364 -- # decimal 1 00:15:16.414 19:13:34 -- scripts/common.sh@352 -- # local d=1 00:15:16.414 19:13:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:16.414 19:13:34 -- scripts/common.sh@354 -- # echo 1 00:15:16.414 19:13:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:16.414 19:13:34 -- scripts/common.sh@365 -- # decimal 2 00:15:16.414 19:13:34 -- scripts/common.sh@352 -- # local d=2 00:15:16.414 19:13:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:16.414 19:13:34 -- scripts/common.sh@354 -- # echo 2 00:15:16.414 19:13:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:16.414 19:13:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:16.414 19:13:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:16.414 19:13:34 -- scripts/common.sh@367 -- # return 0 00:15:16.414 19:13:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:16.414 19:13:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:16.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.414 --rc genhtml_branch_coverage=1 00:15:16.414 --rc genhtml_function_coverage=1 00:15:16.414 --rc genhtml_legend=1 00:15:16.414 --rc geninfo_all_blocks=1 00:15:16.414 --rc geninfo_unexecuted_blocks=1 00:15:16.414 00:15:16.414 ' 00:15:16.414 19:13:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:16.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.414 --rc genhtml_branch_coverage=1 00:15:16.414 --rc genhtml_function_coverage=1 00:15:16.414 --rc genhtml_legend=1 00:15:16.414 --rc geninfo_all_blocks=1 00:15:16.414 --rc geninfo_unexecuted_blocks=1 00:15:16.414 00:15:16.414 ' 00:15:16.414 19:13:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:16.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.414 --rc genhtml_branch_coverage=1 00:15:16.414 --rc genhtml_function_coverage=1 00:15:16.414 --rc genhtml_legend=1 00:15:16.414 --rc geninfo_all_blocks=1 00:15:16.414 --rc geninfo_unexecuted_blocks=1 00:15:16.414 00:15:16.414 ' 00:15:16.414 19:13:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:16.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.414 --rc genhtml_branch_coverage=1 00:15:16.414 --rc genhtml_function_coverage=1 00:15:16.414 --rc genhtml_legend=1 00:15:16.414 --rc geninfo_all_blocks=1 00:15:16.414 --rc geninfo_unexecuted_blocks=1 00:15:16.414 00:15:16.414 ' 00:15:16.414 19:13:34 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:16.414 19:13:34 -- nvmf/common.sh@7 -- # uname -s 00:15:16.414 19:13:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:16.414 19:13:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:16.414 19:13:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:16.414 19:13:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:16.414 19:13:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:16.414 19:13:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:16.414 19:13:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:16.414 19:13:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:16.414 19:13:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:16.414 19:13:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:16.414 19:13:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:16.414 19:13:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:16.414 19:13:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:16.414 19:13:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:16.414 19:13:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:16.414 19:13:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:16.414 19:13:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:16.414 19:13:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:16.414 19:13:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:16.414 19:13:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.414 19:13:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.414 19:13:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.414 19:13:34 -- paths/export.sh@5 -- # export PATH 00:15:16.415 19:13:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.415 19:13:34 -- nvmf/common.sh@46 -- # : 0 00:15:16.415 19:13:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:16.415 19:13:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:16.415 19:13:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:16.415 19:13:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:16.415 19:13:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:16.415 19:13:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:16.415 19:13:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:16.415 19:13:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:16.415 19:13:34 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:16.415 19:13:34 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:16.415 19:13:34 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:16.415 19:13:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:16.415 19:13:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:16.415 19:13:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:16.415 19:13:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:16.415 19:13:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:16.415 19:13:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.415 19:13:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.415 19:13:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:16.415 19:13:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:16.415 19:13:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:16.415 19:13:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:16.415 19:13:34 -- common/autotest_common.sh@10 -- # set +x 00:15:18.946 19:13:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:18.946 19:13:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:18.946 19:13:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:18.946 19:13:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:18.946 19:13:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:18.946 19:13:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:18.946 19:13:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:18.946 19:13:36 -- nvmf/common.sh@294 -- # net_devs=() 00:15:18.946 19:13:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:18.946 19:13:36 -- nvmf/common.sh@295 -- # e810=() 00:15:18.946 19:13:36 -- nvmf/common.sh@295 -- # local -ga e810 00:15:18.946 19:13:36 -- nvmf/common.sh@296 -- # x722=() 00:15:18.946 19:13:36 -- nvmf/common.sh@296 -- # local -ga x722 00:15:18.946 19:13:36 -- nvmf/common.sh@297 -- # mlx=() 00:15:18.946 19:13:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:18.946 19:13:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:18.946 19:13:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:18.946 19:13:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:18.946 19:13:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:18.946 19:13:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:18.946 19:13:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:18.946 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:18.946 19:13:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:18.946 19:13:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:18.946 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:18.946 19:13:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:18.946 19:13:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:18.946 19:13:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.946 19:13:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:18.946 19:13:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.946 19:13:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:18.946 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:18.946 19:13:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.946 19:13:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:18.946 19:13:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.946 19:13:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:18.946 19:13:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.946 19:13:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:18.946 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:18.946 19:13:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.946 19:13:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:18.946 19:13:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:18.946 19:13:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:18.946 19:13:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:18.946 19:13:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:18.946 19:13:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:18.946 19:13:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:18.946 19:13:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:18.946 19:13:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:18.946 19:13:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:18.946 19:13:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:18.946 19:13:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:18.946 19:13:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:18.946 19:13:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:18.946 19:13:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:18.946 19:13:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:18.946 19:13:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:18.946 19:13:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:18.946 19:13:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:18.946 19:13:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:18.946 19:13:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:18.946 19:13:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:18.946 19:13:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:18.946 19:13:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:18.946 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:18.946 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:15:18.946 00:15:18.946 --- 10.0.0.2 ping statistics --- 00:15:18.946 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.946 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:15:18.946 19:13:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:18.946 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:18.946 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:15:18.946 00:15:18.946 --- 10.0.0.1 ping statistics --- 00:15:18.946 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.946 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:15:18.946 19:13:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:18.946 19:13:37 -- nvmf/common.sh@410 -- # return 0 00:15:18.946 19:13:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:18.946 19:13:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:18.946 19:13:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:18.946 19:13:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:18.946 19:13:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:18.946 19:13:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:18.946 19:13:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:18.946 19:13:37 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:18.946 19:13:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:18.946 19:13:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:18.946 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.946 19:13:37 -- nvmf/common.sh@469 -- # nvmfpid=3430837 00:15:18.947 19:13:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:18.947 19:13:37 -- nvmf/common.sh@470 -- # waitforlisten 3430837 00:15:18.947 19:13:37 -- common/autotest_common.sh@829 -- # '[' -z 3430837 ']' 00:15:18.947 19:13:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:18.947 19:13:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:18.947 19:13:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:18.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:18.947 19:13:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 [2024-11-18 19:13:37.145060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:18.947 [2024-11-18 19:13:37.145147] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:18.947 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.947 [2024-11-18 19:13:37.215208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:18.947 [2024-11-18 19:13:37.335246] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:18.947 [2024-11-18 19:13:37.335406] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:18.947 [2024-11-18 19:13:37.335426] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:18.947 [2024-11-18 19:13:37.335441] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:18.947 [2024-11-18 19:13:37.335525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:18.947 [2024-11-18 19:13:37.335592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:18.947 [2024-11-18 19:13:37.335664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:18.947 [2024-11-18 19:13:37.335670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:18.947 19:13:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:18.947 19:13:37 -- common/autotest_common.sh@862 -- # return 0 00:15:18.947 19:13:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:18.947 19:13:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 19:13:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 [2024-11-18 19:13:37.472644] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 Malloc0 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:18.947 19:13:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.947 19:13:37 -- common/autotest_common.sh@10 -- # set +x 00:15:18.947 [2024-11-18 19:13:37.536060] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:18.947 19:13:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3430982 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@30 -- # READ_PID=3430984 00:15:18.947 19:13:37 -- nvmf/common.sh@520 -- # config=() 00:15:18.947 19:13:37 -- nvmf/common.sh@520 -- # local subsystem config 00:15:18.947 19:13:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:18.947 19:13:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:18.947 { 00:15:18.947 "params": { 00:15:18.947 "name": "Nvme$subsystem", 00:15:18.947 "trtype": "$TEST_TRANSPORT", 00:15:18.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:18.947 "adrfam": "ipv4", 00:15:18.947 "trsvcid": "$NVMF_PORT", 00:15:18.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:18.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:18.947 "hdgst": ${hdgst:-false}, 00:15:18.947 "ddgst": ${ddgst:-false} 00:15:18.947 }, 00:15:18.947 "method": "bdev_nvme_attach_controller" 00:15:18.947 } 00:15:18.947 EOF 00:15:18.947 )") 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3430986 00:15:18.947 19:13:37 -- nvmf/common.sh@520 -- # config=() 00:15:18.947 19:13:37 -- nvmf/common.sh@520 -- # local subsystem config 00:15:18.947 19:13:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:18.947 19:13:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:18.947 { 00:15:18.947 "params": { 00:15:18.947 "name": "Nvme$subsystem", 00:15:18.947 "trtype": "$TEST_TRANSPORT", 00:15:18.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:18.947 "adrfam": "ipv4", 00:15:18.947 "trsvcid": "$NVMF_PORT", 00:15:18.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:18.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:18.947 "hdgst": ${hdgst:-false}, 00:15:18.947 "ddgst": ${ddgst:-false} 00:15:18.947 }, 00:15:18.947 "method": "bdev_nvme_attach_controller" 00:15:18.947 } 00:15:18.947 EOF 00:15:18.947 )") 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:18.947 19:13:37 -- nvmf/common.sh@542 -- # cat 00:15:18.947 19:13:37 -- nvmf/common.sh@520 -- # config=() 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3430989 00:15:18.947 19:13:37 -- nvmf/common.sh@520 -- # local subsystem config 00:15:18.947 19:13:37 -- target/bdev_io_wait.sh@35 -- # sync 00:15:18.947 19:13:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:18.947 19:13:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:18.947 { 00:15:18.947 "params": { 00:15:18.947 "name": "Nvme$subsystem", 00:15:18.947 "trtype": "$TEST_TRANSPORT", 00:15:18.947 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:18.947 "adrfam": "ipv4", 00:15:18.947 "trsvcid": "$NVMF_PORT", 00:15:18.947 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:18.947 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:18.947 "hdgst": ${hdgst:-false}, 00:15:18.947 "ddgst": ${ddgst:-false} 00:15:18.947 }, 00:15:18.948 "method": "bdev_nvme_attach_controller" 00:15:18.948 } 00:15:18.948 EOF 00:15:18.948 )") 00:15:18.948 19:13:37 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:18.948 19:13:37 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:18.948 19:13:37 -- nvmf/common.sh@542 -- # cat 00:15:18.948 19:13:37 -- nvmf/common.sh@520 -- # config=() 00:15:18.948 19:13:37 -- nvmf/common.sh@520 -- # local subsystem config 00:15:18.948 19:13:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:18.948 19:13:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:18.948 { 00:15:18.948 "params": { 00:15:18.948 "name": "Nvme$subsystem", 00:15:18.948 "trtype": "$TEST_TRANSPORT", 00:15:18.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:18.948 "adrfam": "ipv4", 00:15:18.948 "trsvcid": "$NVMF_PORT", 00:15:18.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:18.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:18.948 "hdgst": ${hdgst:-false}, 00:15:18.948 "ddgst": ${ddgst:-false} 00:15:18.948 }, 00:15:18.948 "method": "bdev_nvme_attach_controller" 00:15:18.948 } 00:15:18.948 EOF 00:15:18.948 )") 00:15:18.948 19:13:37 -- nvmf/common.sh@542 -- # cat 00:15:18.948 19:13:37 -- target/bdev_io_wait.sh@37 -- # wait 3430982 00:15:18.948 19:13:37 -- nvmf/common.sh@544 -- # jq . 00:15:18.948 19:13:37 -- nvmf/common.sh@542 -- # cat 00:15:18.948 19:13:37 -- nvmf/common.sh@544 -- # jq . 00:15:18.948 19:13:37 -- nvmf/common.sh@545 -- # IFS=, 00:15:18.948 19:13:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:18.948 "params": { 00:15:18.948 "name": "Nvme1", 00:15:18.948 "trtype": "tcp", 00:15:18.948 "traddr": "10.0.0.2", 00:15:18.948 "adrfam": "ipv4", 00:15:18.948 "trsvcid": "4420", 00:15:18.948 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:18.948 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:18.948 "hdgst": false, 00:15:18.948 "ddgst": false 00:15:18.948 }, 00:15:18.948 "method": "bdev_nvme_attach_controller" 00:15:18.948 }' 00:15:18.948 19:13:37 -- nvmf/common.sh@544 -- # jq . 00:15:18.948 19:13:37 -- nvmf/common.sh@545 -- # IFS=, 00:15:18.948 19:13:37 -- nvmf/common.sh@544 -- # jq . 00:15:18.948 19:13:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:18.948 "params": { 00:15:18.948 "name": "Nvme1", 00:15:18.948 "trtype": "tcp", 00:15:18.948 "traddr": "10.0.0.2", 00:15:18.948 "adrfam": "ipv4", 00:15:18.948 "trsvcid": "4420", 00:15:18.948 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:18.948 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:18.948 "hdgst": false, 00:15:18.948 "ddgst": false 00:15:18.948 }, 00:15:18.948 "method": "bdev_nvme_attach_controller" 00:15:18.948 }' 00:15:18.948 19:13:37 -- nvmf/common.sh@545 -- # IFS=, 00:15:19.205 19:13:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:19.205 "params": { 00:15:19.205 "name": "Nvme1", 00:15:19.205 "trtype": "tcp", 00:15:19.205 "traddr": "10.0.0.2", 00:15:19.205 "adrfam": "ipv4", 00:15:19.205 "trsvcid": "4420", 00:15:19.205 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:19.205 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:19.205 "hdgst": false, 00:15:19.205 "ddgst": false 00:15:19.205 }, 00:15:19.205 "method": "bdev_nvme_attach_controller" 00:15:19.205 }' 00:15:19.205 19:13:37 -- nvmf/common.sh@545 -- # IFS=, 00:15:19.205 19:13:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:19.205 "params": { 00:15:19.205 "name": "Nvme1", 00:15:19.205 "trtype": "tcp", 00:15:19.205 "traddr": "10.0.0.2", 00:15:19.205 "adrfam": "ipv4", 00:15:19.205 "trsvcid": "4420", 00:15:19.205 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:19.205 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:19.205 "hdgst": false, 00:15:19.205 "ddgst": false 00:15:19.205 }, 00:15:19.205 "method": "bdev_nvme_attach_controller" 00:15:19.205 }' 00:15:19.205 [2024-11-18 19:13:37.578094] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:19.205 [2024-11-18 19:13:37.578094] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:19.205 [2024-11-18 19:13:37.578094] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:19.205 [2024-11-18 19:13:37.578183] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-18 19:13:37.578184] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-18 19:13:37.578184] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:19.205 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:19.205 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:19.205 [2024-11-18 19:13:37.579866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:19.205 [2024-11-18 19:13:37.579937] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:19.205 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.205 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.205 [2024-11-18 19:13:37.750629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.464 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.464 [2024-11-18 19:13:37.846270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:19.464 [2024-11-18 19:13:37.848991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.464 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.464 [2024-11-18 19:13:37.944580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:19.464 [2024-11-18 19:13:37.949724] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.464 [2024-11-18 19:13:38.026035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:19.464 [2024-11-18 19:13:38.049345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:19.722 [2024-11-18 19:13:38.118166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:19.722 Running I/O for 1 seconds... 00:15:19.722 Running I/O for 1 seconds... 00:15:19.722 Running I/O for 1 seconds... 00:15:19.722 Running I/O for 1 seconds... 00:15:20.656 00:15:20.656 Latency(us) 00:15:20.656 [2024-11-18T18:13:39.261Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.656 [2024-11-18T18:13:39.261Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:20.656 Nvme1n1 : 1.02 6066.95 23.70 0.00 0.00 20859.87 9175.04 31263.10 00:15:20.656 [2024-11-18T18:13:39.261Z] =================================================================================================================== 00:15:20.656 [2024-11-18T18:13:39.261Z] Total : 6066.95 23.70 0.00 0.00 20859.87 9175.04 31263.10 00:15:20.656 00:15:20.656 Latency(us) 00:15:20.656 [2024-11-18T18:13:39.261Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.656 [2024-11-18T18:13:39.261Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:20.656 Nvme1n1 : 1.01 6061.43 23.68 0.00 0.00 21053.37 5752.60 39030.33 00:15:20.656 [2024-11-18T18:13:39.261Z] =================================================================================================================== 00:15:20.656 [2024-11-18T18:13:39.261Z] Total : 6061.43 23.68 0.00 0.00 21053.37 5752.60 39030.33 00:15:20.656 00:15:20.656 Latency(us) 00:15:20.656 [2024-11-18T18:13:39.261Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.656 [2024-11-18T18:13:39.261Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:20.656 Nvme1n1 : 1.00 195045.29 761.90 0.00 0.00 653.71 283.69 879.88 00:15:20.656 [2024-11-18T18:13:39.261Z] =================================================================================================================== 00:15:20.656 [2024-11-18T18:13:39.261Z] Total : 195045.29 761.90 0.00 0.00 653.71 283.69 879.88 00:15:20.913 00:15:20.913 Latency(us) 00:15:20.913 [2024-11-18T18:13:39.518Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:20.913 [2024-11-18T18:13:39.518Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:20.913 Nvme1n1 : 1.01 10510.71 41.06 0.00 0.00 12133.21 6213.78 24466.77 00:15:20.913 [2024-11-18T18:13:39.518Z] =================================================================================================================== 00:15:20.913 [2024-11-18T18:13:39.518Z] Total : 10510.71 41.06 0.00 0.00 12133.21 6213.78 24466.77 00:15:21.171 19:13:39 -- target/bdev_io_wait.sh@38 -- # wait 3430984 00:15:21.171 19:13:39 -- target/bdev_io_wait.sh@39 -- # wait 3430986 00:15:21.171 19:13:39 -- target/bdev_io_wait.sh@40 -- # wait 3430989 00:15:21.171 19:13:39 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:21.171 19:13:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.171 19:13:39 -- common/autotest_common.sh@10 -- # set +x 00:15:21.171 19:13:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.171 19:13:39 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:21.171 19:13:39 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:21.171 19:13:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:21.171 19:13:39 -- nvmf/common.sh@116 -- # sync 00:15:21.171 19:13:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:21.171 19:13:39 -- nvmf/common.sh@119 -- # set +e 00:15:21.171 19:13:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:21.171 19:13:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:21.171 rmmod nvme_tcp 00:15:21.171 rmmod nvme_fabrics 00:15:21.171 rmmod nvme_keyring 00:15:21.171 19:13:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:21.171 19:13:39 -- nvmf/common.sh@123 -- # set -e 00:15:21.171 19:13:39 -- nvmf/common.sh@124 -- # return 0 00:15:21.171 19:13:39 -- nvmf/common.sh@477 -- # '[' -n 3430837 ']' 00:15:21.171 19:13:39 -- nvmf/common.sh@478 -- # killprocess 3430837 00:15:21.171 19:13:39 -- common/autotest_common.sh@936 -- # '[' -z 3430837 ']' 00:15:21.171 19:13:39 -- common/autotest_common.sh@940 -- # kill -0 3430837 00:15:21.171 19:13:39 -- common/autotest_common.sh@941 -- # uname 00:15:21.171 19:13:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:21.171 19:13:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3430837 00:15:21.171 19:13:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:21.171 19:13:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:21.171 19:13:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3430837' 00:15:21.171 killing process with pid 3430837 00:15:21.171 19:13:39 -- common/autotest_common.sh@955 -- # kill 3430837 00:15:21.171 19:13:39 -- common/autotest_common.sh@960 -- # wait 3430837 00:15:21.430 19:13:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:21.430 19:13:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:21.430 19:13:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:21.430 19:13:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:21.430 19:13:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:21.430 19:13:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:21.430 19:13:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:21.430 19:13:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:23.974 19:13:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:23.974 00:15:23.974 real 0m7.251s 00:15:23.974 user 0m16.430s 00:15:23.974 sys 0m3.382s 00:15:23.974 19:13:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:23.974 19:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:23.974 ************************************ 00:15:23.974 END TEST nvmf_bdev_io_wait 00:15:23.974 ************************************ 00:15:23.974 19:13:42 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:23.974 19:13:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:23.974 19:13:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:23.974 19:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:23.974 ************************************ 00:15:23.974 START TEST nvmf_queue_depth 00:15:23.974 ************************************ 00:15:23.974 19:13:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:23.974 * Looking for test storage... 00:15:23.974 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:23.974 19:13:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:23.974 19:13:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:23.974 19:13:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:23.974 19:13:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:23.974 19:13:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:23.974 19:13:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:23.974 19:13:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:23.974 19:13:42 -- scripts/common.sh@335 -- # IFS=.-: 00:15:23.974 19:13:42 -- scripts/common.sh@335 -- # read -ra ver1 00:15:23.974 19:13:42 -- scripts/common.sh@336 -- # IFS=.-: 00:15:23.974 19:13:42 -- scripts/common.sh@336 -- # read -ra ver2 00:15:23.974 19:13:42 -- scripts/common.sh@337 -- # local 'op=<' 00:15:23.974 19:13:42 -- scripts/common.sh@339 -- # ver1_l=2 00:15:23.974 19:13:42 -- scripts/common.sh@340 -- # ver2_l=1 00:15:23.974 19:13:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:23.974 19:13:42 -- scripts/common.sh@343 -- # case "$op" in 00:15:23.974 19:13:42 -- scripts/common.sh@344 -- # : 1 00:15:23.974 19:13:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:23.974 19:13:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:23.974 19:13:42 -- scripts/common.sh@364 -- # decimal 1 00:15:23.974 19:13:42 -- scripts/common.sh@352 -- # local d=1 00:15:23.974 19:13:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:23.974 19:13:42 -- scripts/common.sh@354 -- # echo 1 00:15:23.974 19:13:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:23.974 19:13:42 -- scripts/common.sh@365 -- # decimal 2 00:15:23.974 19:13:42 -- scripts/common.sh@352 -- # local d=2 00:15:23.974 19:13:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:23.974 19:13:42 -- scripts/common.sh@354 -- # echo 2 00:15:23.974 19:13:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:23.974 19:13:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:23.974 19:13:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:23.974 19:13:42 -- scripts/common.sh@367 -- # return 0 00:15:23.974 19:13:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:23.974 19:13:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:23.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.974 --rc genhtml_branch_coverage=1 00:15:23.974 --rc genhtml_function_coverage=1 00:15:23.974 --rc genhtml_legend=1 00:15:23.974 --rc geninfo_all_blocks=1 00:15:23.974 --rc geninfo_unexecuted_blocks=1 00:15:23.974 00:15:23.974 ' 00:15:23.974 19:13:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:23.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.974 --rc genhtml_branch_coverage=1 00:15:23.974 --rc genhtml_function_coverage=1 00:15:23.974 --rc genhtml_legend=1 00:15:23.974 --rc geninfo_all_blocks=1 00:15:23.974 --rc geninfo_unexecuted_blocks=1 00:15:23.974 00:15:23.974 ' 00:15:23.974 19:13:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:23.974 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.974 --rc genhtml_branch_coverage=1 00:15:23.974 --rc genhtml_function_coverage=1 00:15:23.974 --rc genhtml_legend=1 00:15:23.974 --rc geninfo_all_blocks=1 00:15:23.974 --rc geninfo_unexecuted_blocks=1 00:15:23.974 00:15:23.975 ' 00:15:23.975 19:13:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:23.975 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:23.975 --rc genhtml_branch_coverage=1 00:15:23.975 --rc genhtml_function_coverage=1 00:15:23.975 --rc genhtml_legend=1 00:15:23.975 --rc geninfo_all_blocks=1 00:15:23.975 --rc geninfo_unexecuted_blocks=1 00:15:23.975 00:15:23.975 ' 00:15:23.975 19:13:42 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:23.975 19:13:42 -- nvmf/common.sh@7 -- # uname -s 00:15:23.975 19:13:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:23.975 19:13:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:23.975 19:13:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:23.975 19:13:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:23.975 19:13:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:23.975 19:13:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:23.975 19:13:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:23.975 19:13:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:23.975 19:13:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:23.975 19:13:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:23.975 19:13:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:23.975 19:13:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:23.975 19:13:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:23.975 19:13:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:23.975 19:13:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:23.975 19:13:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:23.975 19:13:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:23.975 19:13:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:23.975 19:13:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:23.975 19:13:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.975 19:13:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.975 19:13:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.975 19:13:42 -- paths/export.sh@5 -- # export PATH 00:15:23.975 19:13:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:23.975 19:13:42 -- nvmf/common.sh@46 -- # : 0 00:15:23.975 19:13:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:23.975 19:13:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:23.975 19:13:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:23.975 19:13:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:23.975 19:13:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:23.975 19:13:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:23.975 19:13:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:23.975 19:13:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:23.975 19:13:42 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:23.975 19:13:42 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:23.975 19:13:42 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:23.975 19:13:42 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:23.975 19:13:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:23.975 19:13:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:23.975 19:13:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:23.975 19:13:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:23.975 19:13:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:23.975 19:13:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:23.975 19:13:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:23.975 19:13:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:23.975 19:13:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:23.975 19:13:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:23.975 19:13:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:23.975 19:13:42 -- common/autotest_common.sh@10 -- # set +x 00:15:25.876 19:13:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:25.876 19:13:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:25.876 19:13:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:25.876 19:13:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:25.876 19:13:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:25.876 19:13:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:25.876 19:13:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:25.876 19:13:44 -- nvmf/common.sh@294 -- # net_devs=() 00:15:25.876 19:13:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:25.876 19:13:44 -- nvmf/common.sh@295 -- # e810=() 00:15:25.876 19:13:44 -- nvmf/common.sh@295 -- # local -ga e810 00:15:25.876 19:13:44 -- nvmf/common.sh@296 -- # x722=() 00:15:25.876 19:13:44 -- nvmf/common.sh@296 -- # local -ga x722 00:15:25.876 19:13:44 -- nvmf/common.sh@297 -- # mlx=() 00:15:25.876 19:13:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:25.876 19:13:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:25.876 19:13:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:25.876 19:13:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:25.876 19:13:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:25.876 19:13:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:25.876 19:13:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:25.876 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:25.876 19:13:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:25.876 19:13:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:25.876 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:25.876 19:13:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:25.876 19:13:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:25.876 19:13:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:25.876 19:13:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:25.876 19:13:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:25.876 19:13:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:25.876 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:25.876 19:13:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:25.876 19:13:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:25.876 19:13:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:25.876 19:13:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:25.876 19:13:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:25.876 19:13:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:25.876 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:25.876 19:13:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:25.876 19:13:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:25.876 19:13:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:25.876 19:13:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:25.876 19:13:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:25.876 19:13:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:25.877 19:13:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:25.877 19:13:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:25.877 19:13:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:25.877 19:13:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:25.877 19:13:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:25.877 19:13:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:25.877 19:13:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:25.877 19:13:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:25.877 19:13:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:25.877 19:13:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:25.877 19:13:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:25.877 19:13:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:25.877 19:13:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:25.877 19:13:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:25.877 19:13:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:25.877 19:13:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:25.877 19:13:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:25.877 19:13:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:25.877 19:13:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:25.877 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:25.877 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:15:25.877 00:15:25.877 --- 10.0.0.2 ping statistics --- 00:15:25.877 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.877 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:15:25.877 19:13:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:25.877 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:25.877 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:15:25.877 00:15:25.877 --- 10.0.0.1 ping statistics --- 00:15:25.877 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:25.877 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:15:25.877 19:13:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:25.877 19:13:44 -- nvmf/common.sh@410 -- # return 0 00:15:25.877 19:13:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:25.877 19:13:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:25.877 19:13:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:25.877 19:13:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:25.877 19:13:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:25.877 19:13:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:25.877 19:13:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:25.877 19:13:44 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:25.877 19:13:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:25.877 19:13:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:25.877 19:13:44 -- common/autotest_common.sh@10 -- # set +x 00:15:25.877 19:13:44 -- nvmf/common.sh@469 -- # nvmfpid=3433236 00:15:25.877 19:13:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:25.877 19:13:44 -- nvmf/common.sh@470 -- # waitforlisten 3433236 00:15:25.877 19:13:44 -- common/autotest_common.sh@829 -- # '[' -z 3433236 ']' 00:15:25.877 19:13:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:25.877 19:13:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:25.877 19:13:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:25.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:25.877 19:13:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:25.877 19:13:44 -- common/autotest_common.sh@10 -- # set +x 00:15:26.135 [2024-11-18 19:13:44.515843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:26.135 [2024-11-18 19:13:44.515918] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:26.135 EAL: No free 2048 kB hugepages reported on node 1 00:15:26.135 [2024-11-18 19:13:44.576230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:26.136 [2024-11-18 19:13:44.684006] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:26.136 [2024-11-18 19:13:44.684177] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:26.136 [2024-11-18 19:13:44.684194] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:26.136 [2024-11-18 19:13:44.684207] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:26.136 [2024-11-18 19:13:44.684238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:27.069 19:13:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:27.069 19:13:45 -- common/autotest_common.sh@862 -- # return 0 00:15:27.069 19:13:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:27.069 19:13:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 19:13:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:27.069 19:13:45 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:27.069 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 [2024-11-18 19:13:45.554851] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:27.069 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.069 19:13:45 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:27.069 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 Malloc0 00:15:27.069 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.069 19:13:45 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:27.069 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.069 19:13:45 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:27.069 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.069 19:13:45 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.069 19:13:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 [2024-11-18 19:13:45.620832] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.069 19:13:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.069 19:13:45 -- target/queue_depth.sh@30 -- # bdevperf_pid=3433392 00:15:27.069 19:13:45 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:27.069 19:13:45 -- target/queue_depth.sh@33 -- # waitforlisten 3433392 /var/tmp/bdevperf.sock 00:15:27.069 19:13:45 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:27.069 19:13:45 -- common/autotest_common.sh@829 -- # '[' -z 3433392 ']' 00:15:27.069 19:13:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:27.069 19:13:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:27.069 19:13:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:27.069 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:27.069 19:13:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:27.069 19:13:45 -- common/autotest_common.sh@10 -- # set +x 00:15:27.069 [2024-11-18 19:13:45.665388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.069 [2024-11-18 19:13:45.665459] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3433392 ] 00:15:27.327 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.328 [2024-11-18 19:13:45.722517] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:27.328 [2024-11-18 19:13:45.829007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:28.261 19:13:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:28.261 19:13:46 -- common/autotest_common.sh@862 -- # return 0 00:15:28.261 19:13:46 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:28.261 19:13:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.261 19:13:46 -- common/autotest_common.sh@10 -- # set +x 00:15:28.519 NVMe0n1 00:15:28.519 19:13:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.519 19:13:46 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:28.519 Running I/O for 10 seconds... 00:15:40.716 00:15:40.716 Latency(us) 00:15:40.716 [2024-11-18T18:13:59.321Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:40.716 [2024-11-18T18:13:59.321Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:40.716 Verification LBA range: start 0x0 length 0x4000 00:15:40.716 NVMe0n1 : 10.07 12503.61 48.84 0.00 0.00 81568.65 14757.74 61749.48 00:15:40.716 [2024-11-18T18:13:59.321Z] =================================================================================================================== 00:15:40.716 [2024-11-18T18:13:59.321Z] Total : 12503.61 48.84 0.00 0.00 81568.65 14757.74 61749.48 00:15:40.716 0 00:15:40.716 19:13:57 -- target/queue_depth.sh@39 -- # killprocess 3433392 00:15:40.716 19:13:57 -- common/autotest_common.sh@936 -- # '[' -z 3433392 ']' 00:15:40.716 19:13:57 -- common/autotest_common.sh@940 -- # kill -0 3433392 00:15:40.716 19:13:57 -- common/autotest_common.sh@941 -- # uname 00:15:40.716 19:13:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:40.716 19:13:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3433392 00:15:40.717 19:13:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:40.717 19:13:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:40.717 19:13:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3433392' 00:15:40.717 killing process with pid 3433392 00:15:40.717 19:13:57 -- common/autotest_common.sh@955 -- # kill 3433392 00:15:40.717 Received shutdown signal, test time was about 10.000000 seconds 00:15:40.717 00:15:40.717 Latency(us) 00:15:40.717 [2024-11-18T18:13:59.322Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:40.717 [2024-11-18T18:13:59.322Z] =================================================================================================================== 00:15:40.717 [2024-11-18T18:13:59.322Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:40.717 19:13:57 -- common/autotest_common.sh@960 -- # wait 3433392 00:15:40.717 19:13:57 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:40.717 19:13:57 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:40.717 19:13:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:40.717 19:13:57 -- nvmf/common.sh@116 -- # sync 00:15:40.717 19:13:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:40.717 19:13:57 -- nvmf/common.sh@119 -- # set +e 00:15:40.717 19:13:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:40.717 19:13:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:40.717 rmmod nvme_tcp 00:15:40.717 rmmod nvme_fabrics 00:15:40.717 rmmod nvme_keyring 00:15:40.717 19:13:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:40.717 19:13:57 -- nvmf/common.sh@123 -- # set -e 00:15:40.717 19:13:57 -- nvmf/common.sh@124 -- # return 0 00:15:40.717 19:13:57 -- nvmf/common.sh@477 -- # '[' -n 3433236 ']' 00:15:40.717 19:13:57 -- nvmf/common.sh@478 -- # killprocess 3433236 00:15:40.717 19:13:57 -- common/autotest_common.sh@936 -- # '[' -z 3433236 ']' 00:15:40.717 19:13:57 -- common/autotest_common.sh@940 -- # kill -0 3433236 00:15:40.717 19:13:57 -- common/autotest_common.sh@941 -- # uname 00:15:40.717 19:13:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:40.717 19:13:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3433236 00:15:40.717 19:13:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:40.717 19:13:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:40.717 19:13:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3433236' 00:15:40.717 killing process with pid 3433236 00:15:40.717 19:13:57 -- common/autotest_common.sh@955 -- # kill 3433236 00:15:40.717 19:13:57 -- common/autotest_common.sh@960 -- # wait 3433236 00:15:40.717 19:13:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:40.717 19:13:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:40.717 19:13:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:40.717 19:13:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:40.717 19:13:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:40.717 19:13:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:40.717 19:13:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:40.717 19:13:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:41.651 19:13:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:41.651 00:15:41.651 real 0m17.876s 00:15:41.651 user 0m25.576s 00:15:41.651 sys 0m3.185s 00:15:41.651 19:13:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:41.651 19:13:59 -- common/autotest_common.sh@10 -- # set +x 00:15:41.651 ************************************ 00:15:41.651 END TEST nvmf_queue_depth 00:15:41.651 ************************************ 00:15:41.651 19:13:59 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:41.652 19:13:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:41.652 19:13:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:41.652 19:13:59 -- common/autotest_common.sh@10 -- # set +x 00:15:41.652 ************************************ 00:15:41.652 START TEST nvmf_multipath 00:15:41.652 ************************************ 00:15:41.652 19:13:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:41.652 * Looking for test storage... 00:15:41.652 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:41.652 19:13:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:41.652 19:13:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:41.652 19:13:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:41.652 19:14:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:41.652 19:14:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:41.652 19:14:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:41.652 19:14:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:41.652 19:14:00 -- scripts/common.sh@335 -- # IFS=.-: 00:15:41.652 19:14:00 -- scripts/common.sh@335 -- # read -ra ver1 00:15:41.652 19:14:00 -- scripts/common.sh@336 -- # IFS=.-: 00:15:41.652 19:14:00 -- scripts/common.sh@336 -- # read -ra ver2 00:15:41.652 19:14:00 -- scripts/common.sh@337 -- # local 'op=<' 00:15:41.652 19:14:00 -- scripts/common.sh@339 -- # ver1_l=2 00:15:41.652 19:14:00 -- scripts/common.sh@340 -- # ver2_l=1 00:15:41.652 19:14:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:41.652 19:14:00 -- scripts/common.sh@343 -- # case "$op" in 00:15:41.652 19:14:00 -- scripts/common.sh@344 -- # : 1 00:15:41.652 19:14:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:41.652 19:14:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:41.652 19:14:00 -- scripts/common.sh@364 -- # decimal 1 00:15:41.652 19:14:00 -- scripts/common.sh@352 -- # local d=1 00:15:41.652 19:14:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:41.652 19:14:00 -- scripts/common.sh@354 -- # echo 1 00:15:41.652 19:14:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:41.652 19:14:00 -- scripts/common.sh@365 -- # decimal 2 00:15:41.652 19:14:00 -- scripts/common.sh@352 -- # local d=2 00:15:41.652 19:14:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:41.652 19:14:00 -- scripts/common.sh@354 -- # echo 2 00:15:41.652 19:14:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:41.652 19:14:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:41.652 19:14:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:41.652 19:14:00 -- scripts/common.sh@367 -- # return 0 00:15:41.652 19:14:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:41.652 19:14:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:41.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:41.652 --rc genhtml_branch_coverage=1 00:15:41.652 --rc genhtml_function_coverage=1 00:15:41.652 --rc genhtml_legend=1 00:15:41.652 --rc geninfo_all_blocks=1 00:15:41.652 --rc geninfo_unexecuted_blocks=1 00:15:41.652 00:15:41.652 ' 00:15:41.652 19:14:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:41.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:41.652 --rc genhtml_branch_coverage=1 00:15:41.652 --rc genhtml_function_coverage=1 00:15:41.652 --rc genhtml_legend=1 00:15:41.652 --rc geninfo_all_blocks=1 00:15:41.652 --rc geninfo_unexecuted_blocks=1 00:15:41.652 00:15:41.652 ' 00:15:41.652 19:14:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:41.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:41.652 --rc genhtml_branch_coverage=1 00:15:41.652 --rc genhtml_function_coverage=1 00:15:41.652 --rc genhtml_legend=1 00:15:41.652 --rc geninfo_all_blocks=1 00:15:41.652 --rc geninfo_unexecuted_blocks=1 00:15:41.652 00:15:41.652 ' 00:15:41.652 19:14:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:41.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:41.652 --rc genhtml_branch_coverage=1 00:15:41.652 --rc genhtml_function_coverage=1 00:15:41.652 --rc genhtml_legend=1 00:15:41.652 --rc geninfo_all_blocks=1 00:15:41.652 --rc geninfo_unexecuted_blocks=1 00:15:41.652 00:15:41.652 ' 00:15:41.652 19:14:00 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:41.652 19:14:00 -- nvmf/common.sh@7 -- # uname -s 00:15:41.652 19:14:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:41.652 19:14:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:41.652 19:14:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:41.652 19:14:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:41.652 19:14:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:41.652 19:14:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:41.652 19:14:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:41.652 19:14:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:41.652 19:14:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:41.652 19:14:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:41.652 19:14:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:41.652 19:14:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:41.652 19:14:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:41.652 19:14:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:41.652 19:14:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:41.652 19:14:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:41.652 19:14:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:41.652 19:14:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:41.652 19:14:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:41.652 19:14:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.652 19:14:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.652 19:14:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.652 19:14:00 -- paths/export.sh@5 -- # export PATH 00:15:41.652 19:14:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:41.652 19:14:00 -- nvmf/common.sh@46 -- # : 0 00:15:41.652 19:14:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:41.652 19:14:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:41.652 19:14:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:41.652 19:14:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:41.652 19:14:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:41.652 19:14:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:41.652 19:14:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:41.652 19:14:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:41.652 19:14:00 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:41.652 19:14:00 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:41.652 19:14:00 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:41.652 19:14:00 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:41.652 19:14:00 -- target/multipath.sh@43 -- # nvmftestinit 00:15:41.652 19:14:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:41.652 19:14:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:41.652 19:14:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:41.653 19:14:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:41.653 19:14:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:41.653 19:14:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:41.653 19:14:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:41.653 19:14:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:41.653 19:14:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:41.653 19:14:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:41.653 19:14:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:41.653 19:14:00 -- common/autotest_common.sh@10 -- # set +x 00:15:43.553 19:14:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:43.553 19:14:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:43.553 19:14:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:43.553 19:14:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:43.553 19:14:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:43.553 19:14:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:43.553 19:14:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:43.553 19:14:02 -- nvmf/common.sh@294 -- # net_devs=() 00:15:43.553 19:14:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:43.553 19:14:02 -- nvmf/common.sh@295 -- # e810=() 00:15:43.553 19:14:02 -- nvmf/common.sh@295 -- # local -ga e810 00:15:43.553 19:14:02 -- nvmf/common.sh@296 -- # x722=() 00:15:43.553 19:14:02 -- nvmf/common.sh@296 -- # local -ga x722 00:15:43.553 19:14:02 -- nvmf/common.sh@297 -- # mlx=() 00:15:43.553 19:14:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:43.553 19:14:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:43.553 19:14:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:43.553 19:14:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:43.553 19:14:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:43.553 19:14:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:43.553 19:14:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:43.553 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:43.553 19:14:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:43.553 19:14:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:43.553 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:43.553 19:14:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:43.553 19:14:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:43.553 19:14:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:43.553 19:14:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:43.553 19:14:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:43.553 19:14:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:43.553 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:43.553 19:14:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:43.553 19:14:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:43.553 19:14:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:43.553 19:14:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:43.553 19:14:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:43.553 19:14:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:43.553 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:43.553 19:14:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:43.553 19:14:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:43.553 19:14:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:43.553 19:14:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:43.553 19:14:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:43.553 19:14:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:43.553 19:14:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:43.553 19:14:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:43.553 19:14:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:43.553 19:14:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:43.553 19:14:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:43.553 19:14:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:43.553 19:14:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:43.553 19:14:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:43.553 19:14:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:43.553 19:14:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:43.553 19:14:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:43.553 19:14:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:43.812 19:14:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:43.812 19:14:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:43.812 19:14:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:43.812 19:14:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:43.812 19:14:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:43.812 19:14:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:43.812 19:14:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:43.812 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:43.812 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:15:43.812 00:15:43.812 --- 10.0.0.2 ping statistics --- 00:15:43.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.812 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:15:43.812 19:14:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:43.812 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:43.812 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:15:43.812 00:15:43.812 --- 10.0.0.1 ping statistics --- 00:15:43.812 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:43.812 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:15:43.812 19:14:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:43.812 19:14:02 -- nvmf/common.sh@410 -- # return 0 00:15:43.812 19:14:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:43.812 19:14:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:43.812 19:14:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:43.812 19:14:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:43.812 19:14:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:43.812 19:14:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:43.812 19:14:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:43.812 19:14:02 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:43.812 19:14:02 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:43.812 only one NIC for nvmf test 00:15:43.812 19:14:02 -- target/multipath.sh@47 -- # nvmftestfini 00:15:43.812 19:14:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:43.812 19:14:02 -- nvmf/common.sh@116 -- # sync 00:15:43.812 19:14:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:43.812 19:14:02 -- nvmf/common.sh@119 -- # set +e 00:15:43.812 19:14:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:43.812 19:14:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:43.812 rmmod nvme_tcp 00:15:43.812 rmmod nvme_fabrics 00:15:43.812 rmmod nvme_keyring 00:15:43.812 19:14:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:43.812 19:14:02 -- nvmf/common.sh@123 -- # set -e 00:15:43.812 19:14:02 -- nvmf/common.sh@124 -- # return 0 00:15:43.812 19:14:02 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:43.812 19:14:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:43.812 19:14:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:43.812 19:14:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:43.812 19:14:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:43.812 19:14:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:43.812 19:14:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:43.812 19:14:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:43.812 19:14:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:46.346 19:14:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:46.346 19:14:04 -- target/multipath.sh@48 -- # exit 0 00:15:46.346 19:14:04 -- target/multipath.sh@1 -- # nvmftestfini 00:15:46.346 19:14:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:46.346 19:14:04 -- nvmf/common.sh@116 -- # sync 00:15:46.346 19:14:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:46.346 19:14:04 -- nvmf/common.sh@119 -- # set +e 00:15:46.346 19:14:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:46.346 19:14:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:46.346 19:14:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:46.346 19:14:04 -- nvmf/common.sh@123 -- # set -e 00:15:46.346 19:14:04 -- nvmf/common.sh@124 -- # return 0 00:15:46.346 19:14:04 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:46.346 19:14:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:46.346 19:14:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:46.346 19:14:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:46.346 19:14:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:46.346 19:14:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:46.346 19:14:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:46.346 19:14:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:46.346 19:14:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:46.346 19:14:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:46.346 00:15:46.346 real 0m4.459s 00:15:46.346 user 0m0.918s 00:15:46.346 sys 0m1.528s 00:15:46.346 19:14:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:46.346 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:15:46.346 ************************************ 00:15:46.346 END TEST nvmf_multipath 00:15:46.346 ************************************ 00:15:46.346 19:14:04 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:46.346 19:14:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:46.346 19:14:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:46.346 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:15:46.346 ************************************ 00:15:46.346 START TEST nvmf_zcopy 00:15:46.346 ************************************ 00:15:46.346 19:14:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:46.346 * Looking for test storage... 00:15:46.346 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:46.346 19:14:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:46.346 19:14:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:46.346 19:14:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:46.346 19:14:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:46.346 19:14:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:46.346 19:14:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:46.346 19:14:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:46.346 19:14:04 -- scripts/common.sh@335 -- # IFS=.-: 00:15:46.346 19:14:04 -- scripts/common.sh@335 -- # read -ra ver1 00:15:46.346 19:14:04 -- scripts/common.sh@336 -- # IFS=.-: 00:15:46.346 19:14:04 -- scripts/common.sh@336 -- # read -ra ver2 00:15:46.346 19:14:04 -- scripts/common.sh@337 -- # local 'op=<' 00:15:46.346 19:14:04 -- scripts/common.sh@339 -- # ver1_l=2 00:15:46.346 19:14:04 -- scripts/common.sh@340 -- # ver2_l=1 00:15:46.346 19:14:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:46.346 19:14:04 -- scripts/common.sh@343 -- # case "$op" in 00:15:46.346 19:14:04 -- scripts/common.sh@344 -- # : 1 00:15:46.346 19:14:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:46.346 19:14:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:46.346 19:14:04 -- scripts/common.sh@364 -- # decimal 1 00:15:46.346 19:14:04 -- scripts/common.sh@352 -- # local d=1 00:15:46.346 19:14:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:46.346 19:14:04 -- scripts/common.sh@354 -- # echo 1 00:15:46.346 19:14:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:46.346 19:14:04 -- scripts/common.sh@365 -- # decimal 2 00:15:46.346 19:14:04 -- scripts/common.sh@352 -- # local d=2 00:15:46.346 19:14:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:46.346 19:14:04 -- scripts/common.sh@354 -- # echo 2 00:15:46.346 19:14:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:46.346 19:14:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:46.346 19:14:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:46.346 19:14:04 -- scripts/common.sh@367 -- # return 0 00:15:46.346 19:14:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:46.346 19:14:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:46.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:46.346 --rc genhtml_branch_coverage=1 00:15:46.346 --rc genhtml_function_coverage=1 00:15:46.346 --rc genhtml_legend=1 00:15:46.346 --rc geninfo_all_blocks=1 00:15:46.346 --rc geninfo_unexecuted_blocks=1 00:15:46.346 00:15:46.346 ' 00:15:46.346 19:14:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:46.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:46.346 --rc genhtml_branch_coverage=1 00:15:46.346 --rc genhtml_function_coverage=1 00:15:46.346 --rc genhtml_legend=1 00:15:46.346 --rc geninfo_all_blocks=1 00:15:46.346 --rc geninfo_unexecuted_blocks=1 00:15:46.346 00:15:46.346 ' 00:15:46.346 19:14:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:46.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:46.346 --rc genhtml_branch_coverage=1 00:15:46.346 --rc genhtml_function_coverage=1 00:15:46.346 --rc genhtml_legend=1 00:15:46.346 --rc geninfo_all_blocks=1 00:15:46.346 --rc geninfo_unexecuted_blocks=1 00:15:46.346 00:15:46.346 ' 00:15:46.346 19:14:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:46.346 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:46.346 --rc genhtml_branch_coverage=1 00:15:46.346 --rc genhtml_function_coverage=1 00:15:46.346 --rc genhtml_legend=1 00:15:46.346 --rc geninfo_all_blocks=1 00:15:46.346 --rc geninfo_unexecuted_blocks=1 00:15:46.346 00:15:46.346 ' 00:15:46.346 19:14:04 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:46.346 19:14:04 -- nvmf/common.sh@7 -- # uname -s 00:15:46.346 19:14:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:46.346 19:14:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:46.346 19:14:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:46.346 19:14:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:46.346 19:14:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:46.346 19:14:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:46.346 19:14:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:46.346 19:14:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:46.346 19:14:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:46.346 19:14:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:46.346 19:14:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:46.346 19:14:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:46.346 19:14:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:46.346 19:14:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:46.346 19:14:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:46.346 19:14:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:46.346 19:14:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:46.346 19:14:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:46.346 19:14:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:46.346 19:14:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:46.346 19:14:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:46.346 19:14:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:46.346 19:14:04 -- paths/export.sh@5 -- # export PATH 00:15:46.346 19:14:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:46.346 19:14:04 -- nvmf/common.sh@46 -- # : 0 00:15:46.346 19:14:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:46.346 19:14:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:46.346 19:14:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:46.347 19:14:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:46.347 19:14:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:46.347 19:14:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:46.347 19:14:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:46.347 19:14:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:46.347 19:14:04 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:46.347 19:14:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:46.347 19:14:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:46.347 19:14:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:46.347 19:14:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:46.347 19:14:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:46.347 19:14:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:46.347 19:14:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:46.347 19:14:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:46.347 19:14:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:46.347 19:14:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:46.347 19:14:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:46.347 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:15:48.248 19:14:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:48.248 19:14:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:48.248 19:14:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:48.248 19:14:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:48.248 19:14:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:48.248 19:14:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:48.248 19:14:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:48.248 19:14:06 -- nvmf/common.sh@294 -- # net_devs=() 00:15:48.248 19:14:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:48.248 19:14:06 -- nvmf/common.sh@295 -- # e810=() 00:15:48.248 19:14:06 -- nvmf/common.sh@295 -- # local -ga e810 00:15:48.248 19:14:06 -- nvmf/common.sh@296 -- # x722=() 00:15:48.249 19:14:06 -- nvmf/common.sh@296 -- # local -ga x722 00:15:48.249 19:14:06 -- nvmf/common.sh@297 -- # mlx=() 00:15:48.249 19:14:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:48.249 19:14:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:48.249 19:14:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:48.249 19:14:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:48.249 19:14:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:48.249 19:14:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:48.249 19:14:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:48.249 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:48.249 19:14:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:48.249 19:14:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:48.249 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:48.249 19:14:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:48.249 19:14:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:48.249 19:14:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:48.249 19:14:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:48.249 19:14:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:48.249 19:14:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:48.249 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:48.249 19:14:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:48.249 19:14:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:48.249 19:14:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:48.249 19:14:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:48.249 19:14:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:48.249 19:14:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:48.249 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:48.249 19:14:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:48.249 19:14:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:48.249 19:14:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:48.249 19:14:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:48.249 19:14:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:48.249 19:14:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:48.249 19:14:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:48.249 19:14:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:48.249 19:14:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:48.249 19:14:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:48.249 19:14:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:48.249 19:14:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:48.249 19:14:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:48.249 19:14:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:48.249 19:14:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:48.249 19:14:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:48.249 19:14:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:48.249 19:14:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:48.249 19:14:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:48.249 19:14:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:48.249 19:14:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:48.249 19:14:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:48.508 19:14:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:48.508 19:14:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:48.508 19:14:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:48.508 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:48.508 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.327 ms 00:15:48.508 00:15:48.508 --- 10.0.0.2 ping statistics --- 00:15:48.508 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:48.508 rtt min/avg/max/mdev = 0.327/0.327/0.327/0.000 ms 00:15:48.508 19:14:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:48.508 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:48.508 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:15:48.508 00:15:48.508 --- 10.0.0.1 ping statistics --- 00:15:48.508 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:48.508 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:15:48.508 19:14:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:48.508 19:14:06 -- nvmf/common.sh@410 -- # return 0 00:15:48.508 19:14:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:48.508 19:14:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:48.508 19:14:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:48.508 19:14:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:48.508 19:14:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:48.508 19:14:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:48.508 19:14:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:48.508 19:14:06 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:48.508 19:14:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:48.508 19:14:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:48.508 19:14:06 -- common/autotest_common.sh@10 -- # set +x 00:15:48.508 19:14:06 -- nvmf/common.sh@469 -- # nvmfpid=3438771 00:15:48.508 19:14:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:48.508 19:14:06 -- nvmf/common.sh@470 -- # waitforlisten 3438771 00:15:48.508 19:14:06 -- common/autotest_common.sh@829 -- # '[' -z 3438771 ']' 00:15:48.508 19:14:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:48.508 19:14:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:48.508 19:14:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:48.508 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:48.508 19:14:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:48.508 19:14:06 -- common/autotest_common.sh@10 -- # set +x 00:15:48.508 [2024-11-18 19:14:06.972385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:48.508 [2024-11-18 19:14:06.972468] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:48.508 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.508 [2024-11-18 19:14:07.040875] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:48.766 [2024-11-18 19:14:07.146447] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:48.766 [2024-11-18 19:14:07.146605] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:48.766 [2024-11-18 19:14:07.146634] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:48.767 [2024-11-18 19:14:07.146647] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:48.767 [2024-11-18 19:14:07.146690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:49.701 19:14:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:49.701 19:14:08 -- common/autotest_common.sh@862 -- # return 0 00:15:49.701 19:14:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:49.701 19:14:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 19:14:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:49.701 19:14:08 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:49.701 19:14:08 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:49.701 19:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 [2024-11-18 19:14:08.034803] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:49.701 19:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.701 19:14:08 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:49.701 19:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 19:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.701 19:14:08 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:49.701 19:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 [2024-11-18 19:14:08.050996] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:49.701 19:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.701 19:14:08 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:49.701 19:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 19:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.701 19:14:08 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:49.701 19:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 malloc0 00:15:49.701 19:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.701 19:14:08 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:49.701 19:14:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:49.701 19:14:08 -- common/autotest_common.sh@10 -- # set +x 00:15:49.701 19:14:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:49.701 19:14:08 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:49.701 19:14:08 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:49.701 19:14:08 -- nvmf/common.sh@520 -- # config=() 00:15:49.701 19:14:08 -- nvmf/common.sh@520 -- # local subsystem config 00:15:49.701 19:14:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:49.701 19:14:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:49.701 { 00:15:49.701 "params": { 00:15:49.701 "name": "Nvme$subsystem", 00:15:49.701 "trtype": "$TEST_TRANSPORT", 00:15:49.701 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:49.701 "adrfam": "ipv4", 00:15:49.701 "trsvcid": "$NVMF_PORT", 00:15:49.701 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:49.701 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:49.701 "hdgst": ${hdgst:-false}, 00:15:49.701 "ddgst": ${ddgst:-false} 00:15:49.701 }, 00:15:49.701 "method": "bdev_nvme_attach_controller" 00:15:49.701 } 00:15:49.701 EOF 00:15:49.701 )") 00:15:49.701 19:14:08 -- nvmf/common.sh@542 -- # cat 00:15:49.701 19:14:08 -- nvmf/common.sh@544 -- # jq . 00:15:49.701 19:14:08 -- nvmf/common.sh@545 -- # IFS=, 00:15:49.701 19:14:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:49.701 "params": { 00:15:49.701 "name": "Nvme1", 00:15:49.701 "trtype": "tcp", 00:15:49.701 "traddr": "10.0.0.2", 00:15:49.701 "adrfam": "ipv4", 00:15:49.701 "trsvcid": "4420", 00:15:49.701 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:49.701 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:49.701 "hdgst": false, 00:15:49.701 "ddgst": false 00:15:49.701 }, 00:15:49.701 "method": "bdev_nvme_attach_controller" 00:15:49.701 }' 00:15:49.701 [2024-11-18 19:14:08.129863] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:49.701 [2024-11-18 19:14:08.129945] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3438932 ] 00:15:49.701 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.701 [2024-11-18 19:14:08.198451] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:49.960 [2024-11-18 19:14:08.319786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:50.218 Running I/O for 10 seconds... 00:16:00.234 00:16:00.234 Latency(us) 00:16:00.234 [2024-11-18T18:14:18.839Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:00.234 [2024-11-18T18:14:18.839Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:00.234 Verification LBA range: start 0x0 length 0x1000 00:16:00.234 Nvme1n1 : 10.01 8672.38 67.75 0.00 0.00 14724.42 1128.68 24078.41 00:16:00.234 [2024-11-18T18:14:18.839Z] =================================================================================================================== 00:16:00.234 [2024-11-18T18:14:18.839Z] Total : 8672.38 67.75 0.00 0.00 14724.42 1128.68 24078.41 00:16:00.493 19:14:18 -- target/zcopy.sh@39 -- # perfpid=3440170 00:16:00.493 19:14:18 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:00.493 19:14:18 -- common/autotest_common.sh@10 -- # set +x 00:16:00.493 19:14:18 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:00.493 19:14:18 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:00.493 19:14:18 -- nvmf/common.sh@520 -- # config=() 00:16:00.493 19:14:18 -- nvmf/common.sh@520 -- # local subsystem config 00:16:00.493 19:14:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:00.493 19:14:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:00.493 { 00:16:00.493 "params": { 00:16:00.493 "name": "Nvme$subsystem", 00:16:00.493 "trtype": "$TEST_TRANSPORT", 00:16:00.493 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:00.493 "adrfam": "ipv4", 00:16:00.493 "trsvcid": "$NVMF_PORT", 00:16:00.493 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:00.493 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:00.493 "hdgst": ${hdgst:-false}, 00:16:00.493 "ddgst": ${ddgst:-false} 00:16:00.493 }, 00:16:00.493 "method": "bdev_nvme_attach_controller" 00:16:00.493 } 00:16:00.493 EOF 00:16:00.493 )") 00:16:00.493 19:14:18 -- nvmf/common.sh@542 -- # cat 00:16:00.493 [2024-11-18 19:14:18.970505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.493 [2024-11-18 19:14:18.970551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.493 19:14:18 -- nvmf/common.sh@544 -- # jq . 00:16:00.493 19:14:18 -- nvmf/common.sh@545 -- # IFS=, 00:16:00.493 19:14:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:00.493 "params": { 00:16:00.493 "name": "Nvme1", 00:16:00.493 "trtype": "tcp", 00:16:00.493 "traddr": "10.0.0.2", 00:16:00.493 "adrfam": "ipv4", 00:16:00.493 "trsvcid": "4420", 00:16:00.493 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:00.493 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:00.493 "hdgst": false, 00:16:00.493 "ddgst": false 00:16:00.493 }, 00:16:00.493 "method": "bdev_nvme_attach_controller" 00:16:00.493 }' 00:16:00.493 [2024-11-18 19:14:18.978473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.493 [2024-11-18 19:14:18.978500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.493 [2024-11-18 19:14:18.986495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:18.986520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:18.994519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:18.994543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.002540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.002565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.008215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:00.494 [2024-11-18 19:14:19.008285] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3440170 ] 00:16:00.494 [2024-11-18 19:14:19.010566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.010602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.018575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.018636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.026627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.026652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.034638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.034675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.494 [2024-11-18 19:14:19.042675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.042698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.050692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.050714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.058708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.058729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.066721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.066742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.071195] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:00.494 [2024-11-18 19:14:19.074746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.074768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.082795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.082832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.494 [2024-11-18 19:14:19.090787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.494 [2024-11-18 19:14:19.090808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.098809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.098830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.106828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.106848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.114850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.114870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.122888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.122913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.130909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.130934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.138960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.138998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.146959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.146985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.154975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.154999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.162998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.163022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.171019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.171044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.179045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.179070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.187064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.187090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.189098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:00.753 [2024-11-18 19:14:19.195095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.195119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.203114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.203141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.211161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.211197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.219183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.219232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.227205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.227241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.235234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.235270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.243243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.243291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.251268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.251305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.259276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.259300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.267313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.267349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.275338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.275376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.283335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.283359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.291356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.291380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.299379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.299402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.307421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.307451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.315433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.315470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.323456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.323482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.331480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.331508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.339504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.339531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.347523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.347549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:00.753 [2024-11-18 19:14:19.355544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:00.753 [2024-11-18 19:14:19.355568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.363569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.363593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.371590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.371622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.379620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.379644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.387649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.387677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.395665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.395689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.403689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.403713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.411710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.411733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.419737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.419761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.427762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.427788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.435785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.435811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.443803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.443827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.451827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.451852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.459852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.459876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.467876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.467900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.475899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.475924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.484801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.484831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.491956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.491984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 Running I/O for 5 seconds... 00:16:01.011 [2024-11-18 19:14:19.499976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.500001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.514195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.514226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.524832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.524863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.535715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.535746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.546633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.546664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.557567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.557597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.568058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.568088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.578536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.578566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.589685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.589715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.602288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.602318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.011 [2024-11-18 19:14:19.612747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.011 [2024-11-18 19:14:19.612777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.623509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.623539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.636895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.636926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.647291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.647322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.657690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.657720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.668747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.668777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.679175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.679205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.690254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.690284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.700999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.701029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.711652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.711682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.724456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.724486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.734407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.734437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.745309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.745338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.758056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.758086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.768002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.768032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.778636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.778667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.791853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.791883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.802209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.802239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.812834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.812865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.823457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.823487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.834367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.834397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.846919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.846949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.856444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.856474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.269 [2024-11-18 19:14:19.867839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.269 [2024-11-18 19:14:19.867869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.878563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.878594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.889468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.889499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.902017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.902049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.912188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.912218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.922917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.922947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.935722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.935752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.945930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.945959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.956967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.956997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.969732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.969762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.978782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.978812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:19.991858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:19.991889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.002265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.002295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.013088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.013122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.024095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.024127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.035065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.035099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.046500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.046534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.058000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.058031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.071072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.071103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.081939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.081980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.092850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.092880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.104318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.104348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.115483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.115513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.528 [2024-11-18 19:14:20.127050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.528 [2024-11-18 19:14:20.127080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.138125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.138155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.148844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.148874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.160367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.160397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.171190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.171220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.184065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.184095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.194372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.194403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.205713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.205744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.216387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.216418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.227673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.227703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.238887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.238916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.249574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.249604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.260442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.260471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.273344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.273375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.283563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.283594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.294421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.294461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.307252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.307282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.317715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.317748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.328554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.328585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.339148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.339178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.350147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.350177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.363453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.363485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.373784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.373815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.787 [2024-11-18 19:14:20.384459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.787 [2024-11-18 19:14:20.384489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.045 [2024-11-18 19:14:20.395052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.045 [2024-11-18 19:14:20.395082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.045 [2024-11-18 19:14:20.405632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.045 [2024-11-18 19:14:20.405662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.045 [2024-11-18 19:14:20.416428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.416458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.426941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.426971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.438237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.438267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.451305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.451335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.461985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.462014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.473253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.473283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.484180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.484209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.495213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.495243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.508554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.508591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.519480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.519510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.530843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.530873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.543861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.543891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.554293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.554323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.565451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.565482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.578245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.578275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.588993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.589022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.599820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.599850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.612963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.612992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.623468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.623498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.634342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.634372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.046 [2024-11-18 19:14:20.645891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.046 [2024-11-18 19:14:20.645921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.656677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.656708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.667604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.667645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.680313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.680343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.690568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.690599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.701191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.701221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.713868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.713898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.724498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.724541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.735100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.735130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.745996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.746026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.756971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.757001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.767443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.767473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.778166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.778195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.790931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.790962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.801194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.801224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.812204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.812233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.824585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.824624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.834351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.304 [2024-11-18 19:14:20.834381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.304 [2024-11-18 19:14:20.845892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.305 [2024-11-18 19:14:20.845921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.305 [2024-11-18 19:14:20.858905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.305 [2024-11-18 19:14:20.858935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.305 [2024-11-18 19:14:20.869578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.305 [2024-11-18 19:14:20.869617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.305 [2024-11-18 19:14:20.880765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.305 [2024-11-18 19:14:20.880794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.305 [2024-11-18 19:14:20.893527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.305 [2024-11-18 19:14:20.893557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.305 [2024-11-18 19:14:20.902663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.305 [2024-11-18 19:14:20.902693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.914549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.914578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.927408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.927438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.937409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.937438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.948811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.948841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.961594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.961634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.972074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.972103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.983225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.983255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:20.996016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:20.996045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.006420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.006450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.017369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.017398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.028019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.028048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.038773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.038803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.051634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.051665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.061903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.061934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.073518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.073548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.083963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.083993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.094650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.094680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.105688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.105719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.116769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.116799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.129677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.129708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.140208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.140239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.150942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.150973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.564 [2024-11-18 19:14:21.161515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.564 [2024-11-18 19:14:21.161547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.822 [2024-11-18 19:14:21.172183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.822 [2024-11-18 19:14:21.172213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.822 [2024-11-18 19:14:21.184759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.822 [2024-11-18 19:14:21.184789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.194975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.195005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.206479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.206509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.217238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.217268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.227969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.227999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.238949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.238979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.252119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.252149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.262466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.262495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.273290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.273320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.286272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.286302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.296701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.296731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.307305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.307335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.317971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.318001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.328500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.328530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.339341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.339372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.350312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.350342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.363330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.363361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.373777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.373807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.384867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.384897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.395929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.395958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.406771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.406803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.823 [2024-11-18 19:14:21.419630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.823 [2024-11-18 19:14:21.419661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.429965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.429996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.440531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.440562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.452969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.452999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.462569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.462599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.474393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.474423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.487414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.487445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.497993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.498023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.509303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.509333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.522194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.522224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.081 [2024-11-18 19:14:21.532524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.081 [2024-11-18 19:14:21.532554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.543682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.543715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.554551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.554581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.566051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.566081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.577243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.577272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.590292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.590323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.600502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.600532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.611483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.611513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.622725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.622755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.634030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.634059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.645090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.645119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.655791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.655820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.666371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.666401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.082 [2024-11-18 19:14:21.677181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.082 [2024-11-18 19:14:21.677211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.688080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.688109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.701154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.701184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.711671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.711701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.722499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.722529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.735189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.735219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.746767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.746797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.756058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.756088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.767969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.767998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.778828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.778868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.790051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.790081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.801255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.801286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.812431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.812461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.823209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.823240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.833727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.833757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.844356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.844386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.855027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.340 [2024-11-18 19:14:21.855056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.340 [2024-11-18 19:14:21.865760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.865789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.876726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.876756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.887681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.887712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.898239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.898269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.908707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.908738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.920161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.920191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.932856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.932886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.341 [2024-11-18 19:14:21.943107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.341 [2024-11-18 19:14:21.943137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:21.953999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:21.954029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:21.967107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:21.967139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:21.977363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:21.977392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:21.988521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:21.988560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.001494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.001524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.011474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.011505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.022166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.022197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.032636] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.032666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.043665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.043695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.056628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.056658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.066873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.066903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.077700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.077730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.088523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.088553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.099203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.099233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.109562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.109592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.120320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.120349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.132851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.132881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.142029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.142059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.153574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.153604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.164584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.164623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.599 [2024-11-18 19:14:22.175421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.599 [2024-11-18 19:14:22.175450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.600 [2024-11-18 19:14:22.188202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.600 [2024-11-18 19:14:22.188232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.600 [2024-11-18 19:14:22.198034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.600 [2024-11-18 19:14:22.198071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.208927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.208958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.219724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.219754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.230835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.230865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.243832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.243863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.254390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.254421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.265200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.265230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.276273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.276303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.287270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.287300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.298187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.298216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.309463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.309493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.321789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.321819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.331970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.332001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.342986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.343016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.355930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.355962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.366418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.366448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.377467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.377497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.388570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.388600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.399698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.399728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.412969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.413010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.423543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.423573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.434685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.434715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.447943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.447973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.858 [2024-11-18 19:14:22.457945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.858 [2024-11-18 19:14:22.457975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.468632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.468661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.479634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.479663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.490516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.490546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.503300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.503330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.513063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.513092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.524150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.524179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.536965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.536995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.547681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.547711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.558715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.558745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.569990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.570021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.581467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.581497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.592733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.592764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.605916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.605947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.616356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.616397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.627256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.627287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.640528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.640558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.650603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.650644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.661711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.661741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.674258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.674289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.684534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.684565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.695500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.695530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.707825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.707854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.117 [2024-11-18 19:14:22.717119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.117 [2024-11-18 19:14:22.717149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.375 [2024-11-18 19:14:22.728964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.375 [2024-11-18 19:14:22.728994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.375 [2024-11-18 19:14:22.739977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.375 [2024-11-18 19:14:22.740007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.375 [2024-11-18 19:14:22.751001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.375 [2024-11-18 19:14:22.751031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.375 [2024-11-18 19:14:22.762064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.762096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.774812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.774842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.784677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.784707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.795832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.795862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.809183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.809213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.819113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.819143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.829851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.829881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.842712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.842742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.853019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.853050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.863849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.863879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.876385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.876415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.886750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.886780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.897464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.897494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.910551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.910582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.919806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.919836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.931070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.931100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.941565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.941595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.952163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.952193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.965010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.965040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.376 [2024-11-18 19:14:22.975068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.376 [2024-11-18 19:14:22.975098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:22.986046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:22.986076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:22.997179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:22.997209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.007337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.007367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.017893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.017923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.028429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.028459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.039193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.039224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.050213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.050243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.061044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.061074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.073641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.073671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.083585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.083623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.094655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.094685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.105648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.105680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.116343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.116373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.128970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.129001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.139009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.139039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.149925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.149956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.160961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.160990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.634 [2024-11-18 19:14:23.171992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.634 [2024-11-18 19:14:23.172022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.635 [2024-11-18 19:14:23.184519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.635 [2024-11-18 19:14:23.184549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.635 [2024-11-18 19:14:23.193956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.635 [2024-11-18 19:14:23.193986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.635 [2024-11-18 19:14:23.205393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.635 [2024-11-18 19:14:23.205423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.635 [2024-11-18 19:14:23.218990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.635 [2024-11-18 19:14:23.219020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.635 [2024-11-18 19:14:23.229689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.635 [2024-11-18 19:14:23.229718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.240677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.240707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.253544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.253575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.263199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.263230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.274902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.274933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.286089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.286119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.296842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.296871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.308049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.308079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.320433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.320462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.330490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.330520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.341288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.341318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.351857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.351887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.362795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.362826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.373270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.373300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.384465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.384496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.397058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.397089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.407213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.407243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.418414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.418444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.431499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.431529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.441942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.441973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.453204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.453234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.464280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.464319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.475373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.475403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.893 [2024-11-18 19:14:23.486842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.893 [2024-11-18 19:14:23.486871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.497756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.497786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.510174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.510204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.520508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.520537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.531039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.531069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.541845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.541875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.553411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.553441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.563995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.564025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.574737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.574767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.587390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.587420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.597429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.597459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.608330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.608359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.619831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.619862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.630568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.630598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.641255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.641285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.651876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.651906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.662996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.663026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.675972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.676010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.686590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.686627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.697174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.697204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.707691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.707722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.718675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.718706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.729664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.729695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.740990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.741020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.152 [2024-11-18 19:14:23.751972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.152 [2024-11-18 19:14:23.752003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.762885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.762926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.774125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.774154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.785206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.785235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.796041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.796071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.806918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.806949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.817893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.817923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.829234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.829263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.840124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.840154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.851182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.851212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.863946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.863976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.874682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.874713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.885529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.885576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.898277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.898307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.908512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.908542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.919462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.919492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.931710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.931740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.941560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.941590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.952588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.952627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.963452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.963482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.974518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.974548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.987631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.987661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.411 [2024-11-18 19:14:23.998026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.411 [2024-11-18 19:14:23.998057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.412 [2024-11-18 19:14:24.008907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.412 [2024-11-18 19:14:24.008937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.021754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.021784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.032065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.032094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.043332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.043362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.056163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.056194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.066355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.066385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.077221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.077251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.090402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.090433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.100499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.100540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.111481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.111511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.123969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.123999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.133876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.133906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.145455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.145485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.158465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.158495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.168722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.168753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.179627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.179657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.193228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.193258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.203683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.203713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.214884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.214914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.227547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.227576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.237502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.237531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.249448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.249477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.260113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.260143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.670 [2024-11-18 19:14:24.270922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.670 [2024-11-18 19:14:24.270953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.281623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.281655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.292572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.292601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.305286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.305316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.315781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.315821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.326189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.326219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.336882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.336912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.350051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.350082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.360569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.360598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.371375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.371404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.382334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.382364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.393389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.393419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.404669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.404699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.416237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.416267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.427120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.427150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.437752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.437782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.448691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.448720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.461788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.461818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.472429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.472459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.483301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.483330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.495914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.495944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.505762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.505792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.516724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.516754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 00:16:05.929 Latency(us) 00:16:05.929 [2024-11-18T18:14:24.534Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:05.929 [2024-11-18T18:14:24.534Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:05.929 Nvme1n1 : 5.01 11656.35 91.07 0.00 0.00 10966.04 4757.43 21262.79 00:16:05.929 [2024-11-18T18:14:24.534Z] =================================================================================================================== 00:16:05.929 [2024-11-18T18:14:24.534Z] Total : 11656.35 91.07 0.00 0.00 10966.04 4757.43 21262.79 00:16:05.929 [2024-11-18 19:14:24.524188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.524217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.929 [2024-11-18 19:14:24.532210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.929 [2024-11-18 19:14:24.532238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.540229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.540256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.548272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.548309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.556323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.556370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.564336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.564381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.572353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.572412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.580376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.580420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.588411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.588458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.596431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.596476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.604449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.604494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.612479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.612527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.620501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.620550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.628530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.628578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.636543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.636588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.644567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.644628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.652585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.652643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.660616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.660671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.668602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.668643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.676616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.676640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.684637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.684661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.692662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.692686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.700680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.700704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.708738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.708778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.716762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.716806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.724791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.724836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.732768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.732792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.740792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.740817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.748815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.748839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.756834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.756858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.764859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.188 [2024-11-18 19:14:24.764885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.188 [2024-11-18 19:14:24.772927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.189 [2024-11-18 19:14:24.772973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.189 [2024-11-18 19:14:24.780945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.189 [2024-11-18 19:14:24.780991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.189 [2024-11-18 19:14:24.788930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.189 [2024-11-18 19:14:24.788955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.447 [2024-11-18 19:14:24.796947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.447 [2024-11-18 19:14:24.796972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.447 [2024-11-18 19:14:24.804969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.447 [2024-11-18 19:14:24.804993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.447 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3440170) - No such process 00:16:06.447 19:14:24 -- target/zcopy.sh@49 -- # wait 3440170 00:16:06.447 19:14:24 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:06.447 19:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.447 19:14:24 -- common/autotest_common.sh@10 -- # set +x 00:16:06.447 19:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.447 19:14:24 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:06.447 19:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.447 19:14:24 -- common/autotest_common.sh@10 -- # set +x 00:16:06.447 delay0 00:16:06.447 19:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.447 19:14:24 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:06.447 19:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:06.447 19:14:24 -- common/autotest_common.sh@10 -- # set +x 00:16:06.447 19:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:06.447 19:14:24 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:06.447 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.447 [2024-11-18 19:14:24.885284] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:14.560 [2024-11-18 19:14:31.965012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10512d0 is same with the state(5) to be set 00:16:14.560 [2024-11-18 19:14:31.965062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10512d0 is same with the state(5) to be set 00:16:14.560 Initializing NVMe Controllers 00:16:14.560 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:14.560 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:14.560 Initialization complete. Launching workers. 00:16:14.560 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 236, failed: 21007 00:16:14.560 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 21125, failed to submit 118 00:16:14.560 success 21049, unsuccess 76, failed 0 00:16:14.560 19:14:31 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:14.560 19:14:31 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:14.560 19:14:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:14.560 19:14:31 -- nvmf/common.sh@116 -- # sync 00:16:14.560 19:14:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:14.560 19:14:31 -- nvmf/common.sh@119 -- # set +e 00:16:14.560 19:14:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:14.560 19:14:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:14.560 rmmod nvme_tcp 00:16:14.560 rmmod nvme_fabrics 00:16:14.560 rmmod nvme_keyring 00:16:14.560 19:14:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:14.560 19:14:32 -- nvmf/common.sh@123 -- # set -e 00:16:14.560 19:14:32 -- nvmf/common.sh@124 -- # return 0 00:16:14.560 19:14:32 -- nvmf/common.sh@477 -- # '[' -n 3438771 ']' 00:16:14.560 19:14:32 -- nvmf/common.sh@478 -- # killprocess 3438771 00:16:14.560 19:14:32 -- common/autotest_common.sh@936 -- # '[' -z 3438771 ']' 00:16:14.560 19:14:32 -- common/autotest_common.sh@940 -- # kill -0 3438771 00:16:14.560 19:14:32 -- common/autotest_common.sh@941 -- # uname 00:16:14.560 19:14:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:14.560 19:14:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3438771 00:16:14.560 19:14:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:14.560 19:14:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:14.560 19:14:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3438771' 00:16:14.560 killing process with pid 3438771 00:16:14.560 19:14:32 -- common/autotest_common.sh@955 -- # kill 3438771 00:16:14.560 19:14:32 -- common/autotest_common.sh@960 -- # wait 3438771 00:16:14.560 19:14:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:14.560 19:14:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:14.560 19:14:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:14.560 19:14:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:14.560 19:14:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:14.560 19:14:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:14.560 19:14:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:14.560 19:14:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:15.937 19:14:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:15.937 00:16:15.937 real 0m30.010s 00:16:15.937 user 0m43.580s 00:16:15.937 sys 0m9.291s 00:16:15.937 19:14:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:15.937 19:14:34 -- common/autotest_common.sh@10 -- # set +x 00:16:15.937 ************************************ 00:16:15.937 END TEST nvmf_zcopy 00:16:15.937 ************************************ 00:16:15.937 19:14:34 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:15.937 19:14:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:15.937 19:14:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:15.937 19:14:34 -- common/autotest_common.sh@10 -- # set +x 00:16:15.937 ************************************ 00:16:15.937 START TEST nvmf_nmic 00:16:15.937 ************************************ 00:16:15.937 19:14:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:15.937 * Looking for test storage... 00:16:15.937 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:15.937 19:14:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:15.937 19:14:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:15.937 19:14:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:16.196 19:14:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:16.196 19:14:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:16.196 19:14:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:16.196 19:14:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:16.196 19:14:34 -- scripts/common.sh@335 -- # IFS=.-: 00:16:16.196 19:14:34 -- scripts/common.sh@335 -- # read -ra ver1 00:16:16.196 19:14:34 -- scripts/common.sh@336 -- # IFS=.-: 00:16:16.196 19:14:34 -- scripts/common.sh@336 -- # read -ra ver2 00:16:16.196 19:14:34 -- scripts/common.sh@337 -- # local 'op=<' 00:16:16.196 19:14:34 -- scripts/common.sh@339 -- # ver1_l=2 00:16:16.196 19:14:34 -- scripts/common.sh@340 -- # ver2_l=1 00:16:16.196 19:14:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:16.196 19:14:34 -- scripts/common.sh@343 -- # case "$op" in 00:16:16.196 19:14:34 -- scripts/common.sh@344 -- # : 1 00:16:16.196 19:14:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:16.196 19:14:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:16.197 19:14:34 -- scripts/common.sh@364 -- # decimal 1 00:16:16.197 19:14:34 -- scripts/common.sh@352 -- # local d=1 00:16:16.197 19:14:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:16.197 19:14:34 -- scripts/common.sh@354 -- # echo 1 00:16:16.197 19:14:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:16.197 19:14:34 -- scripts/common.sh@365 -- # decimal 2 00:16:16.197 19:14:34 -- scripts/common.sh@352 -- # local d=2 00:16:16.197 19:14:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:16.197 19:14:34 -- scripts/common.sh@354 -- # echo 2 00:16:16.197 19:14:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:16.197 19:14:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:16.197 19:14:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:16.197 19:14:34 -- scripts/common.sh@367 -- # return 0 00:16:16.197 19:14:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:16.197 19:14:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:16.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.197 --rc genhtml_branch_coverage=1 00:16:16.197 --rc genhtml_function_coverage=1 00:16:16.197 --rc genhtml_legend=1 00:16:16.197 --rc geninfo_all_blocks=1 00:16:16.197 --rc geninfo_unexecuted_blocks=1 00:16:16.197 00:16:16.197 ' 00:16:16.197 19:14:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:16.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.197 --rc genhtml_branch_coverage=1 00:16:16.197 --rc genhtml_function_coverage=1 00:16:16.197 --rc genhtml_legend=1 00:16:16.197 --rc geninfo_all_blocks=1 00:16:16.197 --rc geninfo_unexecuted_blocks=1 00:16:16.197 00:16:16.197 ' 00:16:16.197 19:14:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:16.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.197 --rc genhtml_branch_coverage=1 00:16:16.197 --rc genhtml_function_coverage=1 00:16:16.197 --rc genhtml_legend=1 00:16:16.197 --rc geninfo_all_blocks=1 00:16:16.197 --rc geninfo_unexecuted_blocks=1 00:16:16.197 00:16:16.197 ' 00:16:16.197 19:14:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:16.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.197 --rc genhtml_branch_coverage=1 00:16:16.197 --rc genhtml_function_coverage=1 00:16:16.197 --rc genhtml_legend=1 00:16:16.197 --rc geninfo_all_blocks=1 00:16:16.197 --rc geninfo_unexecuted_blocks=1 00:16:16.197 00:16:16.197 ' 00:16:16.197 19:14:34 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:16.197 19:14:34 -- nvmf/common.sh@7 -- # uname -s 00:16:16.197 19:14:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:16.197 19:14:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:16.197 19:14:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:16.197 19:14:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:16.197 19:14:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:16.197 19:14:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:16.197 19:14:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:16.197 19:14:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:16.197 19:14:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:16.197 19:14:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:16.197 19:14:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:16.197 19:14:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:16.197 19:14:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:16.197 19:14:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:16.197 19:14:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:16.197 19:14:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:16.197 19:14:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:16.197 19:14:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:16.197 19:14:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:16.197 19:14:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.197 19:14:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.197 19:14:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.197 19:14:34 -- paths/export.sh@5 -- # export PATH 00:16:16.197 19:14:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.197 19:14:34 -- nvmf/common.sh@46 -- # : 0 00:16:16.197 19:14:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:16.197 19:14:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:16.197 19:14:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:16.197 19:14:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:16.197 19:14:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:16.197 19:14:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:16.197 19:14:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:16.197 19:14:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:16.197 19:14:34 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:16.197 19:14:34 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:16.197 19:14:34 -- target/nmic.sh@14 -- # nvmftestinit 00:16:16.197 19:14:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:16.197 19:14:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:16.197 19:14:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:16.197 19:14:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:16.197 19:14:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:16.197 19:14:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:16.197 19:14:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:16.197 19:14:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:16.197 19:14:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:16.197 19:14:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:16.197 19:14:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:16.197 19:14:34 -- common/autotest_common.sh@10 -- # set +x 00:16:18.097 19:14:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:18.097 19:14:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:18.097 19:14:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:18.097 19:14:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:18.097 19:14:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:18.097 19:14:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:18.097 19:14:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:18.097 19:14:36 -- nvmf/common.sh@294 -- # net_devs=() 00:16:18.097 19:14:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:18.097 19:14:36 -- nvmf/common.sh@295 -- # e810=() 00:16:18.097 19:14:36 -- nvmf/common.sh@295 -- # local -ga e810 00:16:18.097 19:14:36 -- nvmf/common.sh@296 -- # x722=() 00:16:18.097 19:14:36 -- nvmf/common.sh@296 -- # local -ga x722 00:16:18.097 19:14:36 -- nvmf/common.sh@297 -- # mlx=() 00:16:18.097 19:14:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:18.097 19:14:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:18.097 19:14:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:18.097 19:14:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:18.097 19:14:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:18.097 19:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:18.097 19:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:18.097 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:18.097 19:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:18.097 19:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:18.097 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:18.097 19:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:18.097 19:14:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:18.097 19:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:18.097 19:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:18.097 19:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:18.097 19:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:18.097 19:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:18.097 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:18.097 19:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:18.097 19:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:18.098 19:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:18.098 19:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:18.098 19:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:18.098 19:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:18.098 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:18.098 19:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:18.098 19:14:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:18.098 19:14:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:18.098 19:14:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:18.098 19:14:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:18.098 19:14:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:18.098 19:14:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:18.098 19:14:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:18.098 19:14:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:18.098 19:14:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:18.098 19:14:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:18.098 19:14:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:18.098 19:14:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:18.098 19:14:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:18.098 19:14:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:18.098 19:14:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:18.098 19:14:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:18.098 19:14:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:18.098 19:14:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:18.356 19:14:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:18.356 19:14:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:18.356 19:14:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:18.356 19:14:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:18.356 19:14:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:18.356 19:14:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:18.356 19:14:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:18.356 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:18.356 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.383 ms 00:16:18.356 00:16:18.356 --- 10.0.0.2 ping statistics --- 00:16:18.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:18.356 rtt min/avg/max/mdev = 0.383/0.383/0.383/0.000 ms 00:16:18.356 19:14:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:18.356 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:18.356 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:16:18.356 00:16:18.356 --- 10.0.0.1 ping statistics --- 00:16:18.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:18.356 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:16:18.356 19:14:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:18.356 19:14:36 -- nvmf/common.sh@410 -- # return 0 00:16:18.356 19:14:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:18.356 19:14:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:18.356 19:14:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:18.356 19:14:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:18.356 19:14:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:18.356 19:14:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:18.356 19:14:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:18.356 19:14:36 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:18.356 19:14:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:18.356 19:14:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:18.356 19:14:36 -- common/autotest_common.sh@10 -- # set +x 00:16:18.356 19:14:36 -- nvmf/common.sh@469 -- # nvmfpid=3443742 00:16:18.356 19:14:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:18.356 19:14:36 -- nvmf/common.sh@470 -- # waitforlisten 3443742 00:16:18.356 19:14:36 -- common/autotest_common.sh@829 -- # '[' -z 3443742 ']' 00:16:18.356 19:14:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:18.356 19:14:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:18.356 19:14:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:18.356 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:18.356 19:14:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:18.356 19:14:36 -- common/autotest_common.sh@10 -- # set +x 00:16:18.356 [2024-11-18 19:14:36.857415] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:18.356 [2024-11-18 19:14:36.857485] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:18.356 EAL: No free 2048 kB hugepages reported on node 1 00:16:18.356 [2024-11-18 19:14:36.924507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:18.615 [2024-11-18 19:14:37.045901] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:18.615 [2024-11-18 19:14:37.046071] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:18.615 [2024-11-18 19:14:37.046091] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:18.615 [2024-11-18 19:14:37.046105] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:18.615 [2024-11-18 19:14:37.046166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:18.615 [2024-11-18 19:14:37.046220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:18.615 [2024-11-18 19:14:37.046272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:18.615 [2024-11-18 19:14:37.046276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:19.548 19:14:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:19.548 19:14:37 -- common/autotest_common.sh@862 -- # return 0 00:16:19.548 19:14:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:19.548 19:14:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:19.548 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.548 19:14:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:19.548 19:14:37 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:19.548 19:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.548 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.548 [2024-11-18 19:14:37.953498] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:19.548 19:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.548 19:14:37 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:19.548 19:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.548 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.548 Malloc0 00:16:19.548 19:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.548 19:14:37 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:19.548 19:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.548 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.548 19:14:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.548 19:14:37 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:19.548 19:14:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.548 19:14:37 -- common/autotest_common.sh@10 -- # set +x 00:16:19.548 19:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.548 19:14:38 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:19.548 19:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.548 19:14:38 -- common/autotest_common.sh@10 -- # set +x 00:16:19.548 [2024-11-18 19:14:38.007345] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:19.549 19:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.549 19:14:38 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:19.549 test case1: single bdev can't be used in multiple subsystems 00:16:19.549 19:14:38 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:19.549 19:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.549 19:14:38 -- common/autotest_common.sh@10 -- # set +x 00:16:19.549 19:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.549 19:14:38 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:19.549 19:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.549 19:14:38 -- common/autotest_common.sh@10 -- # set +x 00:16:19.549 19:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.549 19:14:38 -- target/nmic.sh@28 -- # nmic_status=0 00:16:19.549 19:14:38 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:19.549 19:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.549 19:14:38 -- common/autotest_common.sh@10 -- # set +x 00:16:19.549 [2024-11-18 19:14:38.031184] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:19.549 [2024-11-18 19:14:38.031212] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:19.549 [2024-11-18 19:14:38.031243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.549 request: 00:16:19.549 { 00:16:19.549 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:19.549 "namespace": { 00:16:19.549 "bdev_name": "Malloc0" 00:16:19.549 }, 00:16:19.549 "method": "nvmf_subsystem_add_ns", 00:16:19.549 "req_id": 1 00:16:19.549 } 00:16:19.549 Got JSON-RPC error response 00:16:19.549 response: 00:16:19.549 { 00:16:19.549 "code": -32602, 00:16:19.549 "message": "Invalid parameters" 00:16:19.549 } 00:16:19.549 19:14:38 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:19.549 19:14:38 -- target/nmic.sh@29 -- # nmic_status=1 00:16:19.549 19:14:38 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:19.549 19:14:38 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:19.549 Adding namespace failed - expected result. 00:16:19.549 19:14:38 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:19.549 test case2: host connect to nvmf target in multiple paths 00:16:19.549 19:14:38 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:19.549 19:14:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.549 19:14:38 -- common/autotest_common.sh@10 -- # set +x 00:16:19.549 [2024-11-18 19:14:38.039312] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:19.549 19:14:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.549 19:14:38 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:20.115 19:14:38 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:20.679 19:14:39 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:20.679 19:14:39 -- common/autotest_common.sh@1187 -- # local i=0 00:16:20.679 19:14:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:20.679 19:14:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:20.679 19:14:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:23.202 19:14:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:23.203 19:14:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:23.203 19:14:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:23.203 19:14:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:23.203 19:14:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:23.203 19:14:41 -- common/autotest_common.sh@1197 -- # return 0 00:16:23.203 19:14:41 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:23.203 [global] 00:16:23.203 thread=1 00:16:23.203 invalidate=1 00:16:23.203 rw=write 00:16:23.203 time_based=1 00:16:23.203 runtime=1 00:16:23.203 ioengine=libaio 00:16:23.203 direct=1 00:16:23.203 bs=4096 00:16:23.203 iodepth=1 00:16:23.203 norandommap=0 00:16:23.203 numjobs=1 00:16:23.203 00:16:23.203 verify_dump=1 00:16:23.203 verify_backlog=512 00:16:23.203 verify_state_save=0 00:16:23.203 do_verify=1 00:16:23.203 verify=crc32c-intel 00:16:23.203 [job0] 00:16:23.203 filename=/dev/nvme0n1 00:16:23.203 Could not set queue depth (nvme0n1) 00:16:23.203 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:23.203 fio-3.35 00:16:23.203 Starting 1 thread 00:16:24.136 00:16:24.136 job0: (groupid=0, jobs=1): err= 0: pid=3444401: Mon Nov 18 19:14:42 2024 00:16:24.136 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:24.136 slat (nsec): min=6916, max=61900, avg=15001.75, stdev=5914.74 00:16:24.136 clat (usec): min=183, max=630, avg=253.20, stdev=51.63 00:16:24.136 lat (usec): min=190, max=650, avg=268.20, stdev=53.59 00:16:24.136 clat percentiles (usec): 00:16:24.136 | 1.00th=[ 192], 5.00th=[ 204], 10.00th=[ 210], 20.00th=[ 223], 00:16:24.136 | 30.00th=[ 229], 40.00th=[ 235], 50.00th=[ 241], 60.00th=[ 247], 00:16:24.136 | 70.00th=[ 258], 80.00th=[ 285], 90.00th=[ 302], 95.00th=[ 318], 00:16:24.136 | 99.00th=[ 510], 99.50th=[ 537], 99.90th=[ 586], 99.95th=[ 619], 00:16:24.136 | 99.99th=[ 627] 00:16:24.136 write: IOPS=2237, BW=8951KiB/s (9166kB/s)(8960KiB/1001msec); 0 zone resets 00:16:24.136 slat (usec): min=7, max=599, avg=18.45, stdev=14.26 00:16:24.136 clat (usec): min=131, max=782, avg=173.70, stdev=29.84 00:16:24.136 lat (usec): min=138, max=804, avg=192.15, stdev=34.91 00:16:24.136 clat percentiles (usec): 00:16:24.136 | 1.00th=[ 139], 5.00th=[ 143], 10.00th=[ 149], 20.00th=[ 155], 00:16:24.136 | 30.00th=[ 163], 40.00th=[ 169], 50.00th=[ 174], 60.00th=[ 176], 00:16:24.136 | 70.00th=[ 180], 80.00th=[ 184], 90.00th=[ 196], 95.00th=[ 206], 00:16:24.136 | 99.00th=[ 262], 99.50th=[ 293], 99.90th=[ 627], 99.95th=[ 668], 00:16:24.136 | 99.99th=[ 783] 00:16:24.136 bw ( KiB/s): min=10232, max=10232, per=100.00%, avg=10232.00, stdev= 0.00, samples=1 00:16:24.136 iops : min= 2558, max= 2558, avg=2558.00, stdev= 0.00, samples=1 00:16:24.136 lat (usec) : 250=81.58%, 500=17.77%, 750=0.63%, 1000=0.02% 00:16:24.136 cpu : usr=4.50%, sys=10.40%, ctx=4292, majf=0, minf=1 00:16:24.136 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:24.136 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.136 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.136 issued rwts: total=2048,2240,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.136 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:24.136 00:16:24.136 Run status group 0 (all jobs): 00:16:24.136 READ: bw=8184KiB/s (8380kB/s), 8184KiB/s-8184KiB/s (8380kB/s-8380kB/s), io=8192KiB (8389kB), run=1001-1001msec 00:16:24.136 WRITE: bw=8951KiB/s (9166kB/s), 8951KiB/s-8951KiB/s (9166kB/s-9166kB/s), io=8960KiB (9175kB), run=1001-1001msec 00:16:24.136 00:16:24.136 Disk stats (read/write): 00:16:24.136 nvme0n1: ios=1860/2048, merge=0/0, ticks=601/315, in_queue=916, util=98.90% 00:16:24.136 19:14:42 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:24.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:24.136 19:14:42 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:24.136 19:14:42 -- common/autotest_common.sh@1208 -- # local i=0 00:16:24.136 19:14:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:24.136 19:14:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:24.136 19:14:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:24.136 19:14:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:24.136 19:14:42 -- common/autotest_common.sh@1220 -- # return 0 00:16:24.136 19:14:42 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:24.136 19:14:42 -- target/nmic.sh@53 -- # nvmftestfini 00:16:24.136 19:14:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:24.136 19:14:42 -- nvmf/common.sh@116 -- # sync 00:16:24.136 19:14:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:24.136 19:14:42 -- nvmf/common.sh@119 -- # set +e 00:16:24.136 19:14:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:24.136 19:14:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:24.136 rmmod nvme_tcp 00:16:24.394 rmmod nvme_fabrics 00:16:24.394 rmmod nvme_keyring 00:16:24.394 19:14:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:24.394 19:14:42 -- nvmf/common.sh@123 -- # set -e 00:16:24.394 19:14:42 -- nvmf/common.sh@124 -- # return 0 00:16:24.394 19:14:42 -- nvmf/common.sh@477 -- # '[' -n 3443742 ']' 00:16:24.394 19:14:42 -- nvmf/common.sh@478 -- # killprocess 3443742 00:16:24.394 19:14:42 -- common/autotest_common.sh@936 -- # '[' -z 3443742 ']' 00:16:24.394 19:14:42 -- common/autotest_common.sh@940 -- # kill -0 3443742 00:16:24.394 19:14:42 -- common/autotest_common.sh@941 -- # uname 00:16:24.394 19:14:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:24.394 19:14:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3443742 00:16:24.394 19:14:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:24.394 19:14:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:24.394 19:14:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3443742' 00:16:24.394 killing process with pid 3443742 00:16:24.394 19:14:42 -- common/autotest_common.sh@955 -- # kill 3443742 00:16:24.394 19:14:42 -- common/autotest_common.sh@960 -- # wait 3443742 00:16:24.653 19:14:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:24.653 19:14:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:24.653 19:14:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:24.653 19:14:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:24.653 19:14:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:24.653 19:14:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:24.653 19:14:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:24.653 19:14:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.555 19:14:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:26.555 00:16:26.555 real 0m10.696s 00:16:26.555 user 0m25.133s 00:16:26.555 sys 0m2.631s 00:16:26.555 19:14:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:26.555 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:16:26.555 ************************************ 00:16:26.555 END TEST nvmf_nmic 00:16:26.555 ************************************ 00:16:26.815 19:14:45 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:26.815 19:14:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:26.815 19:14:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:26.815 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:16:26.815 ************************************ 00:16:26.815 START TEST nvmf_fio_target 00:16:26.815 ************************************ 00:16:26.815 19:14:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:26.815 * Looking for test storage... 00:16:26.815 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:26.815 19:14:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:26.815 19:14:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:26.815 19:14:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:26.815 19:14:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:26.815 19:14:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:26.815 19:14:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:26.815 19:14:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:26.815 19:14:45 -- scripts/common.sh@335 -- # IFS=.-: 00:16:26.815 19:14:45 -- scripts/common.sh@335 -- # read -ra ver1 00:16:26.815 19:14:45 -- scripts/common.sh@336 -- # IFS=.-: 00:16:26.815 19:14:45 -- scripts/common.sh@336 -- # read -ra ver2 00:16:26.815 19:14:45 -- scripts/common.sh@337 -- # local 'op=<' 00:16:26.815 19:14:45 -- scripts/common.sh@339 -- # ver1_l=2 00:16:26.815 19:14:45 -- scripts/common.sh@340 -- # ver2_l=1 00:16:26.815 19:14:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:26.815 19:14:45 -- scripts/common.sh@343 -- # case "$op" in 00:16:26.815 19:14:45 -- scripts/common.sh@344 -- # : 1 00:16:26.815 19:14:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:26.815 19:14:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:26.815 19:14:45 -- scripts/common.sh@364 -- # decimal 1 00:16:26.815 19:14:45 -- scripts/common.sh@352 -- # local d=1 00:16:26.815 19:14:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:26.815 19:14:45 -- scripts/common.sh@354 -- # echo 1 00:16:26.815 19:14:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:26.815 19:14:45 -- scripts/common.sh@365 -- # decimal 2 00:16:26.815 19:14:45 -- scripts/common.sh@352 -- # local d=2 00:16:26.815 19:14:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:26.815 19:14:45 -- scripts/common.sh@354 -- # echo 2 00:16:26.815 19:14:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:26.815 19:14:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:26.815 19:14:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:26.815 19:14:45 -- scripts/common.sh@367 -- # return 0 00:16:26.815 19:14:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:26.815 19:14:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:26.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.815 --rc genhtml_branch_coverage=1 00:16:26.815 --rc genhtml_function_coverage=1 00:16:26.815 --rc genhtml_legend=1 00:16:26.815 --rc geninfo_all_blocks=1 00:16:26.815 --rc geninfo_unexecuted_blocks=1 00:16:26.815 00:16:26.815 ' 00:16:26.815 19:14:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:26.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.815 --rc genhtml_branch_coverage=1 00:16:26.815 --rc genhtml_function_coverage=1 00:16:26.815 --rc genhtml_legend=1 00:16:26.815 --rc geninfo_all_blocks=1 00:16:26.815 --rc geninfo_unexecuted_blocks=1 00:16:26.815 00:16:26.815 ' 00:16:26.815 19:14:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:26.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.815 --rc genhtml_branch_coverage=1 00:16:26.815 --rc genhtml_function_coverage=1 00:16:26.815 --rc genhtml_legend=1 00:16:26.815 --rc geninfo_all_blocks=1 00:16:26.815 --rc geninfo_unexecuted_blocks=1 00:16:26.815 00:16:26.815 ' 00:16:26.815 19:14:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:26.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:26.815 --rc genhtml_branch_coverage=1 00:16:26.815 --rc genhtml_function_coverage=1 00:16:26.815 --rc genhtml_legend=1 00:16:26.815 --rc geninfo_all_blocks=1 00:16:26.815 --rc geninfo_unexecuted_blocks=1 00:16:26.815 00:16:26.815 ' 00:16:26.815 19:14:45 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:26.815 19:14:45 -- nvmf/common.sh@7 -- # uname -s 00:16:26.815 19:14:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:26.815 19:14:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:26.815 19:14:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:26.815 19:14:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:26.815 19:14:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:26.815 19:14:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:26.815 19:14:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:26.815 19:14:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:26.815 19:14:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:26.815 19:14:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:26.815 19:14:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.815 19:14:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.815 19:14:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:26.815 19:14:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:26.815 19:14:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:26.815 19:14:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:26.815 19:14:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.815 19:14:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.815 19:14:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.815 19:14:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.815 19:14:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.815 19:14:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.815 19:14:45 -- paths/export.sh@5 -- # export PATH 00:16:26.815 19:14:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.815 19:14:45 -- nvmf/common.sh@46 -- # : 0 00:16:26.815 19:14:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:26.815 19:14:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:26.815 19:14:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:26.815 19:14:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:26.815 19:14:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:26.815 19:14:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:26.815 19:14:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:26.815 19:14:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:26.815 19:14:45 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:26.815 19:14:45 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:26.815 19:14:45 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:26.815 19:14:45 -- target/fio.sh@16 -- # nvmftestinit 00:16:26.815 19:14:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:26.816 19:14:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:26.816 19:14:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:26.816 19:14:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:26.816 19:14:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:26.816 19:14:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.816 19:14:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.816 19:14:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.816 19:14:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:26.816 19:14:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:26.816 19:14:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:26.816 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:16:29.346 19:14:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:29.346 19:14:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:29.346 19:14:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:29.346 19:14:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:29.346 19:14:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:29.346 19:14:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:29.346 19:14:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:29.346 19:14:47 -- nvmf/common.sh@294 -- # net_devs=() 00:16:29.346 19:14:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:29.346 19:14:47 -- nvmf/common.sh@295 -- # e810=() 00:16:29.346 19:14:47 -- nvmf/common.sh@295 -- # local -ga e810 00:16:29.346 19:14:47 -- nvmf/common.sh@296 -- # x722=() 00:16:29.346 19:14:47 -- nvmf/common.sh@296 -- # local -ga x722 00:16:29.346 19:14:47 -- nvmf/common.sh@297 -- # mlx=() 00:16:29.346 19:14:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:29.346 19:14:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:29.346 19:14:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:29.346 19:14:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:29.346 19:14:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:29.346 19:14:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.346 19:14:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:29.346 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:29.346 19:14:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.346 19:14:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.347 19:14:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:29.347 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:29.347 19:14:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:29.347 19:14:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.347 19:14:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.347 19:14:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.347 19:14:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.347 19:14:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:29.347 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:29.347 19:14:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.347 19:14:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.347 19:14:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.347 19:14:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.347 19:14:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.347 19:14:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:29.347 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:29.347 19:14:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.347 19:14:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:29.347 19:14:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:29.347 19:14:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:29.347 19:14:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:29.347 19:14:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:29.347 19:14:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:29.347 19:14:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:29.347 19:14:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:29.347 19:14:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:29.347 19:14:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:29.347 19:14:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:29.347 19:14:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:29.347 19:14:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:29.347 19:14:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:29.347 19:14:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:29.347 19:14:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:29.347 19:14:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:29.347 19:14:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:29.347 19:14:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:29.347 19:14:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:29.347 19:14:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:29.347 19:14:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:29.347 19:14:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:29.347 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:29.347 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:16:29.347 00:16:29.347 --- 10.0.0.2 ping statistics --- 00:16:29.347 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.347 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:16:29.347 19:14:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:29.347 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:29.347 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:16:29.347 00:16:29.347 --- 10.0.0.1 ping statistics --- 00:16:29.347 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.347 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:16:29.347 19:14:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:29.347 19:14:47 -- nvmf/common.sh@410 -- # return 0 00:16:29.347 19:14:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:29.347 19:14:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:29.347 19:14:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:29.347 19:14:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:29.347 19:14:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:29.347 19:14:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:29.347 19:14:47 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:29.347 19:14:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:29.347 19:14:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:29.347 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:16:29.347 19:14:47 -- nvmf/common.sh@469 -- # nvmfpid=3446621 00:16:29.347 19:14:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:29.347 19:14:47 -- nvmf/common.sh@470 -- # waitforlisten 3446621 00:16:29.347 19:14:47 -- common/autotest_common.sh@829 -- # '[' -z 3446621 ']' 00:16:29.347 19:14:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.347 19:14:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:29.347 19:14:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.347 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.347 19:14:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:29.347 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:16:29.347 [2024-11-18 19:14:47.630941] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:29.347 [2024-11-18 19:14:47.631032] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.347 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.347 [2024-11-18 19:14:47.703490] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:29.347 [2024-11-18 19:14:47.823514] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.347 [2024-11-18 19:14:47.823683] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.347 [2024-11-18 19:14:47.823704] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.347 [2024-11-18 19:14:47.823718] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.347 [2024-11-18 19:14:47.823780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:29.347 [2024-11-18 19:14:47.823836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:29.347 [2024-11-18 19:14:47.823862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:29.347 [2024-11-18 19:14:47.823869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:30.282 19:14:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:30.282 19:14:48 -- common/autotest_common.sh@862 -- # return 0 00:16:30.282 19:14:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:30.282 19:14:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:30.282 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:16:30.282 19:14:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:30.282 19:14:48 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:30.540 [2024-11-18 19:14:48.950316] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:30.540 19:14:48 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:30.797 19:14:49 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:30.797 19:14:49 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.055 19:14:49 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:31.055 19:14:49 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.314 19:14:49 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:31.314 19:14:49 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.572 19:14:50 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:31.572 19:14:50 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:31.829 19:14:50 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.087 19:14:50 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:32.087 19:14:50 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.346 19:14:50 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:32.346 19:14:50 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.605 19:14:51 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:32.605 19:14:51 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:32.862 19:14:51 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:33.120 19:14:51 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:33.120 19:14:51 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:33.386 19:14:51 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:33.386 19:14:51 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:33.719 19:14:52 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:34.002 [2024-11-18 19:14:52.372728] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:34.002 19:14:52 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:34.259 19:14:52 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:34.518 19:14:52 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:35.084 19:14:53 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:35.084 19:14:53 -- common/autotest_common.sh@1187 -- # local i=0 00:16:35.084 19:14:53 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:35.084 19:14:53 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:35.084 19:14:53 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:35.084 19:14:53 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:36.983 19:14:55 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:36.983 19:14:55 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:36.983 19:14:55 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:36.983 19:14:55 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:36.983 19:14:55 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:36.983 19:14:55 -- common/autotest_common.sh@1197 -- # return 0 00:16:36.983 19:14:55 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:37.242 [global] 00:16:37.242 thread=1 00:16:37.242 invalidate=1 00:16:37.242 rw=write 00:16:37.242 time_based=1 00:16:37.242 runtime=1 00:16:37.242 ioengine=libaio 00:16:37.242 direct=1 00:16:37.242 bs=4096 00:16:37.242 iodepth=1 00:16:37.242 norandommap=0 00:16:37.242 numjobs=1 00:16:37.242 00:16:37.242 verify_dump=1 00:16:37.242 verify_backlog=512 00:16:37.242 verify_state_save=0 00:16:37.242 do_verify=1 00:16:37.242 verify=crc32c-intel 00:16:37.242 [job0] 00:16:37.242 filename=/dev/nvme0n1 00:16:37.242 [job1] 00:16:37.242 filename=/dev/nvme0n2 00:16:37.242 [job2] 00:16:37.242 filename=/dev/nvme0n3 00:16:37.242 [job3] 00:16:37.242 filename=/dev/nvme0n4 00:16:37.242 Could not set queue depth (nvme0n1) 00:16:37.242 Could not set queue depth (nvme0n2) 00:16:37.242 Could not set queue depth (nvme0n3) 00:16:37.242 Could not set queue depth (nvme0n4) 00:16:37.242 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:37.242 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:37.242 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:37.242 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:37.242 fio-3.35 00:16:37.242 Starting 4 threads 00:16:38.614 00:16:38.614 job0: (groupid=0, jobs=1): err= 0: pid=3447738: Mon Nov 18 19:14:57 2024 00:16:38.614 read: IOPS=21, BW=85.6KiB/s (87.7kB/s)(88.0KiB/1028msec) 00:16:38.614 slat (nsec): min=12511, max=33812, avg=21220.14, stdev=9049.18 00:16:38.614 clat (usec): min=40757, max=42027, avg=41372.87, stdev=517.63 00:16:38.614 lat (usec): min=40773, max=42055, avg=41394.10, stdev=518.91 00:16:38.614 clat percentiles (usec): 00:16:38.614 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:38.614 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:16:38.614 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:38.614 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:38.614 | 99.99th=[42206] 00:16:38.614 write: IOPS=498, BW=1992KiB/s (2040kB/s)(2048KiB/1028msec); 0 zone resets 00:16:38.614 slat (nsec): min=6230, max=50049, avg=14341.18, stdev=6208.60 00:16:38.614 clat (usec): min=156, max=265, avg=210.11, stdev=17.22 00:16:38.614 lat (usec): min=183, max=272, avg=224.45, stdev=14.51 00:16:38.614 clat percentiles (usec): 00:16:38.614 | 1.00th=[ 178], 5.00th=[ 188], 10.00th=[ 190], 20.00th=[ 196], 00:16:38.614 | 30.00th=[ 200], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 212], 00:16:38.614 | 70.00th=[ 221], 80.00th=[ 227], 90.00th=[ 235], 95.00th=[ 241], 00:16:38.614 | 99.00th=[ 249], 99.50th=[ 255], 99.90th=[ 265], 99.95th=[ 265], 00:16:38.614 | 99.99th=[ 265] 00:16:38.614 bw ( KiB/s): min= 4096, max= 4096, per=34.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.614 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.614 lat (usec) : 250=94.94%, 500=0.94% 00:16:38.614 lat (msec) : 50=4.12% 00:16:38.614 cpu : usr=0.29%, sys=0.78%, ctx=535, majf=0, minf=1 00:16:38.614 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.614 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.614 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.614 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.614 job1: (groupid=0, jobs=1): err= 0: pid=3447739: Mon Nov 18 19:14:57 2024 00:16:38.614 read: IOPS=305, BW=1222KiB/s (1251kB/s)(1256KiB/1028msec) 00:16:38.614 slat (nsec): min=6107, max=40466, avg=9336.48, stdev=5508.08 00:16:38.614 clat (usec): min=191, max=42196, avg=2893.67, stdev=10085.23 00:16:38.614 lat (usec): min=199, max=42234, avg=2903.01, stdev=10088.22 00:16:38.614 clat percentiles (usec): 00:16:38.614 | 1.00th=[ 200], 5.00th=[ 208], 10.00th=[ 212], 20.00th=[ 219], 00:16:38.614 | 30.00th=[ 227], 40.00th=[ 247], 50.00th=[ 265], 60.00th=[ 273], 00:16:38.614 | 70.00th=[ 285], 80.00th=[ 326], 90.00th=[ 375], 95.00th=[41157], 00:16:38.614 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:38.614 | 99.99th=[42206] 00:16:38.614 write: IOPS=498, BW=1992KiB/s (2040kB/s)(2048KiB/1028msec); 0 zone resets 00:16:38.614 slat (nsec): min=7778, max=60220, avg=18883.17, stdev=8380.45 00:16:38.614 clat (usec): min=138, max=255, avg=200.87, stdev=20.58 00:16:38.614 lat (usec): min=147, max=277, avg=219.76, stdev=23.77 00:16:38.614 clat percentiles (usec): 00:16:38.614 | 1.00th=[ 155], 5.00th=[ 167], 10.00th=[ 176], 20.00th=[ 184], 00:16:38.614 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 202], 60.00th=[ 206], 00:16:38.614 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 227], 95.00th=[ 237], 00:16:38.614 | 99.00th=[ 243], 99.50th=[ 253], 99.90th=[ 255], 99.95th=[ 255], 00:16:38.614 | 99.99th=[ 255] 00:16:38.614 bw ( KiB/s): min= 4096, max= 4096, per=34.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.614 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.614 lat (usec) : 250=77.48%, 500=19.73%, 750=0.36% 00:16:38.614 lat (msec) : 50=2.42% 00:16:38.614 cpu : usr=0.58%, sys=1.75%, ctx=828, majf=0, minf=1 00:16:38.614 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.614 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.614 issued rwts: total=314,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.614 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.614 job2: (groupid=0, jobs=1): err= 0: pid=3447740: Mon Nov 18 19:14:57 2024 00:16:38.614 read: IOPS=57, BW=229KiB/s (235kB/s)(236KiB/1029msec) 00:16:38.614 slat (nsec): min=5881, max=34180, avg=11608.58, stdev=7923.34 00:16:38.614 clat (usec): min=303, max=42251, avg=15718.97, stdev=20072.81 00:16:38.614 lat (usec): min=309, max=42266, avg=15730.58, stdev=20078.34 00:16:38.614 clat percentiles (usec): 00:16:38.614 | 1.00th=[ 306], 5.00th=[ 355], 10.00th=[ 367], 20.00th=[ 371], 00:16:38.614 | 30.00th=[ 371], 40.00th=[ 371], 50.00th=[ 375], 60.00th=[ 474], 00:16:38.614 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:38.614 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:38.614 | 99.99th=[42206] 00:16:38.615 write: IOPS=497, BW=1990KiB/s (2038kB/s)(2048KiB/1029msec); 0 zone resets 00:16:38.615 slat (nsec): min=6129, max=38772, avg=13364.51, stdev=5854.22 00:16:38.615 clat (usec): min=148, max=259, avg=179.16, stdev=13.68 00:16:38.615 lat (usec): min=155, max=287, avg=192.53, stdev=14.96 00:16:38.615 clat percentiles (usec): 00:16:38.615 | 1.00th=[ 155], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 169], 00:16:38.615 | 30.00th=[ 172], 40.00th=[ 174], 50.00th=[ 178], 60.00th=[ 182], 00:16:38.615 | 70.00th=[ 186], 80.00th=[ 190], 90.00th=[ 196], 95.00th=[ 202], 00:16:38.615 | 99.00th=[ 219], 99.50th=[ 245], 99.90th=[ 260], 99.95th=[ 260], 00:16:38.615 | 99.99th=[ 260] 00:16:38.615 bw ( KiB/s): min= 4096, max= 4096, per=34.30%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.615 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.615 lat (usec) : 250=89.49%, 500=6.65% 00:16:38.615 lat (msec) : 50=3.85% 00:16:38.615 cpu : usr=0.29%, sys=0.68%, ctx=572, majf=0, minf=1 00:16:38.615 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.615 issued rwts: total=59,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.615 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.615 job3: (groupid=0, jobs=1): err= 0: pid=3447741: Mon Nov 18 19:14:57 2024 00:16:38.615 read: IOPS=1231, BW=4926KiB/s (5044kB/s)(5064KiB/1028msec) 00:16:38.615 slat (nsec): min=4403, max=40783, avg=10984.42, stdev=4034.67 00:16:38.615 clat (usec): min=179, max=42033, avg=567.49, stdev=3813.18 00:16:38.615 lat (usec): min=185, max=42045, avg=578.47, stdev=3813.56 00:16:38.615 clat percentiles (usec): 00:16:38.615 | 1.00th=[ 188], 5.00th=[ 192], 10.00th=[ 194], 20.00th=[ 198], 00:16:38.615 | 30.00th=[ 202], 40.00th=[ 204], 50.00th=[ 206], 60.00th=[ 210], 00:16:38.615 | 70.00th=[ 212], 80.00th=[ 217], 90.00th=[ 227], 95.00th=[ 269], 00:16:38.615 | 99.00th=[ 314], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:38.615 | 99.99th=[42206] 00:16:38.615 write: IOPS=1494, BW=5977KiB/s (6120kB/s)(6144KiB/1028msec); 0 zone resets 00:16:38.615 slat (nsec): min=5834, max=37511, avg=13381.04, stdev=4785.36 00:16:38.615 clat (usec): min=130, max=394, avg=172.40, stdev=31.66 00:16:38.615 lat (usec): min=138, max=431, avg=185.78, stdev=31.89 00:16:38.615 clat percentiles (usec): 00:16:38.615 | 1.00th=[ 133], 5.00th=[ 139], 10.00th=[ 141], 20.00th=[ 145], 00:16:38.615 | 30.00th=[ 151], 40.00th=[ 153], 50.00th=[ 159], 60.00th=[ 169], 00:16:38.615 | 70.00th=[ 192], 80.00th=[ 204], 90.00th=[ 221], 95.00th=[ 233], 00:16:38.615 | 99.00th=[ 247], 99.50th=[ 253], 99.90th=[ 260], 99.95th=[ 396], 00:16:38.615 | 99.99th=[ 396] 00:16:38.615 bw ( KiB/s): min= 1136, max=11152, per=51.45%, avg=6144.00, stdev=7082.38, samples=2 00:16:38.615 iops : min= 284, max= 2788, avg=1536.00, stdev=1770.60, samples=2 00:16:38.615 lat (usec) : 250=96.57%, 500=3.00%, 750=0.04% 00:16:38.615 lat (msec) : 50=0.39% 00:16:38.615 cpu : usr=1.56%, sys=3.70%, ctx=2804, majf=0, minf=1 00:16:38.615 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.615 issued rwts: total=1266,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.615 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.615 00:16:38.615 Run status group 0 (all jobs): 00:16:38.615 READ: bw=6457KiB/s (6612kB/s), 85.6KiB/s-4926KiB/s (87.7kB/s-5044kB/s), io=6644KiB (6803kB), run=1028-1029msec 00:16:38.615 WRITE: bw=11.7MiB/s (12.2MB/s), 1990KiB/s-5977KiB/s (2038kB/s-6120kB/s), io=12.0MiB (12.6MB), run=1028-1029msec 00:16:38.615 00:16:38.615 Disk stats (read/write): 00:16:38.615 nvme0n1: ios=67/512, merge=0/0, ticks=728/100, in_queue=828, util=86.07% 00:16:38.615 nvme0n2: ios=331/512, merge=0/0, ticks=1571/97, in_queue=1668, util=88.79% 00:16:38.615 nvme0n3: ios=111/512, merge=0/0, ticks=797/85, in_queue=882, util=94.22% 00:16:38.615 nvme0n4: ios=1318/1536, merge=0/0, ticks=577/263, in_queue=840, util=95.54% 00:16:38.615 19:14:57 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:38.615 [global] 00:16:38.615 thread=1 00:16:38.615 invalidate=1 00:16:38.615 rw=randwrite 00:16:38.615 time_based=1 00:16:38.615 runtime=1 00:16:38.615 ioengine=libaio 00:16:38.615 direct=1 00:16:38.615 bs=4096 00:16:38.615 iodepth=1 00:16:38.615 norandommap=0 00:16:38.615 numjobs=1 00:16:38.615 00:16:38.615 verify_dump=1 00:16:38.615 verify_backlog=512 00:16:38.615 verify_state_save=0 00:16:38.615 do_verify=1 00:16:38.615 verify=crc32c-intel 00:16:38.615 [job0] 00:16:38.615 filename=/dev/nvme0n1 00:16:38.615 [job1] 00:16:38.615 filename=/dev/nvme0n2 00:16:38.615 [job2] 00:16:38.615 filename=/dev/nvme0n3 00:16:38.615 [job3] 00:16:38.615 filename=/dev/nvme0n4 00:16:38.615 Could not set queue depth (nvme0n1) 00:16:38.615 Could not set queue depth (nvme0n2) 00:16:38.615 Could not set queue depth (nvme0n3) 00:16:38.615 Could not set queue depth (nvme0n4) 00:16:38.873 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.873 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.873 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.873 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.873 fio-3.35 00:16:38.873 Starting 4 threads 00:16:40.246 00:16:40.246 job0: (groupid=0, jobs=1): err= 0: pid=3447971: Mon Nov 18 19:14:58 2024 00:16:40.246 read: IOPS=23, BW=93.7KiB/s (95.9kB/s)(96.0KiB/1025msec) 00:16:40.246 slat (nsec): min=8773, max=18786, avg=15650.83, stdev=2348.52 00:16:40.246 clat (usec): min=260, max=41021, avg=37539.75, stdev=11473.15 00:16:40.246 lat (usec): min=276, max=41037, avg=37555.40, stdev=11472.69 00:16:40.246 clat percentiles (usec): 00:16:40.246 | 1.00th=[ 262], 5.00th=[ 322], 10.00th=[40633], 20.00th=[40633], 00:16:40.246 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:40.246 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:40.246 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:40.246 | 99.99th=[41157] 00:16:40.246 write: IOPS=499, BW=1998KiB/s (2046kB/s)(2048KiB/1025msec); 0 zone resets 00:16:40.246 slat (nsec): min=10564, max=56492, avg=19386.20, stdev=6236.17 00:16:40.246 clat (usec): min=169, max=472, avg=215.43, stdev=23.50 00:16:40.246 lat (usec): min=181, max=501, avg=234.82, stdev=24.41 00:16:40.246 clat percentiles (usec): 00:16:40.246 | 1.00th=[ 180], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 200], 00:16:40.246 | 30.00th=[ 204], 40.00th=[ 208], 50.00th=[ 212], 60.00th=[ 217], 00:16:40.246 | 70.00th=[ 223], 80.00th=[ 231], 90.00th=[ 239], 95.00th=[ 245], 00:16:40.246 | 99.00th=[ 273], 99.50th=[ 359], 99.90th=[ 474], 99.95th=[ 474], 00:16:40.246 | 99.99th=[ 474] 00:16:40.246 bw ( KiB/s): min= 4096, max= 4096, per=25.85%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.246 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.246 lat (usec) : 250=92.54%, 500=3.36% 00:16:40.246 lat (msec) : 50=4.10% 00:16:40.246 cpu : usr=1.17%, sys=0.78%, ctx=536, majf=0, minf=1 00:16:40.246 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.246 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.246 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.246 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.246 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.246 job1: (groupid=0, jobs=1): err= 0: pid=3447972: Mon Nov 18 19:14:58 2024 00:16:40.246 read: IOPS=21, BW=87.6KiB/s (89.7kB/s)(88.0KiB/1005msec) 00:16:40.246 slat (nsec): min=9276, max=20453, avg=15643.82, stdev=1934.74 00:16:40.246 clat (usec): min=40947, max=41055, avg=40983.99, stdev=24.21 00:16:40.246 lat (usec): min=40967, max=41065, avg=40999.63, stdev=22.85 00:16:40.246 clat percentiles (usec): 00:16:40.246 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:40.246 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:40.246 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:40.246 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:40.246 | 99.99th=[41157] 00:16:40.246 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:16:40.246 slat (nsec): min=7617, max=43943, avg=13916.57, stdev=4035.83 00:16:40.246 clat (usec): min=144, max=342, avg=182.49, stdev=19.17 00:16:40.246 lat (usec): min=158, max=371, avg=196.41, stdev=19.68 00:16:40.246 clat percentiles (usec): 00:16:40.246 | 1.00th=[ 149], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 169], 00:16:40.246 | 30.00th=[ 174], 40.00th=[ 178], 50.00th=[ 180], 60.00th=[ 184], 00:16:40.246 | 70.00th=[ 190], 80.00th=[ 194], 90.00th=[ 204], 95.00th=[ 212], 00:16:40.247 | 99.00th=[ 231], 99.50th=[ 293], 99.90th=[ 343], 99.95th=[ 343], 00:16:40.247 | 99.99th=[ 343] 00:16:40.247 bw ( KiB/s): min= 4096, max= 4096, per=25.85%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.247 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.247 lat (usec) : 250=95.13%, 500=0.75% 00:16:40.247 lat (msec) : 50=4.12% 00:16:40.247 cpu : usr=0.30%, sys=0.80%, ctx=534, majf=0, minf=2 00:16:40.247 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.247 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.247 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.247 job2: (groupid=0, jobs=1): err= 0: pid=3447973: Mon Nov 18 19:14:58 2024 00:16:40.247 read: IOPS=2146, BW=8587KiB/s (8794kB/s)(8596KiB/1001msec) 00:16:40.247 slat (nsec): min=7142, max=49956, avg=9728.82, stdev=4222.63 00:16:40.247 clat (usec): min=188, max=723, avg=229.36, stdev=36.61 00:16:40.247 lat (usec): min=195, max=733, avg=239.09, stdev=38.37 00:16:40.247 clat percentiles (usec): 00:16:40.247 | 1.00th=[ 196], 5.00th=[ 200], 10.00th=[ 202], 20.00th=[ 208], 00:16:40.247 | 30.00th=[ 210], 40.00th=[ 217], 50.00th=[ 223], 60.00th=[ 231], 00:16:40.247 | 70.00th=[ 241], 80.00th=[ 247], 90.00th=[ 253], 95.00th=[ 265], 00:16:40.247 | 99.00th=[ 404], 99.50th=[ 502], 99.90th=[ 586], 99.95th=[ 603], 00:16:40.247 | 99.99th=[ 725] 00:16:40.247 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:16:40.247 slat (nsec): min=9238, max=60448, avg=13416.44, stdev=6140.15 00:16:40.247 clat (usec): min=136, max=362, avg=170.42, stdev=26.20 00:16:40.247 lat (usec): min=146, max=418, avg=183.84, stdev=30.26 00:16:40.247 clat percentiles (usec): 00:16:40.247 | 1.00th=[ 141], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 149], 00:16:40.247 | 30.00th=[ 153], 40.00th=[ 155], 50.00th=[ 159], 60.00th=[ 167], 00:16:40.247 | 70.00th=[ 184], 80.00th=[ 196], 90.00th=[ 208], 95.00th=[ 219], 00:16:40.247 | 99.00th=[ 241], 99.50th=[ 253], 99.90th=[ 334], 99.95th=[ 355], 00:16:40.247 | 99.99th=[ 363] 00:16:40.247 bw ( KiB/s): min= 8752, max= 8752, per=55.23%, avg=8752.00, stdev= 0.00, samples=1 00:16:40.247 iops : min= 2188, max= 2188, avg=2188.00, stdev= 0.00, samples=1 00:16:40.247 lat (usec) : 250=92.80%, 500=6.99%, 750=0.21% 00:16:40.247 cpu : usr=4.10%, sys=7.30%, ctx=4712, majf=0, minf=1 00:16:40.247 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.247 issued rwts: total=2149,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.247 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.247 job3: (groupid=0, jobs=1): err= 0: pid=3447974: Mon Nov 18 19:14:58 2024 00:16:40.247 read: IOPS=58, BW=232KiB/s (238kB/s)(240KiB/1034msec) 00:16:40.247 slat (nsec): min=6430, max=35447, avg=17771.05, stdev=7031.69 00:16:40.247 clat (usec): min=281, max=42031, avg=15409.25, stdev=19899.53 00:16:40.247 lat (usec): min=301, max=42048, avg=15427.02, stdev=19899.96 00:16:40.247 clat percentiles (usec): 00:16:40.247 | 1.00th=[ 281], 5.00th=[ 326], 10.00th=[ 347], 20.00th=[ 363], 00:16:40.247 | 30.00th=[ 371], 40.00th=[ 392], 50.00th=[ 457], 60.00th=[ 502], 00:16:40.247 | 70.00th=[40633], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:16:40.247 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:40.247 | 99.99th=[42206] 00:16:40.247 write: IOPS=495, BW=1981KiB/s (2028kB/s)(2048KiB/1034msec); 0 zone resets 00:16:40.247 slat (nsec): min=8770, max=52261, avg=16329.27, stdev=5371.23 00:16:40.247 clat (usec): min=156, max=333, avg=189.84, stdev=16.98 00:16:40.247 lat (usec): min=173, max=349, avg=206.17, stdev=17.63 00:16:40.247 clat percentiles (usec): 00:16:40.247 | 1.00th=[ 163], 5.00th=[ 169], 10.00th=[ 174], 20.00th=[ 178], 00:16:40.247 | 30.00th=[ 182], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 192], 00:16:40.247 | 70.00th=[ 196], 80.00th=[ 200], 90.00th=[ 206], 95.00th=[ 212], 00:16:40.247 | 99.00th=[ 249], 99.50th=[ 293], 99.90th=[ 334], 99.95th=[ 334], 00:16:40.247 | 99.99th=[ 334] 00:16:40.247 bw ( KiB/s): min= 4096, max= 4096, per=25.85%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.247 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.247 lat (usec) : 250=88.64%, 500=6.99%, 750=0.52% 00:16:40.247 lat (msec) : 50=3.85% 00:16:40.247 cpu : usr=0.39%, sys=0.87%, ctx=573, majf=0, minf=1 00:16:40.247 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.247 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.247 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.247 issued rwts: total=60,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.247 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.247 00:16:40.247 Run status group 0 (all jobs): 00:16:40.247 READ: bw=8723KiB/s (8933kB/s), 87.6KiB/s-8587KiB/s (89.7kB/s-8794kB/s), io=9020KiB (9236kB), run=1001-1034msec 00:16:40.247 WRITE: bw=15.5MiB/s (16.2MB/s), 1981KiB/s-9.99MiB/s (2028kB/s-10.5MB/s), io=16.0MiB (16.8MB), run=1001-1034msec 00:16:40.247 00:16:40.247 Disk stats (read/write): 00:16:40.247 nvme0n1: ios=69/512, merge=0/0, ticks=722/92, in_queue=814, util=86.97% 00:16:40.247 nvme0n2: ios=31/512, merge=0/0, ticks=746/91, in_queue=837, util=86.90% 00:16:40.247 nvme0n3: ios=1914/2048, merge=0/0, ticks=1253/342, in_queue=1595, util=96.98% 00:16:40.247 nvme0n4: ios=83/512, merge=0/0, ticks=1663/95, in_queue=1758, util=98.32% 00:16:40.247 19:14:58 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:40.247 [global] 00:16:40.247 thread=1 00:16:40.247 invalidate=1 00:16:40.247 rw=write 00:16:40.247 time_based=1 00:16:40.247 runtime=1 00:16:40.247 ioengine=libaio 00:16:40.247 direct=1 00:16:40.247 bs=4096 00:16:40.247 iodepth=128 00:16:40.247 norandommap=0 00:16:40.247 numjobs=1 00:16:40.247 00:16:40.247 verify_dump=1 00:16:40.247 verify_backlog=512 00:16:40.247 verify_state_save=0 00:16:40.247 do_verify=1 00:16:40.247 verify=crc32c-intel 00:16:40.247 [job0] 00:16:40.247 filename=/dev/nvme0n1 00:16:40.247 [job1] 00:16:40.247 filename=/dev/nvme0n2 00:16:40.247 [job2] 00:16:40.247 filename=/dev/nvme0n3 00:16:40.247 [job3] 00:16:40.247 filename=/dev/nvme0n4 00:16:40.247 Could not set queue depth (nvme0n1) 00:16:40.247 Could not set queue depth (nvme0n2) 00:16:40.247 Could not set queue depth (nvme0n3) 00:16:40.247 Could not set queue depth (nvme0n4) 00:16:40.247 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.247 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.247 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.247 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.247 fio-3.35 00:16:40.247 Starting 4 threads 00:16:41.623 00:16:41.623 job0: (groupid=0, jobs=1): err= 0: pid=3448234: Mon Nov 18 19:14:59 2024 00:16:41.623 read: IOPS=3115, BW=12.2MiB/s (12.8MB/s)(12.2MiB/1002msec) 00:16:41.623 slat (usec): min=2, max=15573, avg=122.76, stdev=835.91 00:16:41.623 clat (usec): min=551, max=39796, avg=15432.80, stdev=6015.82 00:16:41.623 lat (usec): min=2073, max=39801, avg=15555.56, stdev=6060.54 00:16:41.623 clat percentiles (usec): 00:16:41.623 | 1.00th=[ 3818], 5.00th=[10028], 10.00th=[10814], 20.00th=[11338], 00:16:41.623 | 30.00th=[12256], 40.00th=[12780], 50.00th=[13566], 60.00th=[14222], 00:16:41.623 | 70.00th=[16057], 80.00th=[18744], 90.00th=[22152], 95.00th=[30016], 00:16:41.623 | 99.00th=[33817], 99.50th=[37487], 99.90th=[39584], 99.95th=[39584], 00:16:41.623 | 99.99th=[39584] 00:16:41.623 write: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec); 0 zone resets 00:16:41.623 slat (usec): min=3, max=19635, avg=162.01, stdev=921.68 00:16:41.623 clat (usec): min=1205, max=111276, avg=22015.20, stdev=19981.94 00:16:41.623 lat (usec): min=1220, max=111294, avg=22177.21, stdev=20117.66 00:16:41.623 clat percentiles (msec): 00:16:41.623 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], 00:16:41.623 | 30.00th=[ 13], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 21], 00:16:41.623 | 70.00th=[ 23], 80.00th=[ 25], 90.00th=[ 47], 95.00th=[ 70], 00:16:41.623 | 99.00th=[ 103], 99.50th=[ 108], 99.90th=[ 112], 99.95th=[ 112], 00:16:41.623 | 99.99th=[ 112] 00:16:41.623 bw ( KiB/s): min=10672, max=17384, per=20.10%, avg=14028.00, stdev=4746.10, samples=2 00:16:41.623 iops : min= 2668, max= 4346, avg=3507.00, stdev=1186.53, samples=2 00:16:41.623 lat (usec) : 750=0.01% 00:16:41.623 lat (msec) : 2=0.06%, 4=2.30%, 10=8.07%, 20=61.02%, 50=23.80% 00:16:41.623 lat (msec) : 100=4.18%, 250=0.57% 00:16:41.623 cpu : usr=3.10%, sys=6.29%, ctx=334, majf=0, minf=1 00:16:41.623 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:41.623 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.623 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.623 issued rwts: total=3122,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.623 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.623 job1: (groupid=0, jobs=1): err= 0: pid=3448253: Mon Nov 18 19:14:59 2024 00:16:41.623 read: IOPS=5587, BW=21.8MiB/s (22.9MB/s)(22.0MiB/1008msec) 00:16:41.623 slat (usec): min=2, max=9596, avg=81.26, stdev=516.74 00:16:41.623 clat (usec): min=430, max=65124, avg=10631.88, stdev=6211.49 00:16:41.623 lat (usec): min=440, max=65132, avg=10713.14, stdev=6252.96 00:16:41.623 clat percentiles (usec): 00:16:41.623 | 1.00th=[ 1057], 5.00th=[ 3294], 10.00th=[ 5473], 20.00th=[ 9110], 00:16:41.623 | 30.00th=[10028], 40.00th=[10159], 50.00th=[10421], 60.00th=[10683], 00:16:41.623 | 70.00th=[10945], 80.00th=[11338], 90.00th=[11863], 95.00th=[13566], 00:16:41.623 | 99.00th=[44827], 99.50th=[52167], 99.90th=[63177], 99.95th=[65274], 00:16:41.623 | 99.99th=[65274] 00:16:41.623 write: IOPS=5768, BW=22.5MiB/s (23.6MB/s)(22.7MiB/1008msec); 0 zone resets 00:16:41.623 slat (usec): min=3, max=17496, avg=77.63, stdev=512.37 00:16:41.623 clat (usec): min=272, max=60241, avg=11283.31, stdev=6363.13 00:16:41.623 lat (usec): min=411, max=60259, avg=11360.94, stdev=6386.50 00:16:41.623 clat percentiles (usec): 00:16:41.623 | 1.00th=[ 1221], 5.00th=[ 4490], 10.00th=[ 6718], 20.00th=[ 8979], 00:16:41.623 | 30.00th=[ 9372], 40.00th=[10290], 50.00th=[10814], 60.00th=[11076], 00:16:41.623 | 70.00th=[11338], 80.00th=[11600], 90.00th=[13566], 95.00th=[19268], 00:16:41.623 | 99.00th=[46924], 99.50th=[55313], 99.90th=[60031], 99.95th=[60031], 00:16:41.623 | 99.99th=[60031] 00:16:41.623 bw ( KiB/s): min=20920, max=24576, per=32.59%, avg=22748.00, stdev=2585.18, samples=2 00:16:41.623 iops : min= 5230, max= 6144, avg=5687.00, stdev=646.30, samples=2 00:16:41.623 lat (usec) : 500=0.10%, 750=0.05%, 1000=0.41% 00:16:41.624 lat (msec) : 2=1.12%, 4=4.11%, 10=27.33%, 20=63.32%, 50=2.80% 00:16:41.624 lat (msec) : 100=0.76% 00:16:41.624 cpu : usr=3.97%, sys=8.04%, ctx=539, majf=0, minf=1 00:16:41.624 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:41.624 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.624 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.624 issued rwts: total=5632,5815,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.624 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.624 job2: (groupid=0, jobs=1): err= 0: pid=3448285: Mon Nov 18 19:14:59 2024 00:16:41.624 read: IOPS=4185, BW=16.3MiB/s (17.1MB/s)(16.5MiB/1007msec) 00:16:41.624 slat (usec): min=2, max=19472, avg=108.66, stdev=734.64 00:16:41.624 clat (usec): min=2354, max=51643, avg=13759.33, stdev=4430.10 00:16:41.624 lat (usec): min=4736, max=51652, avg=13867.99, stdev=4460.44 00:16:41.624 clat percentiles (usec): 00:16:41.624 | 1.00th=[ 6587], 5.00th=[ 9241], 10.00th=[10159], 20.00th=[11076], 00:16:41.624 | 30.00th=[11338], 40.00th=[11600], 50.00th=[11994], 60.00th=[13435], 00:16:41.624 | 70.00th=[14353], 80.00th=[16712], 90.00th=[21365], 95.00th=[22938], 00:16:41.624 | 99.00th=[26084], 99.50th=[27919], 99.90th=[51643], 99.95th=[51643], 00:16:41.624 | 99.99th=[51643] 00:16:41.624 write: IOPS=4575, BW=17.9MiB/s (18.7MB/s)(18.0MiB/1007msec); 0 zone resets 00:16:41.624 slat (usec): min=3, max=27309, avg=108.72, stdev=810.47 00:16:41.624 clat (usec): min=833, max=51622, avg=15079.87, stdev=5295.96 00:16:41.624 lat (usec): min=839, max=51638, avg=15188.60, stdev=5349.80 00:16:41.624 clat percentiles (usec): 00:16:41.624 | 1.00th=[ 7177], 5.00th=[ 9372], 10.00th=[10028], 20.00th=[10945], 00:16:41.624 | 30.00th=[11994], 40.00th=[12518], 50.00th=[13698], 60.00th=[14746], 00:16:41.624 | 70.00th=[15139], 80.00th=[20579], 90.00th=[22414], 95.00th=[24511], 00:16:41.624 | 99.00th=[29230], 99.50th=[36439], 99.90th=[39584], 99.95th=[43779], 00:16:41.624 | 99.99th=[51643] 00:16:41.624 bw ( KiB/s): min=16384, max=20408, per=26.35%, avg=18396.00, stdev=2845.40, samples=2 00:16:41.624 iops : min= 4096, max= 5102, avg=4599.00, stdev=711.35, samples=2 00:16:41.624 lat (usec) : 1000=0.07% 00:16:41.624 lat (msec) : 4=0.09%, 10=8.70%, 20=73.66%, 50=17.41%, 100=0.07% 00:16:41.624 cpu : usr=5.47%, sys=7.85%, ctx=390, majf=0, minf=1 00:16:41.624 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:41.624 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.624 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.624 issued rwts: total=4215,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.624 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.624 job3: (groupid=0, jobs=1): err= 0: pid=3448297: Mon Nov 18 19:14:59 2024 00:16:41.624 read: IOPS=3293, BW=12.9MiB/s (13.5MB/s)(12.9MiB/1004msec) 00:16:41.624 slat (usec): min=2, max=31258, avg=128.18, stdev=940.12 00:16:41.624 clat (usec): min=400, max=66609, avg=16361.08, stdev=9303.07 00:16:41.624 lat (usec): min=3371, max=66619, avg=16489.26, stdev=9383.38 00:16:41.624 clat percentiles (usec): 00:16:41.624 | 1.00th=[ 4490], 5.00th=[ 6718], 10.00th=[ 9896], 20.00th=[11863], 00:16:41.624 | 30.00th=[12649], 40.00th=[13042], 50.00th=[13304], 60.00th=[14091], 00:16:41.624 | 70.00th=[15139], 80.00th=[20841], 90.00th=[24773], 95.00th=[35390], 00:16:41.624 | 99.00th=[55313], 99.50th=[57410], 99.90th=[58459], 99.95th=[63701], 00:16:41.624 | 99.99th=[66847] 00:16:41.624 write: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec); 0 zone resets 00:16:41.624 slat (usec): min=3, max=11605, avg=152.27, stdev=810.75 00:16:41.624 clat (usec): min=1763, max=110819, avg=20315.41, stdev=19501.25 00:16:41.624 lat (usec): min=1776, max=110831, avg=20467.68, stdev=19633.14 00:16:41.624 clat percentiles (msec): 00:16:41.624 | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], 00:16:41.624 | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 14], 60.00th=[ 14], 00:16:41.624 | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 44], 95.00th=[ 69], 00:16:41.624 | 99.00th=[ 103], 99.50th=[ 108], 99.90th=[ 111], 99.95th=[ 111], 00:16:41.624 | 99.99th=[ 111] 00:16:41.624 bw ( KiB/s): min=13560, max=15112, per=20.54%, avg=14336.00, stdev=1097.43, samples=2 00:16:41.624 iops : min= 3390, max= 3778, avg=3584.00, stdev=274.36, samples=2 00:16:41.624 lat (usec) : 500=0.01% 00:16:41.624 lat (msec) : 2=0.04%, 4=0.16%, 10=8.04%, 20=71.25%, 50=15.02% 00:16:41.624 lat (msec) : 100=4.92%, 250=0.55% 00:16:41.624 cpu : usr=2.89%, sys=3.79%, ctx=376, majf=0, minf=1 00:16:41.624 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:41.624 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:41.624 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:41.624 issued rwts: total=3307,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:41.624 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:41.624 00:16:41.624 Run status group 0 (all jobs): 00:16:41.624 READ: bw=63.1MiB/s (66.1MB/s), 12.2MiB/s-21.8MiB/s (12.8MB/s-22.9MB/s), io=63.6MiB (66.7MB), run=1002-1008msec 00:16:41.624 WRITE: bw=68.2MiB/s (71.5MB/s), 13.9MiB/s-22.5MiB/s (14.6MB/s-23.6MB/s), io=68.7MiB (72.1MB), run=1002-1008msec 00:16:41.624 00:16:41.624 Disk stats (read/write): 00:16:41.624 nvme0n1: ios=2610/2636, merge=0/0, ticks=30241/59632, in_queue=89873, util=86.67% 00:16:41.624 nvme0n2: ios=4660/5043, merge=0/0, ticks=29695/35737, in_queue=65432, util=93.60% 00:16:41.624 nvme0n3: ios=3628/3847, merge=0/0, ticks=24006/33266, in_queue=57272, util=99.48% 00:16:41.624 nvme0n4: ios=2617/2930, merge=0/0, ticks=21597/32530, in_queue=54127, util=93.99% 00:16:41.624 19:15:00 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:41.624 [global] 00:16:41.624 thread=1 00:16:41.624 invalidate=1 00:16:41.624 rw=randwrite 00:16:41.624 time_based=1 00:16:41.624 runtime=1 00:16:41.624 ioengine=libaio 00:16:41.624 direct=1 00:16:41.624 bs=4096 00:16:41.624 iodepth=128 00:16:41.624 norandommap=0 00:16:41.624 numjobs=1 00:16:41.624 00:16:41.624 verify_dump=1 00:16:41.624 verify_backlog=512 00:16:41.624 verify_state_save=0 00:16:41.624 do_verify=1 00:16:41.624 verify=crc32c-intel 00:16:41.624 [job0] 00:16:41.624 filename=/dev/nvme0n1 00:16:41.624 [job1] 00:16:41.624 filename=/dev/nvme0n2 00:16:41.624 [job2] 00:16:41.624 filename=/dev/nvme0n3 00:16:41.624 [job3] 00:16:41.624 filename=/dev/nvme0n4 00:16:41.624 Could not set queue depth (nvme0n1) 00:16:41.624 Could not set queue depth (nvme0n2) 00:16:41.624 Could not set queue depth (nvme0n3) 00:16:41.624 Could not set queue depth (nvme0n4) 00:16:41.882 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.882 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.882 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.882 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:41.882 fio-3.35 00:16:41.882 Starting 4 threads 00:16:43.276 00:16:43.276 job0: (groupid=0, jobs=1): err= 0: pid=3448593: Mon Nov 18 19:15:01 2024 00:16:43.276 read: IOPS=5348, BW=20.9MiB/s (21.9MB/s)(21.0MiB/1003msec) 00:16:43.276 slat (usec): min=3, max=4429, avg=84.12, stdev=428.11 00:16:43.276 clat (usec): min=795, max=23292, avg=10921.81, stdev=2519.67 00:16:43.276 lat (usec): min=3034, max=23310, avg=11005.94, stdev=2544.47 00:16:43.276 clat percentiles (usec): 00:16:43.276 | 1.00th=[ 6849], 5.00th=[ 8455], 10.00th=[ 8979], 20.00th=[ 9241], 00:16:43.276 | 30.00th=[ 9634], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10683], 00:16:43.276 | 70.00th=[11207], 80.00th=[11731], 90.00th=[15139], 95.00th=[16188], 00:16:43.276 | 99.00th=[20055], 99.50th=[22938], 99.90th=[22938], 99.95th=[22938], 00:16:43.276 | 99.99th=[23200] 00:16:43.276 write: IOPS=5615, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1003msec); 0 zone resets 00:16:43.276 slat (usec): min=4, max=9143, avg=89.96, stdev=509.53 00:16:43.276 clat (usec): min=6623, max=30274, avg=12033.97, stdev=3170.86 00:16:43.276 lat (usec): min=6686, max=30358, avg=12123.93, stdev=3205.34 00:16:43.276 clat percentiles (usec): 00:16:43.276 | 1.00th=[ 7635], 5.00th=[ 9241], 10.00th=[ 9372], 20.00th=[10028], 00:16:43.276 | 30.00th=[10421], 40.00th=[10945], 50.00th=[11207], 60.00th=[11469], 00:16:43.276 | 70.00th=[11731], 80.00th=[13698], 90.00th=[15664], 95.00th=[20841], 00:16:43.276 | 99.00th=[22152], 99.50th=[24249], 99.90th=[26870], 99.95th=[27395], 00:16:43.276 | 99.99th=[30278] 00:16:43.276 bw ( KiB/s): min=20480, max=24576, per=36.90%, avg=22528.00, stdev=2896.31, samples=2 00:16:43.276 iops : min= 5120, max= 6144, avg=5632.00, stdev=724.08, samples=2 00:16:43.276 lat (usec) : 1000=0.01% 00:16:43.276 lat (msec) : 4=0.27%, 10=30.35%, 20=65.97%, 50=3.39% 00:16:43.276 cpu : usr=6.59%, sys=7.78%, ctx=474, majf=0, minf=1 00:16:43.276 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:43.276 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.276 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.276 issued rwts: total=5365,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.276 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.277 job1: (groupid=0, jobs=1): err= 0: pid=3448594: Mon Nov 18 19:15:01 2024 00:16:43.277 read: IOPS=3538, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1013msec) 00:16:43.277 slat (usec): min=2, max=17710, avg=137.28, stdev=888.16 00:16:43.277 clat (usec): min=5915, max=69300, avg=16408.31, stdev=11259.65 00:16:43.277 lat (usec): min=5927, max=69312, avg=16545.59, stdev=11333.86 00:16:43.277 clat percentiles (usec): 00:16:43.277 | 1.00th=[ 7963], 5.00th=[ 8979], 10.00th=[ 9634], 20.00th=[10814], 00:16:43.277 | 30.00th=[11207], 40.00th=[11600], 50.00th=[11994], 60.00th=[12518], 00:16:43.277 | 70.00th=[16450], 80.00th=[20579], 90.00th=[23200], 95.00th=[43779], 00:16:43.277 | 99.00th=[64750], 99.50th=[67634], 99.90th=[69731], 99.95th=[69731], 00:16:43.277 | 99.99th=[69731] 00:16:43.277 write: IOPS=3836, BW=15.0MiB/s (15.7MB/s)(15.2MiB/1013msec); 0 zone resets 00:16:43.277 slat (usec): min=3, max=14651, avg=125.01, stdev=614.40 00:16:43.277 clat (usec): min=3050, max=69302, avg=17613.20, stdev=8834.22 00:16:43.277 lat (usec): min=3060, max=69320, avg=17738.20, stdev=8875.00 00:16:43.277 clat percentiles (usec): 00:16:43.277 | 1.00th=[ 4686], 5.00th=[ 8029], 10.00th=[ 8979], 20.00th=[10290], 00:16:43.277 | 30.00th=[10945], 40.00th=[12649], 50.00th=[16188], 60.00th=[18482], 00:16:43.277 | 70.00th=[20579], 80.00th=[24249], 90.00th=[29754], 95.00th=[35914], 00:16:43.277 | 99.00th=[45351], 99.50th=[50594], 99.90th=[68682], 99.95th=[69731], 00:16:43.277 | 99.99th=[69731] 00:16:43.277 bw ( KiB/s): min=11152, max=18912, per=24.62%, avg=15032.00, stdev=5487.15, samples=2 00:16:43.277 iops : min= 2788, max= 4728, avg=3758.00, stdev=1371.79, samples=2 00:16:43.277 lat (msec) : 4=0.19%, 10=13.32%, 20=57.44%, 50=26.65%, 100=2.40% 00:16:43.277 cpu : usr=3.16%, sys=4.64%, ctx=409, majf=0, minf=1 00:16:43.277 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:43.277 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.277 issued rwts: total=3584,3886,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.277 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.277 job2: (groupid=0, jobs=1): err= 0: pid=3448599: Mon Nov 18 19:15:01 2024 00:16:43.277 read: IOPS=2552, BW=9.97MiB/s (10.5MB/s)(10.0MiB/1003msec) 00:16:43.277 slat (usec): min=2, max=30793, avg=201.43, stdev=1373.55 00:16:43.277 clat (usec): min=7307, max=90981, avg=25066.83, stdev=20046.23 00:16:43.277 lat (usec): min=8962, max=90987, avg=25268.25, stdev=20160.62 00:16:43.277 clat percentiles (usec): 00:16:43.277 | 1.00th=[ 8979], 5.00th=[10028], 10.00th=[10552], 20.00th=[11994], 00:16:43.277 | 30.00th=[12387], 40.00th=[13304], 50.00th=[20317], 60.00th=[22938], 00:16:43.277 | 70.00th=[23462], 80.00th=[25297], 90.00th=[60031], 95.00th=[72877], 00:16:43.277 | 99.00th=[90702], 99.50th=[90702], 99.90th=[90702], 99.95th=[90702], 00:16:43.277 | 99.99th=[90702] 00:16:43.277 write: IOPS=2870, BW=11.2MiB/s (11.8MB/s)(11.2MiB/1003msec); 0 zone resets 00:16:43.277 slat (usec): min=3, max=16494, avg=164.01, stdev=1026.98 00:16:43.277 clat (usec): min=279, max=85946, avg=21654.08, stdev=14673.38 00:16:43.277 lat (usec): min=6500, max=96758, avg=21818.09, stdev=14723.79 00:16:43.277 clat percentiles (usec): 00:16:43.277 | 1.00th=[ 6718], 5.00th=[ 9634], 10.00th=[10159], 20.00th=[12256], 00:16:43.277 | 30.00th=[12911], 40.00th=[14877], 50.00th=[17171], 60.00th=[19792], 00:16:43.277 | 70.00th=[22152], 80.00th=[28181], 90.00th=[36963], 95.00th=[47973], 00:16:43.277 | 99.00th=[85459], 99.50th=[85459], 99.90th=[85459], 99.95th=[85459], 00:16:43.277 | 99.99th=[85459] 00:16:43.277 bw ( KiB/s): min= 8192, max=13816, per=18.02%, avg=11004.00, stdev=3976.77, samples=2 00:16:43.277 iops : min= 2048, max= 3454, avg=2751.00, stdev=994.19, samples=2 00:16:43.277 lat (usec) : 500=0.02% 00:16:43.277 lat (msec) : 10=5.77%, 20=51.04%, 50=34.99%, 100=8.18% 00:16:43.277 cpu : usr=1.30%, sys=3.19%, ctx=272, majf=0, minf=1 00:16:43.277 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:16:43.277 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.277 issued rwts: total=2560,2879,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.277 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.277 job3: (groupid=0, jobs=1): err= 0: pid=3448600: Mon Nov 18 19:15:01 2024 00:16:43.277 read: IOPS=2943, BW=11.5MiB/s (12.1MB/s)(12.0MiB/1047msec) 00:16:43.277 slat (usec): min=3, max=26479, avg=141.33, stdev=1046.05 00:16:43.277 clat (usec): min=6461, max=51202, avg=17294.09, stdev=7218.89 00:16:43.277 lat (usec): min=6472, max=51229, avg=17435.42, stdev=7302.79 00:16:43.277 clat percentiles (usec): 00:16:43.277 | 1.00th=[ 7373], 5.00th=[10159], 10.00th=[10421], 20.00th=[11731], 00:16:43.277 | 30.00th=[11994], 40.00th=[12780], 50.00th=[14746], 60.00th=[16712], 00:16:43.277 | 70.00th=[20055], 80.00th=[22938], 90.00th=[29230], 95.00th=[32637], 00:16:43.277 | 99.00th=[36963], 99.50th=[38536], 99.90th=[46924], 99.95th=[46924], 00:16:43.277 | 99.99th=[51119] 00:16:43.277 write: IOPS=3423, BW=13.4MiB/s (14.0MB/s)(14.0MiB/1047msec); 0 zone resets 00:16:43.277 slat (usec): min=3, max=10311, avg=146.55, stdev=747.73 00:16:43.277 clat (usec): min=1629, max=53603, avg=22183.13, stdev=11448.40 00:16:43.277 lat (usec): min=1635, max=53672, avg=22329.68, stdev=11494.48 00:16:43.277 clat percentiles (usec): 00:16:43.277 | 1.00th=[ 4883], 5.00th=[ 8717], 10.00th=[10290], 20.00th=[11207], 00:16:43.277 | 30.00th=[12256], 40.00th=[17433], 50.00th=[22938], 60.00th=[23725], 00:16:43.277 | 70.00th=[26084], 80.00th=[30540], 90.00th=[39060], 95.00th=[44827], 00:16:43.277 | 99.00th=[53216], 99.50th=[53216], 99.90th=[53740], 99.95th=[53740], 00:16:43.277 | 99.99th=[53740] 00:16:43.277 bw ( KiB/s): min=11344, max=16384, per=22.71%, avg=13864.00, stdev=3563.82, samples=2 00:16:43.277 iops : min= 2836, max= 4096, avg=3466.00, stdev=890.95, samples=2 00:16:43.277 lat (msec) : 2=0.18%, 4=0.12%, 10=5.70%, 20=48.71%, 50=43.58% 00:16:43.277 lat (msec) : 100=1.71% 00:16:43.277 cpu : usr=4.21%, sys=4.88%, ctx=341, majf=0, minf=1 00:16:43.277 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:43.277 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.277 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.277 issued rwts: total=3082,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.277 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.277 00:16:43.277 Run status group 0 (all jobs): 00:16:43.277 READ: bw=54.4MiB/s (57.1MB/s), 9.97MiB/s-20.9MiB/s (10.5MB/s-21.9MB/s), io=57.0MiB (59.8MB), run=1003-1047msec 00:16:43.277 WRITE: bw=59.6MiB/s (62.5MB/s), 11.2MiB/s-21.9MiB/s (11.8MB/s-23.0MB/s), io=62.4MiB (65.5MB), run=1003-1047msec 00:16:43.277 00:16:43.277 Disk stats (read/write): 00:16:43.277 nvme0n1: ios=4233/4608, merge=0/0, ticks=14913/16945, in_queue=31858, util=90.18% 00:16:43.277 nvme0n2: ios=3123/3263, merge=0/0, ticks=25882/29782, in_queue=55664, util=94.25% 00:16:43.277 nvme0n3: ios=1679/2048, merge=0/0, ticks=15089/11460, in_queue=26549, util=97.52% 00:16:43.277 nvme0n4: ios=2588/2807, merge=0/0, ticks=41310/58922, in_queue=100232, util=98.58% 00:16:43.277 19:15:01 -- target/fio.sh@55 -- # sync 00:16:43.277 19:15:01 -- target/fio.sh@59 -- # fio_pid=3448802 00:16:43.277 19:15:01 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:43.277 19:15:01 -- target/fio.sh@61 -- # sleep 3 00:16:43.277 [global] 00:16:43.277 thread=1 00:16:43.277 invalidate=1 00:16:43.277 rw=read 00:16:43.277 time_based=1 00:16:43.277 runtime=10 00:16:43.277 ioengine=libaio 00:16:43.277 direct=1 00:16:43.277 bs=4096 00:16:43.277 iodepth=1 00:16:43.277 norandommap=1 00:16:43.277 numjobs=1 00:16:43.277 00:16:43.277 [job0] 00:16:43.277 filename=/dev/nvme0n1 00:16:43.277 [job1] 00:16:43.277 filename=/dev/nvme0n2 00:16:43.277 [job2] 00:16:43.277 filename=/dev/nvme0n3 00:16:43.277 [job3] 00:16:43.277 filename=/dev/nvme0n4 00:16:43.277 Could not set queue depth (nvme0n1) 00:16:43.277 Could not set queue depth (nvme0n2) 00:16:43.277 Could not set queue depth (nvme0n3) 00:16:43.277 Could not set queue depth (nvme0n4) 00:16:43.277 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.277 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.277 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.277 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.277 fio-3.35 00:16:43.277 Starting 4 threads 00:16:46.558 19:15:04 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:46.558 19:15:04 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:46.558 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=1572864, buflen=4096 00:16:46.558 fio: pid=3448913, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:46.558 19:15:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:46.558 19:15:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:46.558 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=10547200, buflen=4096 00:16:46.558 fio: pid=3448912, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:46.816 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=63705088, buflen=4096 00:16:46.816 fio: pid=3448910, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:46.816 19:15:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:46.816 19:15:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:47.075 19:15:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.075 19:15:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:47.075 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=59518976, buflen=4096 00:16:47.075 fio: pid=3448911, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:47.334 00:16:47.334 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3448910: Mon Nov 18 19:15:05 2024 00:16:47.334 read: IOPS=4507, BW=17.6MiB/s (18.5MB/s)(60.8MiB/3451msec) 00:16:47.334 slat (usec): min=4, max=11875, avg=10.02, stdev=122.88 00:16:47.334 clat (usec): min=160, max=41505, avg=208.48, stdev=333.56 00:16:47.334 lat (usec): min=164, max=41511, avg=218.51, stdev=355.80 00:16:47.334 clat percentiles (usec): 00:16:47.334 | 1.00th=[ 172], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 188], 00:16:47.334 | 30.00th=[ 192], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 206], 00:16:47.334 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 231], 95.00th=[ 243], 00:16:47.334 | 99.00th=[ 306], 99.50th=[ 343], 99.90th=[ 537], 99.95th=[ 594], 00:16:47.334 | 99.99th=[ 3490] 00:16:47.334 bw ( KiB/s): min=17288, max=20040, per=52.86%, avg=18601.33, stdev=963.64, samples=6 00:16:47.334 iops : min= 4322, max= 5010, avg=4650.33, stdev=240.91, samples=6 00:16:47.334 lat (usec) : 250=96.01%, 500=3.75%, 750=0.21%, 1000=0.01% 00:16:47.334 lat (msec) : 4=0.01%, 50=0.01% 00:16:47.334 cpu : usr=1.45%, sys=4.43%, ctx=15560, majf=0, minf=2 00:16:47.334 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.334 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.334 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.334 issued rwts: total=15554,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.334 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.334 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3448911: Mon Nov 18 19:15:05 2024 00:16:47.334 read: IOPS=3869, BW=15.1MiB/s (15.8MB/s)(56.8MiB/3756msec) 00:16:47.334 slat (usec): min=4, max=15594, avg=13.20, stdev=219.41 00:16:47.334 clat (usec): min=161, max=41614, avg=242.25, stdev=593.69 00:16:47.334 lat (usec): min=166, max=41955, avg=255.45, stdev=637.50 00:16:47.334 clat percentiles (usec): 00:16:47.334 | 1.00th=[ 172], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 198], 00:16:47.334 | 30.00th=[ 212], 40.00th=[ 221], 50.00th=[ 229], 60.00th=[ 235], 00:16:47.334 | 70.00th=[ 245], 80.00th=[ 258], 90.00th=[ 277], 95.00th=[ 322], 00:16:47.334 | 99.00th=[ 416], 99.50th=[ 441], 99.90th=[ 498], 99.95th=[ 537], 00:16:47.334 | 99.99th=[41681] 00:16:47.334 bw ( KiB/s): min=13864, max=19432, per=44.98%, avg=15829.57, stdev=1762.67, samples=7 00:16:47.334 iops : min= 3466, max= 4858, avg=3957.29, stdev=440.65, samples=7 00:16:47.334 lat (usec) : 250=74.04%, 500=25.87%, 750=0.04%, 1000=0.01% 00:16:47.334 lat (msec) : 2=0.01%, 50=0.02% 00:16:47.334 cpu : usr=1.81%, sys=5.25%, ctx=14538, majf=0, minf=2 00:16:47.334 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.334 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.334 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.334 issued rwts: total=14532,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.334 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.334 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3448912: Mon Nov 18 19:15:05 2024 00:16:47.334 read: IOPS=806, BW=3226KiB/s (3303kB/s)(10.1MiB/3193msec) 00:16:47.334 slat (nsec): min=6484, max=49214, avg=13994.31, stdev=6176.26 00:16:47.334 clat (usec): min=199, max=42070, avg=1213.26, stdev=6177.87 00:16:47.334 lat (usec): min=207, max=42084, avg=1227.25, stdev=6178.57 00:16:47.334 clat percentiles (usec): 00:16:47.334 | 1.00th=[ 206], 5.00th=[ 212], 10.00th=[ 219], 20.00th=[ 227], 00:16:47.334 | 30.00th=[ 233], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 255], 00:16:47.334 | 70.00th=[ 265], 80.00th=[ 310], 90.00th=[ 371], 95.00th=[ 453], 00:16:47.334 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:47.334 | 99.99th=[42206] 00:16:47.334 bw ( KiB/s): min= 96, max=13472, per=9.74%, avg=3426.67, stdev=5368.10, samples=6 00:16:47.334 iops : min= 24, max= 3368, avg=856.67, stdev=1342.03, samples=6 00:16:47.334 lat (usec) : 250=54.70%, 500=42.51%, 750=0.43% 00:16:47.334 lat (msec) : 4=0.04%, 50=2.29% 00:16:47.334 cpu : usr=0.56%, sys=1.79%, ctx=2577, majf=0, minf=2 00:16:47.334 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.334 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.334 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.334 issued rwts: total=2576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.334 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.334 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3448913: Mon Nov 18 19:15:05 2024 00:16:47.334 read: IOPS=131, BW=526KiB/s (539kB/s)(1536KiB/2919msec) 00:16:47.334 slat (nsec): min=4810, max=43185, avg=8495.28, stdev=6462.97 00:16:47.334 clat (usec): min=177, max=42402, avg=7531.14, stdev=15807.37 00:16:47.334 lat (usec): min=182, max=42415, avg=7539.61, stdev=15812.68 00:16:47.334 clat percentiles (usec): 00:16:47.334 | 1.00th=[ 182], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 196], 00:16:47.334 | 30.00th=[ 200], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 212], 00:16:47.334 | 70.00th=[ 219], 80.00th=[ 277], 90.00th=[41681], 95.00th=[42206], 00:16:47.334 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:47.334 | 99.99th=[42206] 00:16:47.334 bw ( KiB/s): min= 96, max= 184, per=0.33%, avg=115.20, stdev=38.62, samples=5 00:16:47.334 iops : min= 24, max= 46, avg=28.80, stdev= 9.65, samples=5 00:16:47.334 lat (usec) : 250=78.18%, 500=3.90% 00:16:47.334 lat (msec) : 50=17.66% 00:16:47.334 cpu : usr=0.21%, sys=0.00%, ctx=385, majf=0, minf=1 00:16:47.335 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.335 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.335 complete : 0=0.3%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.335 issued rwts: total=385,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.335 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.335 00:16:47.335 Run status group 0 (all jobs): 00:16:47.335 READ: bw=34.4MiB/s (36.0MB/s), 526KiB/s-17.6MiB/s (539kB/s-18.5MB/s), io=129MiB (135MB), run=2919-3756msec 00:16:47.335 00:16:47.335 Disk stats (read/write): 00:16:47.335 nvme0n1: ios=15324/0, merge=0/0, ticks=4024/0, in_queue=4024, util=98.94% 00:16:47.335 nvme0n2: ios=14233/0, merge=0/0, ticks=3193/0, in_queue=3193, util=95.23% 00:16:47.335 nvme0n3: ios=2621/0, merge=0/0, ticks=4043/0, in_queue=4043, util=99.38% 00:16:47.335 nvme0n4: ios=382/0, merge=0/0, ticks=2811/0, in_queue=2811, util=96.71% 00:16:47.335 19:15:05 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.335 19:15:05 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:47.901 19:15:06 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.901 19:15:06 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:47.901 19:15:06 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.901 19:15:06 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:48.159 19:15:06 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.159 19:15:06 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:48.417 19:15:06 -- target/fio.sh@69 -- # fio_status=0 00:16:48.417 19:15:06 -- target/fio.sh@70 -- # wait 3448802 00:16:48.417 19:15:06 -- target/fio.sh@70 -- # fio_status=4 00:16:48.417 19:15:06 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:48.675 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:48.675 19:15:07 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:48.675 19:15:07 -- common/autotest_common.sh@1208 -- # local i=0 00:16:48.675 19:15:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:48.675 19:15:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:48.675 19:15:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:48.675 19:15:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:48.675 19:15:07 -- common/autotest_common.sh@1220 -- # return 0 00:16:48.675 19:15:07 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:48.675 19:15:07 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:48.675 nvmf hotplug test: fio failed as expected 00:16:48.675 19:15:07 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:48.934 19:15:07 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:48.934 19:15:07 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:48.934 19:15:07 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:48.934 19:15:07 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:48.934 19:15:07 -- target/fio.sh@91 -- # nvmftestfini 00:16:48.934 19:15:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:48.934 19:15:07 -- nvmf/common.sh@116 -- # sync 00:16:48.934 19:15:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:48.934 19:15:07 -- nvmf/common.sh@119 -- # set +e 00:16:48.934 19:15:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:48.934 19:15:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:48.934 rmmod nvme_tcp 00:16:48.934 rmmod nvme_fabrics 00:16:48.934 rmmod nvme_keyring 00:16:48.934 19:15:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:48.934 19:15:07 -- nvmf/common.sh@123 -- # set -e 00:16:48.934 19:15:07 -- nvmf/common.sh@124 -- # return 0 00:16:48.934 19:15:07 -- nvmf/common.sh@477 -- # '[' -n 3446621 ']' 00:16:48.934 19:15:07 -- nvmf/common.sh@478 -- # killprocess 3446621 00:16:48.934 19:15:07 -- common/autotest_common.sh@936 -- # '[' -z 3446621 ']' 00:16:48.934 19:15:07 -- common/autotest_common.sh@940 -- # kill -0 3446621 00:16:48.934 19:15:07 -- common/autotest_common.sh@941 -- # uname 00:16:48.934 19:15:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:48.934 19:15:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3446621 00:16:49.192 19:15:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:49.192 19:15:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:49.192 19:15:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3446621' 00:16:49.192 killing process with pid 3446621 00:16:49.192 19:15:07 -- common/autotest_common.sh@955 -- # kill 3446621 00:16:49.192 19:15:07 -- common/autotest_common.sh@960 -- # wait 3446621 00:16:49.451 19:15:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:49.451 19:15:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:49.451 19:15:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:49.451 19:15:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:49.451 19:15:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:49.451 19:15:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:49.451 19:15:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:49.451 19:15:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:51.350 19:15:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:51.350 00:16:51.350 real 0m24.657s 00:16:51.350 user 1m26.068s 00:16:51.350 sys 0m6.992s 00:16:51.350 19:15:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:51.350 19:15:09 -- common/autotest_common.sh@10 -- # set +x 00:16:51.350 ************************************ 00:16:51.350 END TEST nvmf_fio_target 00:16:51.350 ************************************ 00:16:51.350 19:15:09 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:51.350 19:15:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:51.350 19:15:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:51.350 19:15:09 -- common/autotest_common.sh@10 -- # set +x 00:16:51.350 ************************************ 00:16:51.350 START TEST nvmf_bdevio 00:16:51.350 ************************************ 00:16:51.350 19:15:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:51.350 * Looking for test storage... 00:16:51.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:51.350 19:15:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:51.350 19:15:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:51.350 19:15:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:51.609 19:15:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:51.609 19:15:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:51.609 19:15:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:51.609 19:15:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:51.609 19:15:10 -- scripts/common.sh@335 -- # IFS=.-: 00:16:51.609 19:15:10 -- scripts/common.sh@335 -- # read -ra ver1 00:16:51.609 19:15:10 -- scripts/common.sh@336 -- # IFS=.-: 00:16:51.609 19:15:10 -- scripts/common.sh@336 -- # read -ra ver2 00:16:51.609 19:15:10 -- scripts/common.sh@337 -- # local 'op=<' 00:16:51.609 19:15:10 -- scripts/common.sh@339 -- # ver1_l=2 00:16:51.609 19:15:10 -- scripts/common.sh@340 -- # ver2_l=1 00:16:51.609 19:15:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:51.609 19:15:10 -- scripts/common.sh@343 -- # case "$op" in 00:16:51.609 19:15:10 -- scripts/common.sh@344 -- # : 1 00:16:51.609 19:15:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:51.609 19:15:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:51.609 19:15:10 -- scripts/common.sh@364 -- # decimal 1 00:16:51.609 19:15:10 -- scripts/common.sh@352 -- # local d=1 00:16:51.610 19:15:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:51.610 19:15:10 -- scripts/common.sh@354 -- # echo 1 00:16:51.610 19:15:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:51.610 19:15:10 -- scripts/common.sh@365 -- # decimal 2 00:16:51.610 19:15:10 -- scripts/common.sh@352 -- # local d=2 00:16:51.610 19:15:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:51.610 19:15:10 -- scripts/common.sh@354 -- # echo 2 00:16:51.610 19:15:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:51.610 19:15:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:51.610 19:15:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:51.610 19:15:10 -- scripts/common.sh@367 -- # return 0 00:16:51.610 19:15:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:51.610 19:15:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:51.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:51.610 --rc genhtml_branch_coverage=1 00:16:51.610 --rc genhtml_function_coverage=1 00:16:51.610 --rc genhtml_legend=1 00:16:51.610 --rc geninfo_all_blocks=1 00:16:51.610 --rc geninfo_unexecuted_blocks=1 00:16:51.610 00:16:51.610 ' 00:16:51.610 19:15:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:51.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:51.610 --rc genhtml_branch_coverage=1 00:16:51.610 --rc genhtml_function_coverage=1 00:16:51.610 --rc genhtml_legend=1 00:16:51.610 --rc geninfo_all_blocks=1 00:16:51.610 --rc geninfo_unexecuted_blocks=1 00:16:51.610 00:16:51.610 ' 00:16:51.610 19:15:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:51.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:51.610 --rc genhtml_branch_coverage=1 00:16:51.610 --rc genhtml_function_coverage=1 00:16:51.610 --rc genhtml_legend=1 00:16:51.610 --rc geninfo_all_blocks=1 00:16:51.610 --rc geninfo_unexecuted_blocks=1 00:16:51.610 00:16:51.610 ' 00:16:51.610 19:15:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:51.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:51.610 --rc genhtml_branch_coverage=1 00:16:51.610 --rc genhtml_function_coverage=1 00:16:51.610 --rc genhtml_legend=1 00:16:51.610 --rc geninfo_all_blocks=1 00:16:51.610 --rc geninfo_unexecuted_blocks=1 00:16:51.610 00:16:51.610 ' 00:16:51.610 19:15:10 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:51.610 19:15:10 -- nvmf/common.sh@7 -- # uname -s 00:16:51.610 19:15:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:51.610 19:15:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:51.610 19:15:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:51.610 19:15:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:51.610 19:15:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:51.610 19:15:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:51.610 19:15:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:51.610 19:15:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:51.610 19:15:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:51.610 19:15:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:51.610 19:15:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:51.610 19:15:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:51.610 19:15:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:51.610 19:15:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:51.610 19:15:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:51.610 19:15:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:51.610 19:15:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:51.610 19:15:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:51.610 19:15:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:51.610 19:15:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.610 19:15:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.610 19:15:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.610 19:15:10 -- paths/export.sh@5 -- # export PATH 00:16:51.610 19:15:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.610 19:15:10 -- nvmf/common.sh@46 -- # : 0 00:16:51.610 19:15:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:51.610 19:15:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:51.610 19:15:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:51.610 19:15:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:51.610 19:15:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:51.610 19:15:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:51.610 19:15:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:51.610 19:15:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:51.610 19:15:10 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:51.610 19:15:10 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:51.610 19:15:10 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:51.610 19:15:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:51.610 19:15:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:51.610 19:15:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:51.610 19:15:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:51.610 19:15:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:51.610 19:15:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:51.610 19:15:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:51.610 19:15:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:51.610 19:15:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:51.610 19:15:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:51.610 19:15:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:51.610 19:15:10 -- common/autotest_common.sh@10 -- # set +x 00:16:53.512 19:15:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:53.512 19:15:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:53.512 19:15:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:53.512 19:15:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:53.512 19:15:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:53.512 19:15:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:53.512 19:15:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:53.512 19:15:12 -- nvmf/common.sh@294 -- # net_devs=() 00:16:53.512 19:15:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:53.512 19:15:12 -- nvmf/common.sh@295 -- # e810=() 00:16:53.512 19:15:12 -- nvmf/common.sh@295 -- # local -ga e810 00:16:53.512 19:15:12 -- nvmf/common.sh@296 -- # x722=() 00:16:53.512 19:15:12 -- nvmf/common.sh@296 -- # local -ga x722 00:16:53.512 19:15:12 -- nvmf/common.sh@297 -- # mlx=() 00:16:53.512 19:15:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:53.512 19:15:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:53.512 19:15:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:53.512 19:15:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:53.512 19:15:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:53.512 19:15:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:53.512 19:15:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:53.512 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:53.512 19:15:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:53.512 19:15:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:53.512 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:53.512 19:15:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:53.512 19:15:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:53.512 19:15:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:53.512 19:15:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:53.512 19:15:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:53.512 19:15:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:53.512 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:53.512 19:15:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:53.512 19:15:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:53.512 19:15:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:53.512 19:15:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:53.512 19:15:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:53.512 19:15:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:53.512 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:53.512 19:15:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:53.512 19:15:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:53.512 19:15:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:53.512 19:15:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:53.512 19:15:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:53.512 19:15:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:53.512 19:15:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:53.512 19:15:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:53.512 19:15:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:53.512 19:15:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:53.512 19:15:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:53.512 19:15:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:53.512 19:15:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:53.512 19:15:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:53.512 19:15:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:53.512 19:15:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:53.512 19:15:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:53.512 19:15:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:53.771 19:15:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:53.771 19:15:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:53.771 19:15:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:53.771 19:15:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:53.771 19:15:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:53.771 19:15:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:53.771 19:15:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:53.771 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:53.771 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:16:53.771 00:16:53.771 --- 10.0.0.2 ping statistics --- 00:16:53.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:53.771 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:16:53.771 19:15:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:53.771 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:53.771 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:16:53.771 00:16:53.771 --- 10.0.0.1 ping statistics --- 00:16:53.771 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:53.771 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:16:53.771 19:15:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:53.771 19:15:12 -- nvmf/common.sh@410 -- # return 0 00:16:53.771 19:15:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:53.771 19:15:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:53.771 19:15:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:53.771 19:15:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:53.771 19:15:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:53.771 19:15:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:53.771 19:15:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:53.771 19:15:12 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:53.771 19:15:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:53.771 19:15:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:53.771 19:15:12 -- common/autotest_common.sh@10 -- # set +x 00:16:53.771 19:15:12 -- nvmf/common.sh@469 -- # nvmfpid=3452085 00:16:53.771 19:15:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:53.771 19:15:12 -- nvmf/common.sh@470 -- # waitforlisten 3452085 00:16:53.771 19:15:12 -- common/autotest_common.sh@829 -- # '[' -z 3452085 ']' 00:16:53.771 19:15:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:53.771 19:15:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:53.771 19:15:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:53.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:53.771 19:15:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:53.771 19:15:12 -- common/autotest_common.sh@10 -- # set +x 00:16:53.771 [2024-11-18 19:15:12.279403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:53.771 [2024-11-18 19:15:12.279469] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:53.771 EAL: No free 2048 kB hugepages reported on node 1 00:16:53.771 [2024-11-18 19:15:12.346687] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:54.029 [2024-11-18 19:15:12.471350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:54.029 [2024-11-18 19:15:12.471506] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:54.029 [2024-11-18 19:15:12.471526] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:54.029 [2024-11-18 19:15:12.471542] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:54.029 [2024-11-18 19:15:12.471633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:54.029 [2024-11-18 19:15:12.471688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:54.029 [2024-11-18 19:15:12.471745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:54.029 [2024-11-18 19:15:12.471748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:54.961 19:15:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:54.961 19:15:13 -- common/autotest_common.sh@862 -- # return 0 00:16:54.961 19:15:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:54.961 19:15:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:54.961 19:15:13 -- common/autotest_common.sh@10 -- # set +x 00:16:54.961 19:15:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:54.961 19:15:13 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:54.961 19:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.961 19:15:13 -- common/autotest_common.sh@10 -- # set +x 00:16:54.961 [2024-11-18 19:15:13.280162] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:54.961 19:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.961 19:15:13 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:54.961 19:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.961 19:15:13 -- common/autotest_common.sh@10 -- # set +x 00:16:54.961 Malloc0 00:16:54.961 19:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.961 19:15:13 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:54.961 19:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.961 19:15:13 -- common/autotest_common.sh@10 -- # set +x 00:16:54.961 19:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.961 19:15:13 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:54.961 19:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.961 19:15:13 -- common/autotest_common.sh@10 -- # set +x 00:16:54.962 19:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.962 19:15:13 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:54.962 19:15:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:54.962 19:15:13 -- common/autotest_common.sh@10 -- # set +x 00:16:54.962 [2024-11-18 19:15:13.333528] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:54.962 19:15:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:54.962 19:15:13 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:54.962 19:15:13 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:54.962 19:15:13 -- nvmf/common.sh@520 -- # config=() 00:16:54.962 19:15:13 -- nvmf/common.sh@520 -- # local subsystem config 00:16:54.962 19:15:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:54.962 19:15:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:54.962 { 00:16:54.962 "params": { 00:16:54.962 "name": "Nvme$subsystem", 00:16:54.962 "trtype": "$TEST_TRANSPORT", 00:16:54.962 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:54.962 "adrfam": "ipv4", 00:16:54.962 "trsvcid": "$NVMF_PORT", 00:16:54.962 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:54.962 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:54.962 "hdgst": ${hdgst:-false}, 00:16:54.962 "ddgst": ${ddgst:-false} 00:16:54.962 }, 00:16:54.962 "method": "bdev_nvme_attach_controller" 00:16:54.962 } 00:16:54.962 EOF 00:16:54.962 )") 00:16:54.962 19:15:13 -- nvmf/common.sh@542 -- # cat 00:16:54.962 19:15:13 -- nvmf/common.sh@544 -- # jq . 00:16:54.962 19:15:13 -- nvmf/common.sh@545 -- # IFS=, 00:16:54.962 19:15:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:54.962 "params": { 00:16:54.962 "name": "Nvme1", 00:16:54.962 "trtype": "tcp", 00:16:54.962 "traddr": "10.0.0.2", 00:16:54.962 "adrfam": "ipv4", 00:16:54.962 "trsvcid": "4420", 00:16:54.962 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:54.962 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:54.962 "hdgst": false, 00:16:54.962 "ddgst": false 00:16:54.962 }, 00:16:54.962 "method": "bdev_nvme_attach_controller" 00:16:54.962 }' 00:16:54.962 [2024-11-18 19:15:13.376397] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:54.962 [2024-11-18 19:15:13.376478] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3452242 ] 00:16:54.962 EAL: No free 2048 kB hugepages reported on node 1 00:16:54.962 [2024-11-18 19:15:13.436267] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:54.962 [2024-11-18 19:15:13.548040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:54.962 [2024-11-18 19:15:13.548089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:54.962 [2024-11-18 19:15:13.548092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:55.219 [2024-11-18 19:15:13.755971] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:55.219 [2024-11-18 19:15:13.756023] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:55.219 I/O targets: 00:16:55.219 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:55.219 00:16:55.219 00:16:55.220 CUnit - A unit testing framework for C - Version 2.1-3 00:16:55.220 http://cunit.sourceforge.net/ 00:16:55.220 00:16:55.220 00:16:55.220 Suite: bdevio tests on: Nvme1n1 00:16:55.220 Test: blockdev write read block ...passed 00:16:55.478 Test: blockdev write zeroes read block ...passed 00:16:55.478 Test: blockdev write zeroes read no split ...passed 00:16:55.478 Test: blockdev write zeroes read split ...passed 00:16:55.478 Test: blockdev write zeroes read split partial ...passed 00:16:55.478 Test: blockdev reset ...[2024-11-18 19:15:13.907465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:55.478 [2024-11-18 19:15:13.907566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17dff20 (9): Bad file descriptor 00:16:55.478 [2024-11-18 19:15:13.965500] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:55.478 passed 00:16:55.478 Test: blockdev write read 8 blocks ...passed 00:16:55.478 Test: blockdev write read size > 128k ...passed 00:16:55.478 Test: blockdev write read invalid size ...passed 00:16:55.478 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:55.478 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:55.478 Test: blockdev write read max offset ...passed 00:16:55.735 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:55.735 Test: blockdev writev readv 8 blocks ...passed 00:16:55.735 Test: blockdev writev readv 30 x 1block ...passed 00:16:55.736 Test: blockdev writev readv block ...passed 00:16:55.736 Test: blockdev writev readv size > 128k ...passed 00:16:55.736 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:55.736 Test: blockdev comparev and writev ...[2024-11-18 19:15:14.299738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.299775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.299799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.299817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.300177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.300201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.300222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.300239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.300581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.300613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.300638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.300663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.301005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.301030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:55.736 [2024-11-18 19:15:14.301051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:55.736 [2024-11-18 19:15:14.301066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:55.993 passed 00:16:55.993 Test: blockdev nvme passthru rw ...passed 00:16:55.993 Test: blockdev nvme passthru vendor specific ...[2024-11-18 19:15:14.382877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:55.993 [2024-11-18 19:15:14.382909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:55.993 [2024-11-18 19:15:14.383063] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:55.994 [2024-11-18 19:15:14.383087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:55.994 [2024-11-18 19:15:14.383229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:55.994 [2024-11-18 19:15:14.383252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:55.994 [2024-11-18 19:15:14.383397] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:55.994 [2024-11-18 19:15:14.383420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:55.994 passed 00:16:55.994 Test: blockdev nvme admin passthru ...passed 00:16:55.994 Test: blockdev copy ...passed 00:16:55.994 00:16:55.994 Run Summary: Type Total Ran Passed Failed Inactive 00:16:55.994 suites 1 1 n/a 0 0 00:16:55.994 tests 23 23 23 0 0 00:16:55.994 asserts 152 152 152 0 n/a 00:16:55.994 00:16:55.994 Elapsed time = 1.365 seconds 00:16:56.251 19:15:14 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:56.251 19:15:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.251 19:15:14 -- common/autotest_common.sh@10 -- # set +x 00:16:56.251 19:15:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.251 19:15:14 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:56.251 19:15:14 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:56.251 19:15:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:56.251 19:15:14 -- nvmf/common.sh@116 -- # sync 00:16:56.251 19:15:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:56.251 19:15:14 -- nvmf/common.sh@119 -- # set +e 00:16:56.251 19:15:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:56.251 19:15:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:56.251 rmmod nvme_tcp 00:16:56.251 rmmod nvme_fabrics 00:16:56.251 rmmod nvme_keyring 00:16:56.251 19:15:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:56.251 19:15:14 -- nvmf/common.sh@123 -- # set -e 00:16:56.251 19:15:14 -- nvmf/common.sh@124 -- # return 0 00:16:56.251 19:15:14 -- nvmf/common.sh@477 -- # '[' -n 3452085 ']' 00:16:56.251 19:15:14 -- nvmf/common.sh@478 -- # killprocess 3452085 00:16:56.251 19:15:14 -- common/autotest_common.sh@936 -- # '[' -z 3452085 ']' 00:16:56.251 19:15:14 -- common/autotest_common.sh@940 -- # kill -0 3452085 00:16:56.251 19:15:14 -- common/autotest_common.sh@941 -- # uname 00:16:56.251 19:15:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:56.251 19:15:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3452085 00:16:56.251 19:15:14 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:56.251 19:15:14 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:56.251 19:15:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3452085' 00:16:56.251 killing process with pid 3452085 00:16:56.251 19:15:14 -- common/autotest_common.sh@955 -- # kill 3452085 00:16:56.251 19:15:14 -- common/autotest_common.sh@960 -- # wait 3452085 00:16:56.509 19:15:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:56.509 19:15:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:56.509 19:15:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:56.509 19:15:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:56.509 19:15:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:56.509 19:15:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:56.509 19:15:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:56.509 19:15:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.052 19:15:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:59.053 00:16:59.053 real 0m7.256s 00:16:59.053 user 0m13.749s 00:16:59.053 sys 0m2.131s 00:16:59.053 19:15:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:59.053 19:15:17 -- common/autotest_common.sh@10 -- # set +x 00:16:59.053 ************************************ 00:16:59.053 END TEST nvmf_bdevio 00:16:59.053 ************************************ 00:16:59.053 19:15:17 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:59.053 19:15:17 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:59.053 19:15:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:59.053 19:15:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:59.053 19:15:17 -- common/autotest_common.sh@10 -- # set +x 00:16:59.053 ************************************ 00:16:59.053 START TEST nvmf_bdevio_no_huge 00:16:59.053 ************************************ 00:16:59.053 19:15:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:59.053 * Looking for test storage... 00:16:59.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:59.053 19:15:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:59.053 19:15:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:59.053 19:15:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:59.053 19:15:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:59.053 19:15:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:59.053 19:15:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:59.053 19:15:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:59.053 19:15:17 -- scripts/common.sh@335 -- # IFS=.-: 00:16:59.053 19:15:17 -- scripts/common.sh@335 -- # read -ra ver1 00:16:59.054 19:15:17 -- scripts/common.sh@336 -- # IFS=.-: 00:16:59.054 19:15:17 -- scripts/common.sh@336 -- # read -ra ver2 00:16:59.054 19:15:17 -- scripts/common.sh@337 -- # local 'op=<' 00:16:59.054 19:15:17 -- scripts/common.sh@339 -- # ver1_l=2 00:16:59.054 19:15:17 -- scripts/common.sh@340 -- # ver2_l=1 00:16:59.054 19:15:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:59.054 19:15:17 -- scripts/common.sh@343 -- # case "$op" in 00:16:59.054 19:15:17 -- scripts/common.sh@344 -- # : 1 00:16:59.054 19:15:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:59.054 19:15:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:59.054 19:15:17 -- scripts/common.sh@364 -- # decimal 1 00:16:59.054 19:15:17 -- scripts/common.sh@352 -- # local d=1 00:16:59.054 19:15:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:59.054 19:15:17 -- scripts/common.sh@354 -- # echo 1 00:16:59.054 19:15:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:59.054 19:15:17 -- scripts/common.sh@365 -- # decimal 2 00:16:59.054 19:15:17 -- scripts/common.sh@352 -- # local d=2 00:16:59.054 19:15:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:59.054 19:15:17 -- scripts/common.sh@354 -- # echo 2 00:16:59.054 19:15:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:59.054 19:15:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:59.054 19:15:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:59.054 19:15:17 -- scripts/common.sh@367 -- # return 0 00:16:59.054 19:15:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:59.054 19:15:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:59.055 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.055 --rc genhtml_branch_coverage=1 00:16:59.055 --rc genhtml_function_coverage=1 00:16:59.055 --rc genhtml_legend=1 00:16:59.055 --rc geninfo_all_blocks=1 00:16:59.055 --rc geninfo_unexecuted_blocks=1 00:16:59.055 00:16:59.055 ' 00:16:59.055 19:15:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:59.055 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.055 --rc genhtml_branch_coverage=1 00:16:59.055 --rc genhtml_function_coverage=1 00:16:59.055 --rc genhtml_legend=1 00:16:59.055 --rc geninfo_all_blocks=1 00:16:59.055 --rc geninfo_unexecuted_blocks=1 00:16:59.055 00:16:59.055 ' 00:16:59.055 19:15:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:59.055 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.055 --rc genhtml_branch_coverage=1 00:16:59.055 --rc genhtml_function_coverage=1 00:16:59.055 --rc genhtml_legend=1 00:16:59.055 --rc geninfo_all_blocks=1 00:16:59.055 --rc geninfo_unexecuted_blocks=1 00:16:59.055 00:16:59.055 ' 00:16:59.055 19:15:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:59.055 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.055 --rc genhtml_branch_coverage=1 00:16:59.055 --rc genhtml_function_coverage=1 00:16:59.055 --rc genhtml_legend=1 00:16:59.055 --rc geninfo_all_blocks=1 00:16:59.055 --rc geninfo_unexecuted_blocks=1 00:16:59.055 00:16:59.055 ' 00:16:59.055 19:15:17 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:59.056 19:15:17 -- nvmf/common.sh@7 -- # uname -s 00:16:59.056 19:15:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:59.056 19:15:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:59.056 19:15:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:59.056 19:15:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:59.056 19:15:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:59.056 19:15:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:59.056 19:15:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:59.056 19:15:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:59.056 19:15:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:59.056 19:15:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:59.056 19:15:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.056 19:15:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.056 19:15:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:59.056 19:15:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:59.056 19:15:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:59.056 19:15:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:59.056 19:15:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:59.056 19:15:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:59.056 19:15:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:59.056 19:15:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.056 19:15:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.056 19:15:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.056 19:15:17 -- paths/export.sh@5 -- # export PATH 00:16:59.057 19:15:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.057 19:15:17 -- nvmf/common.sh@46 -- # : 0 00:16:59.057 19:15:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:59.057 19:15:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:59.057 19:15:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:59.057 19:15:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:59.057 19:15:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:59.057 19:15:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:59.057 19:15:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:59.057 19:15:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:59.057 19:15:17 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:59.057 19:15:17 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:59.057 19:15:17 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:59.057 19:15:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:59.057 19:15:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:59.057 19:15:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:59.057 19:15:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:59.057 19:15:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:59.057 19:15:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:59.057 19:15:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:59.057 19:15:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.057 19:15:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:59.057 19:15:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:59.057 19:15:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:59.057 19:15:17 -- common/autotest_common.sh@10 -- # set +x 00:17:00.967 19:15:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:00.967 19:15:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:00.967 19:15:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:00.967 19:15:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:00.967 19:15:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:00.967 19:15:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:00.967 19:15:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:00.967 19:15:19 -- nvmf/common.sh@294 -- # net_devs=() 00:17:00.967 19:15:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:00.967 19:15:19 -- nvmf/common.sh@295 -- # e810=() 00:17:00.967 19:15:19 -- nvmf/common.sh@295 -- # local -ga e810 00:17:00.967 19:15:19 -- nvmf/common.sh@296 -- # x722=() 00:17:00.967 19:15:19 -- nvmf/common.sh@296 -- # local -ga x722 00:17:00.967 19:15:19 -- nvmf/common.sh@297 -- # mlx=() 00:17:00.967 19:15:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:00.967 19:15:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:00.967 19:15:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:00.967 19:15:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:00.967 19:15:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:00.967 19:15:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:00.967 19:15:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:00.967 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:00.967 19:15:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:00.967 19:15:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:00.967 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:00.967 19:15:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:00.967 19:15:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:00.967 19:15:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:00.967 19:15:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:00.967 19:15:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:00.967 19:15:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:00.967 19:15:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:00.967 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:00.967 19:15:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:00.967 19:15:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:00.967 19:15:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:00.967 19:15:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:00.967 19:15:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:00.967 19:15:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:00.968 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:00.968 19:15:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:00.968 19:15:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:00.968 19:15:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:00.968 19:15:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:00.968 19:15:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:00.968 19:15:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:00.968 19:15:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:00.968 19:15:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:00.968 19:15:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:00.968 19:15:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:00.968 19:15:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:00.968 19:15:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:00.968 19:15:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:00.968 19:15:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:00.968 19:15:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:00.968 19:15:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:00.968 19:15:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:00.968 19:15:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:00.968 19:15:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:00.968 19:15:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:00.968 19:15:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:00.968 19:15:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:00.968 19:15:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:00.968 19:15:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:00.968 19:15:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:00.968 19:15:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:00.968 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:00.968 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:17:00.968 00:17:00.968 --- 10.0.0.2 ping statistics --- 00:17:00.968 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:00.968 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:17:00.968 19:15:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:00.968 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:00.968 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:17:00.968 00:17:00.968 --- 10.0.0.1 ping statistics --- 00:17:00.968 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:00.968 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:17:00.968 19:15:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:00.968 19:15:19 -- nvmf/common.sh@410 -- # return 0 00:17:00.968 19:15:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:00.968 19:15:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:00.968 19:15:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:00.968 19:15:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:00.968 19:15:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:00.968 19:15:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:00.968 19:15:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:00.968 19:15:19 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:00.968 19:15:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:00.968 19:15:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:00.968 19:15:19 -- common/autotest_common.sh@10 -- # set +x 00:17:00.968 19:15:19 -- nvmf/common.sh@469 -- # nvmfpid=3454451 00:17:00.968 19:15:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:00.968 19:15:19 -- nvmf/common.sh@470 -- # waitforlisten 3454451 00:17:00.968 19:15:19 -- common/autotest_common.sh@829 -- # '[' -z 3454451 ']' 00:17:00.968 19:15:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:00.968 19:15:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:00.968 19:15:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:00.968 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:00.968 19:15:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:00.968 19:15:19 -- common/autotest_common.sh@10 -- # set +x 00:17:00.968 [2024-11-18 19:15:19.532908] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.968 [2024-11-18 19:15:19.533014] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:01.226 [2024-11-18 19:15:19.606648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:01.226 [2024-11-18 19:15:19.727720] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:01.226 [2024-11-18 19:15:19.727897] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:01.226 [2024-11-18 19:15:19.727918] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:01.226 [2024-11-18 19:15:19.727933] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:01.226 [2024-11-18 19:15:19.728021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:01.226 [2024-11-18 19:15:19.728087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:01.226 [2024-11-18 19:15:19.728141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:01.226 [2024-11-18 19:15:19.728144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:02.159 19:15:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.159 19:15:20 -- common/autotest_common.sh@862 -- # return 0 00:17:02.159 19:15:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:02.159 19:15:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:02.159 19:15:20 -- common/autotest_common.sh@10 -- # set +x 00:17:02.159 19:15:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:02.159 19:15:20 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:02.159 19:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.159 19:15:20 -- common/autotest_common.sh@10 -- # set +x 00:17:02.159 [2024-11-18 19:15:20.526722] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:02.159 19:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.159 19:15:20 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:02.159 19:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.159 19:15:20 -- common/autotest_common.sh@10 -- # set +x 00:17:02.159 Malloc0 00:17:02.159 19:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.159 19:15:20 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:02.159 19:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.159 19:15:20 -- common/autotest_common.sh@10 -- # set +x 00:17:02.159 19:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.159 19:15:20 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:02.159 19:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.159 19:15:20 -- common/autotest_common.sh@10 -- # set +x 00:17:02.159 19:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.159 19:15:20 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:02.159 19:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.159 19:15:20 -- common/autotest_common.sh@10 -- # set +x 00:17:02.159 [2024-11-18 19:15:20.565185] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:02.159 19:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.159 19:15:20 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:02.159 19:15:20 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:02.159 19:15:20 -- nvmf/common.sh@520 -- # config=() 00:17:02.159 19:15:20 -- nvmf/common.sh@520 -- # local subsystem config 00:17:02.159 19:15:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:02.159 19:15:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:02.159 { 00:17:02.159 "params": { 00:17:02.159 "name": "Nvme$subsystem", 00:17:02.159 "trtype": "$TEST_TRANSPORT", 00:17:02.159 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:02.159 "adrfam": "ipv4", 00:17:02.159 "trsvcid": "$NVMF_PORT", 00:17:02.159 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:02.159 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:02.159 "hdgst": ${hdgst:-false}, 00:17:02.159 "ddgst": ${ddgst:-false} 00:17:02.159 }, 00:17:02.159 "method": "bdev_nvme_attach_controller" 00:17:02.159 } 00:17:02.159 EOF 00:17:02.159 )") 00:17:02.159 19:15:20 -- nvmf/common.sh@542 -- # cat 00:17:02.159 19:15:20 -- nvmf/common.sh@544 -- # jq . 00:17:02.159 19:15:20 -- nvmf/common.sh@545 -- # IFS=, 00:17:02.159 19:15:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:02.159 "params": { 00:17:02.159 "name": "Nvme1", 00:17:02.159 "trtype": "tcp", 00:17:02.159 "traddr": "10.0.0.2", 00:17:02.159 "adrfam": "ipv4", 00:17:02.159 "trsvcid": "4420", 00:17:02.159 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:02.159 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:02.159 "hdgst": false, 00:17:02.159 "ddgst": false 00:17:02.159 }, 00:17:02.160 "method": "bdev_nvme_attach_controller" 00:17:02.160 }' 00:17:02.160 [2024-11-18 19:15:20.608186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.160 [2024-11-18 19:15:20.608255] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3454613 ] 00:17:02.160 [2024-11-18 19:15:20.674217] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:02.417 [2024-11-18 19:15:20.789743] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:02.417 [2024-11-18 19:15:20.789795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:02.417 [2024-11-18 19:15:20.789798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:02.417 [2024-11-18 19:15:20.949627] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:02.417 [2024-11-18 19:15:20.949684] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:02.417 I/O targets: 00:17:02.417 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:02.417 00:17:02.417 00:17:02.417 CUnit - A unit testing framework for C - Version 2.1-3 00:17:02.417 http://cunit.sourceforge.net/ 00:17:02.417 00:17:02.417 00:17:02.417 Suite: bdevio tests on: Nvme1n1 00:17:02.417 Test: blockdev write read block ...passed 00:17:02.675 Test: blockdev write zeroes read block ...passed 00:17:02.675 Test: blockdev write zeroes read no split ...passed 00:17:02.675 Test: blockdev write zeroes read split ...passed 00:17:02.675 Test: blockdev write zeroes read split partial ...passed 00:17:02.675 Test: blockdev reset ...[2024-11-18 19:15:21.150979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:02.675 [2024-11-18 19:15:21.151090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bfd7d0 (9): Bad file descriptor 00:17:02.675 [2024-11-18 19:15:21.169119] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:02.675 passed 00:17:02.675 Test: blockdev write read 8 blocks ...passed 00:17:02.675 Test: blockdev write read size > 128k ...passed 00:17:02.675 Test: blockdev write read invalid size ...passed 00:17:02.675 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:02.675 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:02.675 Test: blockdev write read max offset ...passed 00:17:02.933 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:02.933 Test: blockdev writev readv 8 blocks ...passed 00:17:02.933 Test: blockdev writev readv 30 x 1block ...passed 00:17:02.933 Test: blockdev writev readv block ...passed 00:17:02.933 Test: blockdev writev readv size > 128k ...passed 00:17:02.933 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:02.933 Test: blockdev comparev and writev ...[2024-11-18 19:15:21.421976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.422016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.422040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.422058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.422387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.422411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.422434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.422451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.422775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.422800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.422822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.422838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.423167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.423191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.423219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:02.933 [2024-11-18 19:15:21.423236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:02.933 passed 00:17:02.933 Test: blockdev nvme passthru rw ...passed 00:17:02.933 Test: blockdev nvme passthru vendor specific ...[2024-11-18 19:15:21.504862] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:02.933 [2024-11-18 19:15:21.504892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.505035] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:02.933 [2024-11-18 19:15:21.505058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.505189] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:02.933 [2024-11-18 19:15:21.505213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:02.933 [2024-11-18 19:15:21.505353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:02.933 [2024-11-18 19:15:21.505376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:02.933 passed 00:17:02.933 Test: blockdev nvme admin passthru ...passed 00:17:03.190 Test: blockdev copy ...passed 00:17:03.190 00:17:03.190 Run Summary: Type Total Ran Passed Failed Inactive 00:17:03.190 suites 1 1 n/a 0 0 00:17:03.190 tests 23 23 23 0 0 00:17:03.190 asserts 152 152 152 0 n/a 00:17:03.190 00:17:03.190 Elapsed time = 1.226 seconds 00:17:03.447 19:15:21 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:03.447 19:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.447 19:15:21 -- common/autotest_common.sh@10 -- # set +x 00:17:03.447 19:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.447 19:15:21 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:03.447 19:15:21 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:03.447 19:15:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:03.447 19:15:21 -- nvmf/common.sh@116 -- # sync 00:17:03.447 19:15:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:03.447 19:15:21 -- nvmf/common.sh@119 -- # set +e 00:17:03.447 19:15:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:03.447 19:15:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:03.447 rmmod nvme_tcp 00:17:03.447 rmmod nvme_fabrics 00:17:03.447 rmmod nvme_keyring 00:17:03.447 19:15:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:03.447 19:15:21 -- nvmf/common.sh@123 -- # set -e 00:17:03.447 19:15:21 -- nvmf/common.sh@124 -- # return 0 00:17:03.447 19:15:21 -- nvmf/common.sh@477 -- # '[' -n 3454451 ']' 00:17:03.447 19:15:21 -- nvmf/common.sh@478 -- # killprocess 3454451 00:17:03.447 19:15:21 -- common/autotest_common.sh@936 -- # '[' -z 3454451 ']' 00:17:03.447 19:15:21 -- common/autotest_common.sh@940 -- # kill -0 3454451 00:17:03.447 19:15:21 -- common/autotest_common.sh@941 -- # uname 00:17:03.447 19:15:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:03.447 19:15:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3454451 00:17:03.447 19:15:22 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:03.447 19:15:22 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:03.447 19:15:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3454451' 00:17:03.447 killing process with pid 3454451 00:17:03.447 19:15:22 -- common/autotest_common.sh@955 -- # kill 3454451 00:17:03.447 19:15:22 -- common/autotest_common.sh@960 -- # wait 3454451 00:17:04.014 19:15:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:04.014 19:15:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:04.014 19:15:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:04.014 19:15:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:04.014 19:15:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:04.014 19:15:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.014 19:15:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.014 19:15:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.911 19:15:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:06.170 00:17:06.170 real 0m7.361s 00:17:06.170 user 0m13.583s 00:17:06.170 sys 0m2.527s 00:17:06.170 19:15:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:06.170 19:15:24 -- common/autotest_common.sh@10 -- # set +x 00:17:06.170 ************************************ 00:17:06.170 END TEST nvmf_bdevio_no_huge 00:17:06.170 ************************************ 00:17:06.170 19:15:24 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:06.170 19:15:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:06.170 19:15:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:06.170 19:15:24 -- common/autotest_common.sh@10 -- # set +x 00:17:06.170 ************************************ 00:17:06.170 START TEST nvmf_tls 00:17:06.170 ************************************ 00:17:06.170 19:15:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:06.170 * Looking for test storage... 00:17:06.170 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:06.170 19:15:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:06.170 19:15:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:06.170 19:15:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:06.170 19:15:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:06.170 19:15:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:06.170 19:15:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:06.170 19:15:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:06.170 19:15:24 -- scripts/common.sh@335 -- # IFS=.-: 00:17:06.170 19:15:24 -- scripts/common.sh@335 -- # read -ra ver1 00:17:06.170 19:15:24 -- scripts/common.sh@336 -- # IFS=.-: 00:17:06.170 19:15:24 -- scripts/common.sh@336 -- # read -ra ver2 00:17:06.170 19:15:24 -- scripts/common.sh@337 -- # local 'op=<' 00:17:06.170 19:15:24 -- scripts/common.sh@339 -- # ver1_l=2 00:17:06.170 19:15:24 -- scripts/common.sh@340 -- # ver2_l=1 00:17:06.170 19:15:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:06.170 19:15:24 -- scripts/common.sh@343 -- # case "$op" in 00:17:06.170 19:15:24 -- scripts/common.sh@344 -- # : 1 00:17:06.170 19:15:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:06.170 19:15:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.170 19:15:24 -- scripts/common.sh@364 -- # decimal 1 00:17:06.170 19:15:24 -- scripts/common.sh@352 -- # local d=1 00:17:06.170 19:15:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:06.170 19:15:24 -- scripts/common.sh@354 -- # echo 1 00:17:06.170 19:15:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:06.170 19:15:24 -- scripts/common.sh@365 -- # decimal 2 00:17:06.170 19:15:24 -- scripts/common.sh@352 -- # local d=2 00:17:06.170 19:15:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:06.170 19:15:24 -- scripts/common.sh@354 -- # echo 2 00:17:06.170 19:15:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:06.170 19:15:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:06.170 19:15:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:06.170 19:15:24 -- scripts/common.sh@367 -- # return 0 00:17:06.171 19:15:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:06.171 19:15:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:06.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.171 --rc genhtml_branch_coverage=1 00:17:06.171 --rc genhtml_function_coverage=1 00:17:06.171 --rc genhtml_legend=1 00:17:06.171 --rc geninfo_all_blocks=1 00:17:06.171 --rc geninfo_unexecuted_blocks=1 00:17:06.171 00:17:06.171 ' 00:17:06.171 19:15:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:06.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.171 --rc genhtml_branch_coverage=1 00:17:06.171 --rc genhtml_function_coverage=1 00:17:06.171 --rc genhtml_legend=1 00:17:06.171 --rc geninfo_all_blocks=1 00:17:06.171 --rc geninfo_unexecuted_blocks=1 00:17:06.171 00:17:06.171 ' 00:17:06.171 19:15:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:06.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.171 --rc genhtml_branch_coverage=1 00:17:06.171 --rc genhtml_function_coverage=1 00:17:06.171 --rc genhtml_legend=1 00:17:06.171 --rc geninfo_all_blocks=1 00:17:06.171 --rc geninfo_unexecuted_blocks=1 00:17:06.171 00:17:06.171 ' 00:17:06.171 19:15:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:06.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.171 --rc genhtml_branch_coverage=1 00:17:06.171 --rc genhtml_function_coverage=1 00:17:06.171 --rc genhtml_legend=1 00:17:06.171 --rc geninfo_all_blocks=1 00:17:06.171 --rc geninfo_unexecuted_blocks=1 00:17:06.171 00:17:06.171 ' 00:17:06.171 19:15:24 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:06.171 19:15:24 -- nvmf/common.sh@7 -- # uname -s 00:17:06.171 19:15:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:06.171 19:15:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:06.171 19:15:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:06.171 19:15:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:06.171 19:15:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:06.171 19:15:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:06.171 19:15:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:06.171 19:15:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:06.171 19:15:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:06.171 19:15:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:06.171 19:15:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.171 19:15:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.171 19:15:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:06.171 19:15:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:06.171 19:15:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:06.171 19:15:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:06.171 19:15:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:06.171 19:15:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:06.171 19:15:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:06.171 19:15:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.171 19:15:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.171 19:15:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.171 19:15:24 -- paths/export.sh@5 -- # export PATH 00:17:06.171 19:15:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.171 19:15:24 -- nvmf/common.sh@46 -- # : 0 00:17:06.171 19:15:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:06.171 19:15:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:06.171 19:15:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:06.171 19:15:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:06.171 19:15:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:06.171 19:15:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:06.171 19:15:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:06.171 19:15:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:06.171 19:15:24 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:06.171 19:15:24 -- target/tls.sh@71 -- # nvmftestinit 00:17:06.171 19:15:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:06.171 19:15:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:06.171 19:15:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:06.171 19:15:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:06.171 19:15:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:06.171 19:15:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.171 19:15:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:06.171 19:15:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.171 19:15:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:06.171 19:15:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:06.171 19:15:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:06.171 19:15:24 -- common/autotest_common.sh@10 -- # set +x 00:17:08.072 19:15:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:08.072 19:15:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:08.072 19:15:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:08.072 19:15:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:08.072 19:15:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:08.072 19:15:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:08.072 19:15:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:08.072 19:15:26 -- nvmf/common.sh@294 -- # net_devs=() 00:17:08.072 19:15:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:08.072 19:15:26 -- nvmf/common.sh@295 -- # e810=() 00:17:08.072 19:15:26 -- nvmf/common.sh@295 -- # local -ga e810 00:17:08.072 19:15:26 -- nvmf/common.sh@296 -- # x722=() 00:17:08.072 19:15:26 -- nvmf/common.sh@296 -- # local -ga x722 00:17:08.072 19:15:26 -- nvmf/common.sh@297 -- # mlx=() 00:17:08.072 19:15:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:08.072 19:15:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:08.072 19:15:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:08.072 19:15:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:08.072 19:15:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:08.072 19:15:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.072 19:15:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:08.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:08.072 19:15:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.072 19:15:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:08.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:08.072 19:15:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:08.072 19:15:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.072 19:15:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.072 19:15:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.072 19:15:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.072 19:15:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:08.072 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:08.072 19:15:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.072 19:15:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.072 19:15:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.072 19:15:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.072 19:15:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.072 19:15:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:08.072 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:08.072 19:15:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.072 19:15:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:08.072 19:15:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:08.072 19:15:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:08.072 19:15:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:08.072 19:15:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:08.072 19:15:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:08.072 19:15:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:08.072 19:15:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:08.072 19:15:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:08.072 19:15:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:08.072 19:15:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:08.072 19:15:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:08.072 19:15:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:08.072 19:15:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:08.072 19:15:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:08.072 19:15:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:08.072 19:15:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:08.331 19:15:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:08.331 19:15:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:08.331 19:15:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:08.331 19:15:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:08.331 19:15:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:08.331 19:15:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:08.331 19:15:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:08.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:08.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:17:08.331 00:17:08.331 --- 10.0.0.2 ping statistics --- 00:17:08.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.331 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:17:08.331 19:15:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:08.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:08.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:17:08.331 00:17:08.331 --- 10.0.0.1 ping statistics --- 00:17:08.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.331 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:17:08.331 19:15:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:08.331 19:15:26 -- nvmf/common.sh@410 -- # return 0 00:17:08.331 19:15:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:08.331 19:15:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:08.331 19:15:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:08.331 19:15:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:08.331 19:15:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:08.331 19:15:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:08.331 19:15:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:08.331 19:15:26 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:08.331 19:15:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:08.331 19:15:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:08.331 19:15:26 -- common/autotest_common.sh@10 -- # set +x 00:17:08.331 19:15:26 -- nvmf/common.sh@469 -- # nvmfpid=3456705 00:17:08.331 19:15:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:08.331 19:15:26 -- nvmf/common.sh@470 -- # waitforlisten 3456705 00:17:08.331 19:15:26 -- common/autotest_common.sh@829 -- # '[' -z 3456705 ']' 00:17:08.331 19:15:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:08.331 19:15:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:08.331 19:15:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:08.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:08.331 19:15:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:08.331 19:15:26 -- common/autotest_common.sh@10 -- # set +x 00:17:08.331 [2024-11-18 19:15:26.810227] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:08.331 [2024-11-18 19:15:26.810300] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:08.331 EAL: No free 2048 kB hugepages reported on node 1 00:17:08.331 [2024-11-18 19:15:26.875538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:08.590 [2024-11-18 19:15:26.986188] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:08.590 [2024-11-18 19:15:26.986321] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.590 [2024-11-18 19:15:26.986337] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.590 [2024-11-18 19:15:26.986349] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.590 [2024-11-18 19:15:26.986377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.590 19:15:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:08.590 19:15:27 -- common/autotest_common.sh@862 -- # return 0 00:17:08.590 19:15:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:08.590 19:15:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:08.590 19:15:27 -- common/autotest_common.sh@10 -- # set +x 00:17:08.590 19:15:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.590 19:15:27 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:08.590 19:15:27 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:08.848 true 00:17:08.848 19:15:27 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:08.848 19:15:27 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:09.106 19:15:27 -- target/tls.sh@82 -- # version=0 00:17:09.106 19:15:27 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:09.106 19:15:27 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:09.408 19:15:27 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:09.408 19:15:27 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:09.700 19:15:28 -- target/tls.sh@90 -- # version=13 00:17:09.700 19:15:28 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:09.700 19:15:28 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:09.972 19:15:28 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:09.972 19:15:28 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:10.229 19:15:28 -- target/tls.sh@98 -- # version=7 00:17:10.230 19:15:28 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:10.230 19:15:28 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.230 19:15:28 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:10.230 19:15:28 -- target/tls.sh@105 -- # ktls=false 00:17:10.230 19:15:28 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:10.230 19:15:28 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:10.794 19:15:29 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.794 19:15:29 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:10.794 19:15:29 -- target/tls.sh@113 -- # ktls=true 00:17:10.794 19:15:29 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:10.794 19:15:29 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:11.359 19:15:29 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.359 19:15:29 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:11.359 19:15:29 -- target/tls.sh@121 -- # ktls=false 00:17:11.359 19:15:29 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:11.359 19:15:29 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:11.359 19:15:29 -- target/tls.sh@49 -- # local key hash crc 00:17:11.359 19:15:29 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:11.359 19:15:29 -- target/tls.sh@51 -- # hash=01 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # gzip -1 -c 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # tail -c8 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # head -c 4 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # crc='p$H�' 00:17:11.359 19:15:29 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:11.359 19:15:29 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:11.359 19:15:29 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:11.359 19:15:29 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:11.359 19:15:29 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:11.359 19:15:29 -- target/tls.sh@49 -- # local key hash crc 00:17:11.359 19:15:29 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:11.359 19:15:29 -- target/tls.sh@51 -- # hash=01 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # gzip -1 -c 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # tail -c8 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # head -c 4 00:17:11.359 19:15:29 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:11.359 19:15:29 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:11.359 19:15:29 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:11.359 19:15:29 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:11.359 19:15:29 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:11.359 19:15:29 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.359 19:15:29 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.359 19:15:29 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:11.359 19:15:29 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:11.359 19:15:29 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.359 19:15:29 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.359 19:15:29 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:11.925 19:15:30 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:12.184 19:15:30 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.184 19:15:30 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.184 19:15:30 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:12.441 [2024-11-18 19:15:30.912479] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:12.441 19:15:30 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:12.699 19:15:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:12.957 [2024-11-18 19:15:31.409861] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:12.957 [2024-11-18 19:15:31.410139] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:12.957 19:15:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:13.215 malloc0 00:17:13.215 19:15:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:13.473 19:15:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.731 19:15:32 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.731 EAL: No free 2048 kB hugepages reported on node 1 00:17:23.697 Initializing NVMe Controllers 00:17:23.697 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:23.697 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:23.697 Initialization complete. Launching workers. 00:17:23.697 ======================================================== 00:17:23.697 Latency(us) 00:17:23.697 Device Information : IOPS MiB/s Average min max 00:17:23.697 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7780.69 30.39 8228.14 1319.05 11795.34 00:17:23.697 ======================================================== 00:17:23.697 Total : 7780.69 30.39 8228.14 1319.05 11795.34 00:17:23.697 00:17:23.697 19:15:42 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:23.697 19:15:42 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:23.697 19:15:42 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:23.697 19:15:42 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:23.697 19:15:42 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:23.697 19:15:42 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:23.697 19:15:42 -- target/tls.sh@28 -- # bdevperf_pid=3458672 00:17:23.697 19:15:42 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:23.697 19:15:42 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:23.697 19:15:42 -- target/tls.sh@31 -- # waitforlisten 3458672 /var/tmp/bdevperf.sock 00:17:23.697 19:15:42 -- common/autotest_common.sh@829 -- # '[' -z 3458672 ']' 00:17:23.697 19:15:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:23.697 19:15:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:23.697 19:15:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:23.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:23.697 19:15:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:23.697 19:15:42 -- common/autotest_common.sh@10 -- # set +x 00:17:23.955 [2024-11-18 19:15:42.325082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:23.956 [2024-11-18 19:15:42.325169] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3458672 ] 00:17:23.956 EAL: No free 2048 kB hugepages reported on node 1 00:17:23.956 [2024-11-18 19:15:42.382047] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:23.956 [2024-11-18 19:15:42.486148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:24.888 19:15:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:24.888 19:15:43 -- common/autotest_common.sh@862 -- # return 0 00:17:24.888 19:15:43 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.145 [2024-11-18 19:15:43.568784] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:25.145 TLSTESTn1 00:17:25.145 19:15:43 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:25.404 Running I/O for 10 seconds... 00:17:35.373 00:17:35.373 Latency(us) 00:17:35.373 [2024-11-18T18:15:53.978Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.373 [2024-11-18T18:15:53.978Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:35.373 Verification LBA range: start 0x0 length 0x2000 00:17:35.373 TLSTESTn1 : 10.03 3352.38 13.10 0.00 0.00 38132.82 5631.24 60584.39 00:17:35.373 [2024-11-18T18:15:53.978Z] =================================================================================================================== 00:17:35.373 [2024-11-18T18:15:53.978Z] Total : 3352.38 13.10 0.00 0.00 38132.82 5631.24 60584.39 00:17:35.373 0 00:17:35.373 19:15:53 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:35.373 19:15:53 -- target/tls.sh@45 -- # killprocess 3458672 00:17:35.373 19:15:53 -- common/autotest_common.sh@936 -- # '[' -z 3458672 ']' 00:17:35.373 19:15:53 -- common/autotest_common.sh@940 -- # kill -0 3458672 00:17:35.373 19:15:53 -- common/autotest_common.sh@941 -- # uname 00:17:35.373 19:15:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:35.373 19:15:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3458672 00:17:35.373 19:15:53 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:35.373 19:15:53 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:35.373 19:15:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3458672' 00:17:35.373 killing process with pid 3458672 00:17:35.373 19:15:53 -- common/autotest_common.sh@955 -- # kill 3458672 00:17:35.373 Received shutdown signal, test time was about 10.000000 seconds 00:17:35.373 00:17:35.373 Latency(us) 00:17:35.373 [2024-11-18T18:15:53.978Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.373 [2024-11-18T18:15:53.978Z] =================================================================================================================== 00:17:35.373 [2024-11-18T18:15:53.978Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:35.373 19:15:53 -- common/autotest_common.sh@960 -- # wait 3458672 00:17:35.631 19:15:54 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.631 19:15:54 -- common/autotest_common.sh@650 -- # local es=0 00:17:35.631 19:15:54 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.631 19:15:54 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:35.631 19:15:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.631 19:15:54 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:35.631 19:15:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.631 19:15:54 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.631 19:15:54 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:35.631 19:15:54 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:35.631 19:15:54 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:35.631 19:15:54 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:35.631 19:15:54 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:35.631 19:15:54 -- target/tls.sh@28 -- # bdevperf_pid=3460038 00:17:35.631 19:15:54 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:35.631 19:15:54 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:35.631 19:15:54 -- target/tls.sh@31 -- # waitforlisten 3460038 /var/tmp/bdevperf.sock 00:17:35.631 19:15:54 -- common/autotest_common.sh@829 -- # '[' -z 3460038 ']' 00:17:35.631 19:15:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:35.631 19:15:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:35.631 19:15:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:35.631 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:35.631 19:15:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:35.631 19:15:54 -- common/autotest_common.sh@10 -- # set +x 00:17:35.631 [2024-11-18 19:15:54.178497] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:35.631 [2024-11-18 19:15:54.178587] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3460038 ] 00:17:35.631 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.890 [2024-11-18 19:15:54.236446] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:35.890 [2024-11-18 19:15:54.347060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:36.823 19:15:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:36.823 19:15:55 -- common/autotest_common.sh@862 -- # return 0 00:17:36.823 19:15:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.080 [2024-11-18 19:15:55.487071] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:37.080 [2024-11-18 19:15:55.492467] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:37.080 [2024-11-18 19:15:55.492890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1de51f0 (107): Transport endpoint is not connected 00:17:37.080 [2024-11-18 19:15:55.493879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1de51f0 (9): Bad file descriptor 00:17:37.080 [2024-11-18 19:15:55.494878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:37.080 [2024-11-18 19:15:55.494925] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:37.080 [2024-11-18 19:15:55.494942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:37.080 request: 00:17:37.080 { 00:17:37.080 "name": "TLSTEST", 00:17:37.080 "trtype": "tcp", 00:17:37.080 "traddr": "10.0.0.2", 00:17:37.080 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:37.080 "adrfam": "ipv4", 00:17:37.080 "trsvcid": "4420", 00:17:37.080 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.080 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:37.080 "method": "bdev_nvme_attach_controller", 00:17:37.080 "req_id": 1 00:17:37.080 } 00:17:37.080 Got JSON-RPC error response 00:17:37.080 response: 00:17:37.080 { 00:17:37.080 "code": -32602, 00:17:37.080 "message": "Invalid parameters" 00:17:37.080 } 00:17:37.080 19:15:55 -- target/tls.sh@36 -- # killprocess 3460038 00:17:37.080 19:15:55 -- common/autotest_common.sh@936 -- # '[' -z 3460038 ']' 00:17:37.080 19:15:55 -- common/autotest_common.sh@940 -- # kill -0 3460038 00:17:37.080 19:15:55 -- common/autotest_common.sh@941 -- # uname 00:17:37.080 19:15:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.080 19:15:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3460038 00:17:37.080 19:15:55 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:37.080 19:15:55 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:37.080 19:15:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3460038' 00:17:37.080 killing process with pid 3460038 00:17:37.080 19:15:55 -- common/autotest_common.sh@955 -- # kill 3460038 00:17:37.080 Received shutdown signal, test time was about 10.000000 seconds 00:17:37.080 00:17:37.080 Latency(us) 00:17:37.080 [2024-11-18T18:15:55.685Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.080 [2024-11-18T18:15:55.685Z] =================================================================================================================== 00:17:37.080 [2024-11-18T18:15:55.685Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:37.080 19:15:55 -- common/autotest_common.sh@960 -- # wait 3460038 00:17:37.338 19:15:55 -- target/tls.sh@37 -- # return 1 00:17:37.338 19:15:55 -- common/autotest_common.sh@653 -- # es=1 00:17:37.338 19:15:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:37.338 19:15:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:37.338 19:15:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:37.338 19:15:55 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.338 19:15:55 -- common/autotest_common.sh@650 -- # local es=0 00:17:37.338 19:15:55 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.338 19:15:55 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:37.338 19:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.338 19:15:55 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:37.338 19:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.338 19:15:55 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.338 19:15:55 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.338 19:15:55 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.338 19:15:55 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:37.338 19:15:55 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:37.338 19:15:55 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.338 19:15:55 -- target/tls.sh@28 -- # bdevperf_pid=3460315 00:17:37.338 19:15:55 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.338 19:15:55 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.338 19:15:55 -- target/tls.sh@31 -- # waitforlisten 3460315 /var/tmp/bdevperf.sock 00:17:37.338 19:15:55 -- common/autotest_common.sh@829 -- # '[' -z 3460315 ']' 00:17:37.338 19:15:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.338 19:15:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.338 19:15:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.338 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.338 19:15:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.338 19:15:55 -- common/autotest_common.sh@10 -- # set +x 00:17:37.338 [2024-11-18 19:15:55.822143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.338 [2024-11-18 19:15:55.822220] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3460315 ] 00:17:37.338 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.338 [2024-11-18 19:15:55.878359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.596 [2024-11-18 19:15:55.983375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.530 19:15:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.530 19:15:56 -- common/autotest_common.sh@862 -- # return 0 00:17:38.530 19:15:56 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.530 [2024-11-18 19:15:57.018474] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.530 [2024-11-18 19:15:57.024311] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:38.530 [2024-11-18 19:15:57.024342] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:38.530 [2024-11-18 19:15:57.024394] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:38.530 [2024-11-18 19:15:57.025208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9ec1f0 (107): Transport endpoint is not connected 00:17:38.530 [2024-11-18 19:15:57.026200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9ec1f0 (9): Bad file descriptor 00:17:38.530 [2024-11-18 19:15:57.027199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:38.530 [2024-11-18 19:15:57.027220] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:38.530 [2024-11-18 19:15:57.027234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:38.530 request: 00:17:38.530 { 00:17:38.530 "name": "TLSTEST", 00:17:38.530 "trtype": "tcp", 00:17:38.530 "traddr": "10.0.0.2", 00:17:38.530 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:38.530 "adrfam": "ipv4", 00:17:38.530 "trsvcid": "4420", 00:17:38.530 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.530 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:38.530 "method": "bdev_nvme_attach_controller", 00:17:38.530 "req_id": 1 00:17:38.530 } 00:17:38.530 Got JSON-RPC error response 00:17:38.530 response: 00:17:38.530 { 00:17:38.530 "code": -32602, 00:17:38.530 "message": "Invalid parameters" 00:17:38.530 } 00:17:38.530 19:15:57 -- target/tls.sh@36 -- # killprocess 3460315 00:17:38.530 19:15:57 -- common/autotest_common.sh@936 -- # '[' -z 3460315 ']' 00:17:38.531 19:15:57 -- common/autotest_common.sh@940 -- # kill -0 3460315 00:17:38.531 19:15:57 -- common/autotest_common.sh@941 -- # uname 00:17:38.531 19:15:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.531 19:15:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3460315 00:17:38.531 19:15:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:38.531 19:15:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:38.531 19:15:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3460315' 00:17:38.531 killing process with pid 3460315 00:17:38.531 19:15:57 -- common/autotest_common.sh@955 -- # kill 3460315 00:17:38.531 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.531 00:17:38.531 Latency(us) 00:17:38.531 [2024-11-18T18:15:57.136Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.531 [2024-11-18T18:15:57.136Z] =================================================================================================================== 00:17:38.531 [2024-11-18T18:15:57.136Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:38.531 19:15:57 -- common/autotest_common.sh@960 -- # wait 3460315 00:17:38.789 19:15:57 -- target/tls.sh@37 -- # return 1 00:17:38.789 19:15:57 -- common/autotest_common.sh@653 -- # es=1 00:17:38.789 19:15:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:38.789 19:15:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:38.789 19:15:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:38.789 19:15:57 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.789 19:15:57 -- common/autotest_common.sh@650 -- # local es=0 00:17:38.789 19:15:57 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.789 19:15:57 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:38.789 19:15:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.789 19:15:57 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:38.789 19:15:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:38.789 19:15:57 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.789 19:15:57 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:38.789 19:15:57 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:38.789 19:15:57 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:38.789 19:15:57 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:38.789 19:15:57 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.789 19:15:57 -- target/tls.sh@28 -- # bdevperf_pid=3460463 00:17:38.789 19:15:57 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.789 19:15:57 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.789 19:15:57 -- target/tls.sh@31 -- # waitforlisten 3460463 /var/tmp/bdevperf.sock 00:17:38.789 19:15:57 -- common/autotest_common.sh@829 -- # '[' -z 3460463 ']' 00:17:38.789 19:15:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.789 19:15:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.789 19:15:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.789 19:15:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.789 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:17:38.789 [2024-11-18 19:15:57.390241] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.790 [2024-11-18 19:15:57.390330] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3460463 ] 00:17:39.048 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.048 [2024-11-18 19:15:57.447359] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.048 [2024-11-18 19:15:57.554902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.981 19:15:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.981 19:15:58 -- common/autotest_common.sh@862 -- # return 0 00:17:39.981 19:15:58 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.239 [2024-11-18 19:15:58.676469] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:40.239 [2024-11-18 19:15:58.681567] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:40.239 [2024-11-18 19:15:58.681632] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:40.239 [2024-11-18 19:15:58.681674] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:40.239 [2024-11-18 19:15:58.682213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x120f1f0 (107): Transport endpoint is not connected 00:17:40.239 [2024-11-18 19:15:58.683203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x120f1f0 (9): Bad file descriptor 00:17:40.239 [2024-11-18 19:15:58.684202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:40.239 [2024-11-18 19:15:58.684222] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:40.239 [2024-11-18 19:15:58.684235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:40.239 request: 00:17:40.239 { 00:17:40.239 "name": "TLSTEST", 00:17:40.239 "trtype": "tcp", 00:17:40.239 "traddr": "10.0.0.2", 00:17:40.239 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:40.239 "adrfam": "ipv4", 00:17:40.239 "trsvcid": "4420", 00:17:40.239 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:40.239 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:40.240 "method": "bdev_nvme_attach_controller", 00:17:40.240 "req_id": 1 00:17:40.240 } 00:17:40.240 Got JSON-RPC error response 00:17:40.240 response: 00:17:40.240 { 00:17:40.240 "code": -32602, 00:17:40.240 "message": "Invalid parameters" 00:17:40.240 } 00:17:40.240 19:15:58 -- target/tls.sh@36 -- # killprocess 3460463 00:17:40.240 19:15:58 -- common/autotest_common.sh@936 -- # '[' -z 3460463 ']' 00:17:40.240 19:15:58 -- common/autotest_common.sh@940 -- # kill -0 3460463 00:17:40.240 19:15:58 -- common/autotest_common.sh@941 -- # uname 00:17:40.240 19:15:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:40.240 19:15:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3460463 00:17:40.240 19:15:58 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:40.240 19:15:58 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:40.240 19:15:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3460463' 00:17:40.240 killing process with pid 3460463 00:17:40.240 19:15:58 -- common/autotest_common.sh@955 -- # kill 3460463 00:17:40.240 Received shutdown signal, test time was about 10.000000 seconds 00:17:40.240 00:17:40.240 Latency(us) 00:17:40.240 [2024-11-18T18:15:58.845Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.240 [2024-11-18T18:15:58.845Z] =================================================================================================================== 00:17:40.240 [2024-11-18T18:15:58.845Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:40.240 19:15:58 -- common/autotest_common.sh@960 -- # wait 3460463 00:17:40.499 19:15:58 -- target/tls.sh@37 -- # return 1 00:17:40.499 19:15:58 -- common/autotest_common.sh@653 -- # es=1 00:17:40.499 19:15:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:40.499 19:15:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:40.499 19:15:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:40.499 19:15:58 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:40.499 19:15:58 -- common/autotest_common.sh@650 -- # local es=0 00:17:40.499 19:15:58 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:40.499 19:15:58 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:40.499 19:15:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.499 19:15:58 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:40.499 19:15:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.499 19:15:58 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:40.499 19:15:58 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:40.499 19:15:58 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:40.499 19:15:58 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:40.499 19:15:58 -- target/tls.sh@23 -- # psk= 00:17:40.499 19:15:58 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:40.499 19:15:58 -- target/tls.sh@28 -- # bdevperf_pid=3460740 00:17:40.499 19:15:58 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:40.499 19:15:58 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:40.499 19:15:58 -- target/tls.sh@31 -- # waitforlisten 3460740 /var/tmp/bdevperf.sock 00:17:40.499 19:15:58 -- common/autotest_common.sh@829 -- # '[' -z 3460740 ']' 00:17:40.499 19:15:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:40.499 19:15:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:40.499 19:15:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:40.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:40.499 19:15:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:40.499 19:15:58 -- common/autotest_common.sh@10 -- # set +x 00:17:40.499 [2024-11-18 19:15:59.010086] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:40.499 [2024-11-18 19:15:59.010163] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3460740 ] 00:17:40.499 EAL: No free 2048 kB hugepages reported on node 1 00:17:40.499 [2024-11-18 19:15:59.068709] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.766 [2024-11-18 19:15:59.176114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:41.701 19:16:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:41.702 19:16:00 -- common/autotest_common.sh@862 -- # return 0 00:17:41.702 19:16:00 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:41.702 [2024-11-18 19:16:00.282769] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:41.702 [2024-11-18 19:16:00.284278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x563050 (9): Bad file descriptor 00:17:41.702 [2024-11-18 19:16:00.285262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:41.702 [2024-11-18 19:16:00.285285] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:41.702 [2024-11-18 19:16:00.285300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:41.702 request: 00:17:41.702 { 00:17:41.702 "name": "TLSTEST", 00:17:41.702 "trtype": "tcp", 00:17:41.702 "traddr": "10.0.0.2", 00:17:41.702 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:41.702 "adrfam": "ipv4", 00:17:41.702 "trsvcid": "4420", 00:17:41.702 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.702 "method": "bdev_nvme_attach_controller", 00:17:41.702 "req_id": 1 00:17:41.702 } 00:17:41.702 Got JSON-RPC error response 00:17:41.702 response: 00:17:41.702 { 00:17:41.702 "code": -32602, 00:17:41.702 "message": "Invalid parameters" 00:17:41.702 } 00:17:41.702 19:16:00 -- target/tls.sh@36 -- # killprocess 3460740 00:17:41.702 19:16:00 -- common/autotest_common.sh@936 -- # '[' -z 3460740 ']' 00:17:41.702 19:16:00 -- common/autotest_common.sh@940 -- # kill -0 3460740 00:17:41.702 19:16:00 -- common/autotest_common.sh@941 -- # uname 00:17:41.702 19:16:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:41.702 19:16:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3460740 00:17:41.960 19:16:00 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:41.960 19:16:00 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:41.960 19:16:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3460740' 00:17:41.960 killing process with pid 3460740 00:17:41.960 19:16:00 -- common/autotest_common.sh@955 -- # kill 3460740 00:17:41.960 Received shutdown signal, test time was about 10.000000 seconds 00:17:41.960 00:17:41.960 Latency(us) 00:17:41.960 [2024-11-18T18:16:00.565Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:41.960 [2024-11-18T18:16:00.565Z] =================================================================================================================== 00:17:41.960 [2024-11-18T18:16:00.565Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:41.960 19:16:00 -- common/autotest_common.sh@960 -- # wait 3460740 00:17:42.218 19:16:00 -- target/tls.sh@37 -- # return 1 00:17:42.218 19:16:00 -- common/autotest_common.sh@653 -- # es=1 00:17:42.218 19:16:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:42.218 19:16:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:42.218 19:16:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:42.218 19:16:00 -- target/tls.sh@167 -- # killprocess 3456705 00:17:42.218 19:16:00 -- common/autotest_common.sh@936 -- # '[' -z 3456705 ']' 00:17:42.218 19:16:00 -- common/autotest_common.sh@940 -- # kill -0 3456705 00:17:42.218 19:16:00 -- common/autotest_common.sh@941 -- # uname 00:17:42.218 19:16:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.218 19:16:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3456705 00:17:42.218 19:16:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:42.218 19:16:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:42.218 19:16:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3456705' 00:17:42.218 killing process with pid 3456705 00:17:42.218 19:16:00 -- common/autotest_common.sh@955 -- # kill 3456705 00:17:42.218 19:16:00 -- common/autotest_common.sh@960 -- # wait 3456705 00:17:42.476 19:16:00 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:42.476 19:16:00 -- target/tls.sh@49 -- # local key hash crc 00:17:42.476 19:16:00 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:42.476 19:16:00 -- target/tls.sh@51 -- # hash=02 00:17:42.476 19:16:00 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:42.476 19:16:00 -- target/tls.sh@52 -- # gzip -1 -c 00:17:42.476 19:16:00 -- target/tls.sh@52 -- # tail -c8 00:17:42.476 19:16:00 -- target/tls.sh@52 -- # head -c 4 00:17:42.476 19:16:00 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:42.476 19:16:00 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:42.476 19:16:00 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:42.476 19:16:00 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:42.476 19:16:00 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:42.476 19:16:00 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.476 19:16:00 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:42.476 19:16:00 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.476 19:16:00 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:42.476 19:16:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:42.476 19:16:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:42.476 19:16:00 -- common/autotest_common.sh@10 -- # set +x 00:17:42.476 19:16:00 -- nvmf/common.sh@469 -- # nvmfpid=3460910 00:17:42.476 19:16:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:42.476 19:16:00 -- nvmf/common.sh@470 -- # waitforlisten 3460910 00:17:42.476 19:16:00 -- common/autotest_common.sh@829 -- # '[' -z 3460910 ']' 00:17:42.476 19:16:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:42.476 19:16:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.476 19:16:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:42.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:42.476 19:16:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.476 19:16:00 -- common/autotest_common.sh@10 -- # set +x 00:17:42.476 [2024-11-18 19:16:00.962846] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.476 [2024-11-18 19:16:00.962956] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:42.476 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.476 [2024-11-18 19:16:01.031695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.734 [2024-11-18 19:16:01.146705] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:42.734 [2024-11-18 19:16:01.146883] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:42.734 [2024-11-18 19:16:01.146914] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:42.734 [2024-11-18 19:16:01.146929] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:42.734 [2024-11-18 19:16:01.146980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:43.667 19:16:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.667 19:16:01 -- common/autotest_common.sh@862 -- # return 0 00:17:43.667 19:16:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:43.667 19:16:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:43.667 19:16:01 -- common/autotest_common.sh@10 -- # set +x 00:17:43.667 19:16:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:43.667 19:16:01 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.667 19:16:01 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.667 19:16:01 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:43.667 [2024-11-18 19:16:02.195005] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:43.667 19:16:02 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:43.926 19:16:02 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:44.184 [2024-11-18 19:16:02.692331] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:44.184 [2024-11-18 19:16:02.692593] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:44.184 19:16:02 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:44.442 malloc0 00:17:44.442 19:16:02 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:44.699 19:16:03 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.957 19:16:03 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:44.957 19:16:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:44.957 19:16:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:44.957 19:16:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:44.957 19:16:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:44.957 19:16:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:44.957 19:16:03 -- target/tls.sh@28 -- # bdevperf_pid=3461331 00:17:44.957 19:16:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:44.957 19:16:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:44.957 19:16:03 -- target/tls.sh@31 -- # waitforlisten 3461331 /var/tmp/bdevperf.sock 00:17:44.957 19:16:03 -- common/autotest_common.sh@829 -- # '[' -z 3461331 ']' 00:17:44.957 19:16:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:44.957 19:16:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.957 19:16:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:44.957 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:44.957 19:16:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.957 19:16:03 -- common/autotest_common.sh@10 -- # set +x 00:17:44.957 [2024-11-18 19:16:03.503212] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.957 [2024-11-18 19:16:03.503285] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3461331 ] 00:17:44.957 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.215 [2024-11-18 19:16:03.562910] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.215 [2024-11-18 19:16:03.679810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.149 19:16:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.149 19:16:04 -- common/autotest_common.sh@862 -- # return 0 00:17:46.149 19:16:04 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.407 [2024-11-18 19:16:04.755530] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.407 TLSTESTn1 00:17:46.407 19:16:04 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:46.407 Running I/O for 10 seconds... 00:17:58.617 00:17:58.617 Latency(us) 00:17:58.617 [2024-11-18T18:16:17.222Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.617 [2024-11-18T18:16:17.222Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:58.617 Verification LBA range: start 0x0 length 0x2000 00:17:58.617 TLSTESTn1 : 10.03 4515.86 17.64 0.00 0.00 28296.25 8155.59 55924.05 00:17:58.617 [2024-11-18T18:16:17.222Z] =================================================================================================================== 00:17:58.617 [2024-11-18T18:16:17.222Z] Total : 4515.86 17.64 0.00 0.00 28296.25 8155.59 55924.05 00:17:58.617 0 00:17:58.617 19:16:15 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:58.617 19:16:15 -- target/tls.sh@45 -- # killprocess 3461331 00:17:58.617 19:16:15 -- common/autotest_common.sh@936 -- # '[' -z 3461331 ']' 00:17:58.617 19:16:15 -- common/autotest_common.sh@940 -- # kill -0 3461331 00:17:58.617 19:16:15 -- common/autotest_common.sh@941 -- # uname 00:17:58.617 19:16:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.617 19:16:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3461331 00:17:58.617 19:16:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:58.617 19:16:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:58.617 19:16:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3461331' 00:17:58.617 killing process with pid 3461331 00:17:58.618 19:16:15 -- common/autotest_common.sh@955 -- # kill 3461331 00:17:58.618 Received shutdown signal, test time was about 10.000000 seconds 00:17:58.618 00:17:58.618 Latency(us) 00:17:58.618 [2024-11-18T18:16:17.223Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.618 [2024-11-18T18:16:17.223Z] =================================================================================================================== 00:17:58.618 [2024-11-18T18:16:17.223Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:58.618 19:16:15 -- common/autotest_common.sh@960 -- # wait 3461331 00:17:58.618 19:16:15 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.618 19:16:15 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.618 19:16:15 -- common/autotest_common.sh@650 -- # local es=0 00:17:58.618 19:16:15 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.618 19:16:15 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:58.618 19:16:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.618 19:16:15 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:58.618 19:16:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:58.618 19:16:15 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.618 19:16:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:58.618 19:16:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:58.618 19:16:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:58.618 19:16:15 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:58.618 19:16:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:58.618 19:16:15 -- target/tls.sh@28 -- # bdevperf_pid=3462701 00:17:58.618 19:16:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:58.618 19:16:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:58.618 19:16:15 -- target/tls.sh@31 -- # waitforlisten 3462701 /var/tmp/bdevperf.sock 00:17:58.618 19:16:15 -- common/autotest_common.sh@829 -- # '[' -z 3462701 ']' 00:17:58.618 19:16:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:58.618 19:16:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.618 19:16:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:58.618 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:58.618 19:16:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.618 19:16:15 -- common/autotest_common.sh@10 -- # set +x 00:17:58.618 [2024-11-18 19:16:15.364685] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:58.618 [2024-11-18 19:16:15.364762] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3462701 ] 00:17:58.618 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.618 [2024-11-18 19:16:15.419794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:58.618 [2024-11-18 19:16:15.519924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:58.618 19:16:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:58.618 19:16:16 -- common/autotest_common.sh@862 -- # return 0 00:17:58.618 19:16:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.618 [2024-11-18 19:16:16.591377] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:58.618 [2024-11-18 19:16:16.591445] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:58.618 request: 00:17:58.618 { 00:17:58.618 "name": "TLSTEST", 00:17:58.618 "trtype": "tcp", 00:17:58.618 "traddr": "10.0.0.2", 00:17:58.618 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:58.618 "adrfam": "ipv4", 00:17:58.618 "trsvcid": "4420", 00:17:58.618 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:58.618 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:58.618 "method": "bdev_nvme_attach_controller", 00:17:58.618 "req_id": 1 00:17:58.618 } 00:17:58.618 Got JSON-RPC error response 00:17:58.618 response: 00:17:58.618 { 00:17:58.618 "code": -22, 00:17:58.618 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:58.618 } 00:17:58.618 19:16:16 -- target/tls.sh@36 -- # killprocess 3462701 00:17:58.618 19:16:16 -- common/autotest_common.sh@936 -- # '[' -z 3462701 ']' 00:17:58.618 19:16:16 -- common/autotest_common.sh@940 -- # kill -0 3462701 00:17:58.618 19:16:16 -- common/autotest_common.sh@941 -- # uname 00:17:58.618 19:16:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.618 19:16:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3462701 00:17:58.618 19:16:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:58.618 19:16:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:58.618 19:16:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3462701' 00:17:58.618 killing process with pid 3462701 00:17:58.618 19:16:16 -- common/autotest_common.sh@955 -- # kill 3462701 00:17:58.618 Received shutdown signal, test time was about 10.000000 seconds 00:17:58.618 00:17:58.618 Latency(us) 00:17:58.618 [2024-11-18T18:16:17.223Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.618 [2024-11-18T18:16:17.223Z] =================================================================================================================== 00:17:58.618 [2024-11-18T18:16:17.223Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:58.618 19:16:16 -- common/autotest_common.sh@960 -- # wait 3462701 00:17:58.618 19:16:16 -- target/tls.sh@37 -- # return 1 00:17:58.618 19:16:16 -- common/autotest_common.sh@653 -- # es=1 00:17:58.618 19:16:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:58.618 19:16:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:58.618 19:16:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:58.618 19:16:16 -- target/tls.sh@183 -- # killprocess 3460910 00:17:58.618 19:16:16 -- common/autotest_common.sh@936 -- # '[' -z 3460910 ']' 00:17:58.618 19:16:16 -- common/autotest_common.sh@940 -- # kill -0 3460910 00:17:58.618 19:16:16 -- common/autotest_common.sh@941 -- # uname 00:17:58.618 19:16:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.618 19:16:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3460910 00:17:58.618 19:16:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:58.618 19:16:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:58.618 19:16:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3460910' 00:17:58.618 killing process with pid 3460910 00:17:58.618 19:16:16 -- common/autotest_common.sh@955 -- # kill 3460910 00:17:58.618 19:16:16 -- common/autotest_common.sh@960 -- # wait 3460910 00:17:58.876 19:16:17 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:58.876 19:16:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:58.876 19:16:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:58.876 19:16:17 -- common/autotest_common.sh@10 -- # set +x 00:17:58.876 19:16:17 -- nvmf/common.sh@469 -- # nvmfpid=3462982 00:17:58.876 19:16:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:58.876 19:16:17 -- nvmf/common.sh@470 -- # waitforlisten 3462982 00:17:58.876 19:16:17 -- common/autotest_common.sh@829 -- # '[' -z 3462982 ']' 00:17:58.876 19:16:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:58.876 19:16:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.876 19:16:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:58.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:58.876 19:16:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.876 19:16:17 -- common/autotest_common.sh@10 -- # set +x 00:17:58.876 [2024-11-18 19:16:17.289271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:58.876 [2024-11-18 19:16:17.289356] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:58.876 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.876 [2024-11-18 19:16:17.362575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:58.876 [2024-11-18 19:16:17.473584] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:58.876 [2024-11-18 19:16:17.473772] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:58.876 [2024-11-18 19:16:17.473790] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:58.876 [2024-11-18 19:16:17.473802] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:58.876 [2024-11-18 19:16:17.473833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:59.810 19:16:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:59.810 19:16:18 -- common/autotest_common.sh@862 -- # return 0 00:17:59.810 19:16:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:59.810 19:16:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:59.810 19:16:18 -- common/autotest_common.sh@10 -- # set +x 00:17:59.810 19:16:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:59.810 19:16:18 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.810 19:16:18 -- common/autotest_common.sh@650 -- # local es=0 00:17:59.810 19:16:18 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.810 19:16:18 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:17:59.810 19:16:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.810 19:16:18 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:17:59.810 19:16:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:59.810 19:16:18 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.810 19:16:18 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.810 19:16:18 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:00.068 [2024-11-18 19:16:18.540783] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:00.068 19:16:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:00.326 19:16:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:00.584 [2024-11-18 19:16:19.098325] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:00.584 [2024-11-18 19:16:19.098651] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:00.584 19:16:19 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:00.877 malloc0 00:18:00.877 19:16:19 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:01.162 19:16:19 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.420 [2024-11-18 19:16:19.964192] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:01.420 [2024-11-18 19:16:19.964239] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:01.420 [2024-11-18 19:16:19.964263] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:01.420 request: 00:18:01.420 { 00:18:01.420 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.420 "host": "nqn.2016-06.io.spdk:host1", 00:18:01.420 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:01.420 "method": "nvmf_subsystem_add_host", 00:18:01.420 "req_id": 1 00:18:01.420 } 00:18:01.420 Got JSON-RPC error response 00:18:01.420 response: 00:18:01.420 { 00:18:01.420 "code": -32603, 00:18:01.420 "message": "Internal error" 00:18:01.420 } 00:18:01.420 19:16:19 -- common/autotest_common.sh@653 -- # es=1 00:18:01.420 19:16:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:01.420 19:16:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:01.420 19:16:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:01.420 19:16:19 -- target/tls.sh@189 -- # killprocess 3462982 00:18:01.420 19:16:19 -- common/autotest_common.sh@936 -- # '[' -z 3462982 ']' 00:18:01.420 19:16:19 -- common/autotest_common.sh@940 -- # kill -0 3462982 00:18:01.420 19:16:19 -- common/autotest_common.sh@941 -- # uname 00:18:01.420 19:16:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:01.420 19:16:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3462982 00:18:01.420 19:16:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:01.420 19:16:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:01.420 19:16:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3462982' 00:18:01.420 killing process with pid 3462982 00:18:01.420 19:16:20 -- common/autotest_common.sh@955 -- # kill 3462982 00:18:01.420 19:16:20 -- common/autotest_common.sh@960 -- # wait 3462982 00:18:01.985 19:16:20 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.985 19:16:20 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:01.985 19:16:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:01.985 19:16:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:01.985 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:18:01.985 19:16:20 -- nvmf/common.sh@469 -- # nvmfpid=3463391 00:18:01.985 19:16:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:01.985 19:16:20 -- nvmf/common.sh@470 -- # waitforlisten 3463391 00:18:01.985 19:16:20 -- common/autotest_common.sh@829 -- # '[' -z 3463391 ']' 00:18:01.985 19:16:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:01.985 19:16:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:01.985 19:16:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:01.985 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:01.985 19:16:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:01.985 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:18:01.985 [2024-11-18 19:16:20.365807] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:01.985 [2024-11-18 19:16:20.365898] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:01.985 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.986 [2024-11-18 19:16:20.433354] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:01.986 [2024-11-18 19:16:20.548900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:01.986 [2024-11-18 19:16:20.549053] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:01.986 [2024-11-18 19:16:20.549072] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:01.986 [2024-11-18 19:16:20.549086] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:01.986 [2024-11-18 19:16:20.549130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:02.920 19:16:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:02.920 19:16:21 -- common/autotest_common.sh@862 -- # return 0 00:18:02.920 19:16:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:02.920 19:16:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:02.920 19:16:21 -- common/autotest_common.sh@10 -- # set +x 00:18:02.920 19:16:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:02.920 19:16:21 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.920 19:16:21 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.920 19:16:21 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:03.178 [2024-11-18 19:16:21.659004] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:03.178 19:16:21 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:03.436 19:16:21 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:03.694 [2024-11-18 19:16:22.172380] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:03.694 [2024-11-18 19:16:22.172659] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:03.694 19:16:22 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:03.952 malloc0 00:18:03.952 19:16:22 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:04.209 19:16:22 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.467 19:16:22 -- target/tls.sh@197 -- # bdevperf_pid=3463728 00:18:04.467 19:16:22 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:04.467 19:16:22 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:04.467 19:16:22 -- target/tls.sh@200 -- # waitforlisten 3463728 /var/tmp/bdevperf.sock 00:18:04.468 19:16:22 -- common/autotest_common.sh@829 -- # '[' -z 3463728 ']' 00:18:04.468 19:16:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:04.468 19:16:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:04.468 19:16:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:04.468 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:04.468 19:16:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:04.468 19:16:22 -- common/autotest_common.sh@10 -- # set +x 00:18:04.468 [2024-11-18 19:16:23.027964] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:04.468 [2024-11-18 19:16:23.028035] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3463728 ] 00:18:04.468 EAL: No free 2048 kB hugepages reported on node 1 00:18:04.726 [2024-11-18 19:16:23.086646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:04.726 [2024-11-18 19:16:23.195365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:05.659 19:16:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:05.659 19:16:24 -- common/autotest_common.sh@862 -- # return 0 00:18:05.659 19:16:24 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:05.659 [2024-11-18 19:16:24.257260] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:05.917 TLSTESTn1 00:18:05.917 19:16:24 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:06.175 19:16:24 -- target/tls.sh@205 -- # tgtconf='{ 00:18:06.175 "subsystems": [ 00:18:06.175 { 00:18:06.175 "subsystem": "iobuf", 00:18:06.175 "config": [ 00:18:06.175 { 00:18:06.175 "method": "iobuf_set_options", 00:18:06.175 "params": { 00:18:06.175 "small_pool_count": 8192, 00:18:06.175 "large_pool_count": 1024, 00:18:06.175 "small_bufsize": 8192, 00:18:06.175 "large_bufsize": 135168 00:18:06.175 } 00:18:06.175 } 00:18:06.175 ] 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "subsystem": "sock", 00:18:06.175 "config": [ 00:18:06.175 { 00:18:06.175 "method": "sock_impl_set_options", 00:18:06.175 "params": { 00:18:06.175 "impl_name": "posix", 00:18:06.175 "recv_buf_size": 2097152, 00:18:06.175 "send_buf_size": 2097152, 00:18:06.175 "enable_recv_pipe": true, 00:18:06.175 "enable_quickack": false, 00:18:06.175 "enable_placement_id": 0, 00:18:06.175 "enable_zerocopy_send_server": true, 00:18:06.175 "enable_zerocopy_send_client": false, 00:18:06.175 "zerocopy_threshold": 0, 00:18:06.175 "tls_version": 0, 00:18:06.175 "enable_ktls": false 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "sock_impl_set_options", 00:18:06.175 "params": { 00:18:06.175 "impl_name": "ssl", 00:18:06.175 "recv_buf_size": 4096, 00:18:06.175 "send_buf_size": 4096, 00:18:06.175 "enable_recv_pipe": true, 00:18:06.175 "enable_quickack": false, 00:18:06.175 "enable_placement_id": 0, 00:18:06.175 "enable_zerocopy_send_server": true, 00:18:06.175 "enable_zerocopy_send_client": false, 00:18:06.175 "zerocopy_threshold": 0, 00:18:06.175 "tls_version": 0, 00:18:06.175 "enable_ktls": false 00:18:06.175 } 00:18:06.175 } 00:18:06.175 ] 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "subsystem": "vmd", 00:18:06.175 "config": [] 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "subsystem": "accel", 00:18:06.175 "config": [ 00:18:06.175 { 00:18:06.175 "method": "accel_set_options", 00:18:06.175 "params": { 00:18:06.175 "small_cache_size": 128, 00:18:06.175 "large_cache_size": 16, 00:18:06.175 "task_count": 2048, 00:18:06.175 "sequence_count": 2048, 00:18:06.175 "buf_count": 2048 00:18:06.175 } 00:18:06.175 } 00:18:06.175 ] 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "subsystem": "bdev", 00:18:06.175 "config": [ 00:18:06.175 { 00:18:06.175 "method": "bdev_set_options", 00:18:06.175 "params": { 00:18:06.175 "bdev_io_pool_size": 65535, 00:18:06.175 "bdev_io_cache_size": 256, 00:18:06.175 "bdev_auto_examine": true, 00:18:06.175 "iobuf_small_cache_size": 128, 00:18:06.175 "iobuf_large_cache_size": 16 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "bdev_raid_set_options", 00:18:06.175 "params": { 00:18:06.175 "process_window_size_kb": 1024 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "bdev_iscsi_set_options", 00:18:06.175 "params": { 00:18:06.175 "timeout_sec": 30 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "bdev_nvme_set_options", 00:18:06.175 "params": { 00:18:06.175 "action_on_timeout": "none", 00:18:06.175 "timeout_us": 0, 00:18:06.175 "timeout_admin_us": 0, 00:18:06.175 "keep_alive_timeout_ms": 10000, 00:18:06.175 "transport_retry_count": 4, 00:18:06.175 "arbitration_burst": 0, 00:18:06.175 "low_priority_weight": 0, 00:18:06.175 "medium_priority_weight": 0, 00:18:06.175 "high_priority_weight": 0, 00:18:06.175 "nvme_adminq_poll_period_us": 10000, 00:18:06.175 "nvme_ioq_poll_period_us": 0, 00:18:06.175 "io_queue_requests": 0, 00:18:06.175 "delay_cmd_submit": true, 00:18:06.175 "bdev_retry_count": 3, 00:18:06.175 "transport_ack_timeout": 0, 00:18:06.175 "ctrlr_loss_timeout_sec": 0, 00:18:06.175 "reconnect_delay_sec": 0, 00:18:06.175 "fast_io_fail_timeout_sec": 0, 00:18:06.175 "generate_uuids": false, 00:18:06.175 "transport_tos": 0, 00:18:06.175 "io_path_stat": false, 00:18:06.175 "allow_accel_sequence": false 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "bdev_nvme_set_hotplug", 00:18:06.175 "params": { 00:18:06.175 "period_us": 100000, 00:18:06.175 "enable": false 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "bdev_malloc_create", 00:18:06.175 "params": { 00:18:06.175 "name": "malloc0", 00:18:06.175 "num_blocks": 8192, 00:18:06.175 "block_size": 4096, 00:18:06.175 "physical_block_size": 4096, 00:18:06.175 "uuid": "e4d37052-bdfc-4541-9dce-1f5765d02b75", 00:18:06.175 "optimal_io_boundary": 0 00:18:06.175 } 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "method": "bdev_wait_for_examine" 00:18:06.175 } 00:18:06.175 ] 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "subsystem": "nbd", 00:18:06.175 "config": [] 00:18:06.175 }, 00:18:06.175 { 00:18:06.175 "subsystem": "scheduler", 00:18:06.175 "config": [ 00:18:06.175 { 00:18:06.175 "method": "framework_set_scheduler", 00:18:06.175 "params": { 00:18:06.175 "name": "static" 00:18:06.175 } 00:18:06.175 } 00:18:06.175 ] 00:18:06.175 }, 00:18:06.176 { 00:18:06.176 "subsystem": "nvmf", 00:18:06.176 "config": [ 00:18:06.176 { 00:18:06.176 "method": "nvmf_set_config", 00:18:06.176 "params": { 00:18:06.176 "discovery_filter": "match_any", 00:18:06.176 "admin_cmd_passthru": { 00:18:06.176 "identify_ctrlr": false 00:18:06.176 } 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_set_max_subsystems", 00:18:06.176 "params": { 00:18:06.176 "max_subsystems": 1024 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_set_crdt", 00:18:06.176 "params": { 00:18:06.176 "crdt1": 0, 00:18:06.176 "crdt2": 0, 00:18:06.176 "crdt3": 0 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_create_transport", 00:18:06.176 "params": { 00:18:06.176 "trtype": "TCP", 00:18:06.176 "max_queue_depth": 128, 00:18:06.176 "max_io_qpairs_per_ctrlr": 127, 00:18:06.176 "in_capsule_data_size": 4096, 00:18:06.176 "max_io_size": 131072, 00:18:06.176 "io_unit_size": 131072, 00:18:06.176 "max_aq_depth": 128, 00:18:06.176 "num_shared_buffers": 511, 00:18:06.176 "buf_cache_size": 4294967295, 00:18:06.176 "dif_insert_or_strip": false, 00:18:06.176 "zcopy": false, 00:18:06.176 "c2h_success": false, 00:18:06.176 "sock_priority": 0, 00:18:06.176 "abort_timeout_sec": 1 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_create_subsystem", 00:18:06.176 "params": { 00:18:06.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.176 "allow_any_host": false, 00:18:06.176 "serial_number": "SPDK00000000000001", 00:18:06.176 "model_number": "SPDK bdev Controller", 00:18:06.176 "max_namespaces": 10, 00:18:06.176 "min_cntlid": 1, 00:18:06.176 "max_cntlid": 65519, 00:18:06.176 "ana_reporting": false 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_subsystem_add_host", 00:18:06.176 "params": { 00:18:06.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.176 "host": "nqn.2016-06.io.spdk:host1", 00:18:06.176 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_subsystem_add_ns", 00:18:06.176 "params": { 00:18:06.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.176 "namespace": { 00:18:06.176 "nsid": 1, 00:18:06.176 "bdev_name": "malloc0", 00:18:06.176 "nguid": "E4D37052BDFC45419DCE1F5765D02B75", 00:18:06.176 "uuid": "e4d37052-bdfc-4541-9dce-1f5765d02b75" 00:18:06.176 } 00:18:06.176 } 00:18:06.176 }, 00:18:06.176 { 00:18:06.176 "method": "nvmf_subsystem_add_listener", 00:18:06.176 "params": { 00:18:06.176 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.176 "listen_address": { 00:18:06.176 "trtype": "TCP", 00:18:06.176 "adrfam": "IPv4", 00:18:06.176 "traddr": "10.0.0.2", 00:18:06.176 "trsvcid": "4420" 00:18:06.176 }, 00:18:06.176 "secure_channel": true 00:18:06.176 } 00:18:06.176 } 00:18:06.176 ] 00:18:06.176 } 00:18:06.176 ] 00:18:06.176 }' 00:18:06.176 19:16:24 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:06.742 19:16:25 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:06.742 "subsystems": [ 00:18:06.742 { 00:18:06.742 "subsystem": "iobuf", 00:18:06.742 "config": [ 00:18:06.742 { 00:18:06.742 "method": "iobuf_set_options", 00:18:06.742 "params": { 00:18:06.742 "small_pool_count": 8192, 00:18:06.742 "large_pool_count": 1024, 00:18:06.742 "small_bufsize": 8192, 00:18:06.742 "large_bufsize": 135168 00:18:06.742 } 00:18:06.742 } 00:18:06.742 ] 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "subsystem": "sock", 00:18:06.742 "config": [ 00:18:06.742 { 00:18:06.742 "method": "sock_impl_set_options", 00:18:06.742 "params": { 00:18:06.742 "impl_name": "posix", 00:18:06.742 "recv_buf_size": 2097152, 00:18:06.742 "send_buf_size": 2097152, 00:18:06.742 "enable_recv_pipe": true, 00:18:06.742 "enable_quickack": false, 00:18:06.742 "enable_placement_id": 0, 00:18:06.742 "enable_zerocopy_send_server": true, 00:18:06.742 "enable_zerocopy_send_client": false, 00:18:06.742 "zerocopy_threshold": 0, 00:18:06.742 "tls_version": 0, 00:18:06.742 "enable_ktls": false 00:18:06.742 } 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "method": "sock_impl_set_options", 00:18:06.742 "params": { 00:18:06.742 "impl_name": "ssl", 00:18:06.742 "recv_buf_size": 4096, 00:18:06.742 "send_buf_size": 4096, 00:18:06.742 "enable_recv_pipe": true, 00:18:06.742 "enable_quickack": false, 00:18:06.742 "enable_placement_id": 0, 00:18:06.742 "enable_zerocopy_send_server": true, 00:18:06.742 "enable_zerocopy_send_client": false, 00:18:06.742 "zerocopy_threshold": 0, 00:18:06.742 "tls_version": 0, 00:18:06.742 "enable_ktls": false 00:18:06.742 } 00:18:06.742 } 00:18:06.742 ] 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "subsystem": "vmd", 00:18:06.742 "config": [] 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "subsystem": "accel", 00:18:06.742 "config": [ 00:18:06.742 { 00:18:06.742 "method": "accel_set_options", 00:18:06.742 "params": { 00:18:06.742 "small_cache_size": 128, 00:18:06.742 "large_cache_size": 16, 00:18:06.742 "task_count": 2048, 00:18:06.742 "sequence_count": 2048, 00:18:06.742 "buf_count": 2048 00:18:06.742 } 00:18:06.742 } 00:18:06.742 ] 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "subsystem": "bdev", 00:18:06.742 "config": [ 00:18:06.742 { 00:18:06.742 "method": "bdev_set_options", 00:18:06.742 "params": { 00:18:06.742 "bdev_io_pool_size": 65535, 00:18:06.742 "bdev_io_cache_size": 256, 00:18:06.742 "bdev_auto_examine": true, 00:18:06.742 "iobuf_small_cache_size": 128, 00:18:06.742 "iobuf_large_cache_size": 16 00:18:06.742 } 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "method": "bdev_raid_set_options", 00:18:06.742 "params": { 00:18:06.742 "process_window_size_kb": 1024 00:18:06.742 } 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "method": "bdev_iscsi_set_options", 00:18:06.742 "params": { 00:18:06.742 "timeout_sec": 30 00:18:06.742 } 00:18:06.742 }, 00:18:06.742 { 00:18:06.742 "method": "bdev_nvme_set_options", 00:18:06.742 "params": { 00:18:06.742 "action_on_timeout": "none", 00:18:06.742 "timeout_us": 0, 00:18:06.742 "timeout_admin_us": 0, 00:18:06.742 "keep_alive_timeout_ms": 10000, 00:18:06.742 "transport_retry_count": 4, 00:18:06.742 "arbitration_burst": 0, 00:18:06.742 "low_priority_weight": 0, 00:18:06.742 "medium_priority_weight": 0, 00:18:06.742 "high_priority_weight": 0, 00:18:06.742 "nvme_adminq_poll_period_us": 10000, 00:18:06.742 "nvme_ioq_poll_period_us": 0, 00:18:06.742 "io_queue_requests": 512, 00:18:06.742 "delay_cmd_submit": true, 00:18:06.743 "bdev_retry_count": 3, 00:18:06.743 "transport_ack_timeout": 0, 00:18:06.743 "ctrlr_loss_timeout_sec": 0, 00:18:06.743 "reconnect_delay_sec": 0, 00:18:06.743 "fast_io_fail_timeout_sec": 0, 00:18:06.743 "generate_uuids": false, 00:18:06.743 "transport_tos": 0, 00:18:06.743 "io_path_stat": false, 00:18:06.743 "allow_accel_sequence": false 00:18:06.743 } 00:18:06.743 }, 00:18:06.743 { 00:18:06.743 "method": "bdev_nvme_attach_controller", 00:18:06.743 "params": { 00:18:06.743 "name": "TLSTEST", 00:18:06.743 "trtype": "TCP", 00:18:06.743 "adrfam": "IPv4", 00:18:06.743 "traddr": "10.0.0.2", 00:18:06.743 "trsvcid": "4420", 00:18:06.743 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.743 "prchk_reftag": false, 00:18:06.743 "prchk_guard": false, 00:18:06.743 "ctrlr_loss_timeout_sec": 0, 00:18:06.743 "reconnect_delay_sec": 0, 00:18:06.743 "fast_io_fail_timeout_sec": 0, 00:18:06.743 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:06.743 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:06.743 "hdgst": false, 00:18:06.743 "ddgst": false 00:18:06.743 } 00:18:06.743 }, 00:18:06.743 { 00:18:06.743 "method": "bdev_nvme_set_hotplug", 00:18:06.743 "params": { 00:18:06.743 "period_us": 100000, 00:18:06.743 "enable": false 00:18:06.743 } 00:18:06.743 }, 00:18:06.743 { 00:18:06.743 "method": "bdev_wait_for_examine" 00:18:06.743 } 00:18:06.743 ] 00:18:06.743 }, 00:18:06.743 { 00:18:06.743 "subsystem": "nbd", 00:18:06.743 "config": [] 00:18:06.743 } 00:18:06.743 ] 00:18:06.743 }' 00:18:06.743 19:16:25 -- target/tls.sh@208 -- # killprocess 3463728 00:18:06.743 19:16:25 -- common/autotest_common.sh@936 -- # '[' -z 3463728 ']' 00:18:06.743 19:16:25 -- common/autotest_common.sh@940 -- # kill -0 3463728 00:18:06.743 19:16:25 -- common/autotest_common.sh@941 -- # uname 00:18:06.743 19:16:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.743 19:16:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3463728 00:18:06.743 19:16:25 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:06.743 19:16:25 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:06.743 19:16:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3463728' 00:18:06.743 killing process with pid 3463728 00:18:06.743 19:16:25 -- common/autotest_common.sh@955 -- # kill 3463728 00:18:06.743 Received shutdown signal, test time was about 10.000000 seconds 00:18:06.743 00:18:06.743 Latency(us) 00:18:06.743 [2024-11-18T18:16:25.348Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.743 [2024-11-18T18:16:25.348Z] =================================================================================================================== 00:18:06.743 [2024-11-18T18:16:25.348Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:06.743 19:16:25 -- common/autotest_common.sh@960 -- # wait 3463728 00:18:06.743 19:16:25 -- target/tls.sh@209 -- # killprocess 3463391 00:18:06.743 19:16:25 -- common/autotest_common.sh@936 -- # '[' -z 3463391 ']' 00:18:06.743 19:16:25 -- common/autotest_common.sh@940 -- # kill -0 3463391 00:18:06.743 19:16:25 -- common/autotest_common.sh@941 -- # uname 00:18:07.001 19:16:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:07.001 19:16:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3463391 00:18:07.001 19:16:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:07.001 19:16:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:07.001 19:16:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3463391' 00:18:07.001 killing process with pid 3463391 00:18:07.001 19:16:25 -- common/autotest_common.sh@955 -- # kill 3463391 00:18:07.001 19:16:25 -- common/autotest_common.sh@960 -- # wait 3463391 00:18:07.260 19:16:25 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:07.260 19:16:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:07.260 19:16:25 -- target/tls.sh@212 -- # echo '{ 00:18:07.260 "subsystems": [ 00:18:07.260 { 00:18:07.260 "subsystem": "iobuf", 00:18:07.260 "config": [ 00:18:07.260 { 00:18:07.260 "method": "iobuf_set_options", 00:18:07.260 "params": { 00:18:07.260 "small_pool_count": 8192, 00:18:07.260 "large_pool_count": 1024, 00:18:07.260 "small_bufsize": 8192, 00:18:07.260 "large_bufsize": 135168 00:18:07.260 } 00:18:07.260 } 00:18:07.260 ] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "sock", 00:18:07.260 "config": [ 00:18:07.260 { 00:18:07.260 "method": "sock_impl_set_options", 00:18:07.260 "params": { 00:18:07.260 "impl_name": "posix", 00:18:07.260 "recv_buf_size": 2097152, 00:18:07.260 "send_buf_size": 2097152, 00:18:07.260 "enable_recv_pipe": true, 00:18:07.260 "enable_quickack": false, 00:18:07.260 "enable_placement_id": 0, 00:18:07.260 "enable_zerocopy_send_server": true, 00:18:07.260 "enable_zerocopy_send_client": false, 00:18:07.260 "zerocopy_threshold": 0, 00:18:07.260 "tls_version": 0, 00:18:07.260 "enable_ktls": false 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "sock_impl_set_options", 00:18:07.260 "params": { 00:18:07.260 "impl_name": "ssl", 00:18:07.260 "recv_buf_size": 4096, 00:18:07.260 "send_buf_size": 4096, 00:18:07.260 "enable_recv_pipe": true, 00:18:07.260 "enable_quickack": false, 00:18:07.260 "enable_placement_id": 0, 00:18:07.260 "enable_zerocopy_send_server": true, 00:18:07.260 "enable_zerocopy_send_client": false, 00:18:07.260 "zerocopy_threshold": 0, 00:18:07.260 "tls_version": 0, 00:18:07.260 "enable_ktls": false 00:18:07.260 } 00:18:07.260 } 00:18:07.260 ] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "vmd", 00:18:07.260 "config": [] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "accel", 00:18:07.260 "config": [ 00:18:07.260 { 00:18:07.260 "method": "accel_set_options", 00:18:07.260 "params": { 00:18:07.260 "small_cache_size": 128, 00:18:07.260 "large_cache_size": 16, 00:18:07.260 "task_count": 2048, 00:18:07.260 "sequence_count": 2048, 00:18:07.260 "buf_count": 2048 00:18:07.260 } 00:18:07.260 } 00:18:07.260 ] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "bdev", 00:18:07.260 "config": [ 00:18:07.260 { 00:18:07.260 "method": "bdev_set_options", 00:18:07.260 "params": { 00:18:07.260 "bdev_io_pool_size": 65535, 00:18:07.260 "bdev_io_cache_size": 256, 00:18:07.260 "bdev_auto_examine": true, 00:18:07.260 "iobuf_small_cache_size": 128, 00:18:07.260 "iobuf_large_cache_size": 16 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "bdev_raid_set_options", 00:18:07.260 "params": { 00:18:07.260 "process_window_size_kb": 1024 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "bdev_iscsi_set_options", 00:18:07.260 "params": { 00:18:07.260 "timeout_sec": 30 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "bdev_nvme_set_options", 00:18:07.260 "params": { 00:18:07.260 "action_on_timeout": "none", 00:18:07.260 "timeout_us": 0, 00:18:07.260 "timeout_admin_us": 0, 00:18:07.260 "keep_alive_timeout_ms": 10000, 00:18:07.260 "transport_retry_count": 4, 00:18:07.260 "arbitration_burst": 0, 00:18:07.260 "low_priority_weight": 0, 00:18:07.260 "medium_priority_weight": 0, 00:18:07.260 "high_priority_weight": 0, 00:18:07.260 "nvme_adminq_poll_period_us": 10000, 00:18:07.260 "nvme_ioq_poll_period_us": 0, 00:18:07.260 "io_queue_requests": 0, 00:18:07.260 "delay_cmd_submit": true, 00:18:07.260 "bdev_retry_count": 3, 00:18:07.260 "transport_ack_timeout": 0, 00:18:07.260 "ctrlr_loss_timeout_sec": 0, 00:18:07.260 "reconnect_delay_sec": 0, 00:18:07.260 "fast_io_fail_timeout_sec": 0, 00:18:07.260 "generate_uuids": false, 00:18:07.260 "transport_tos": 0, 00:18:07.260 "io_path_stat": false, 00:18:07.260 "allow_accel_sequence": false 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "bdev_nvme_set_hotplug", 00:18:07.260 "params": { 00:18:07.260 "period_us": 100000, 00:18:07.260 "enable": false 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "bdev_malloc_create", 00:18:07.260 "params": { 00:18:07.260 "name": "malloc0", 00:18:07.260 "num_blocks": 8192, 00:18:07.260 "block_size": 4096, 00:18:07.260 "physical_block_size": 4096, 00:18:07.260 "uuid": "e4d37052-bdfc-4541-9dce-1f5765d02b75", 00:18:07.260 "optimal_io_boundary": 0 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "bdev_wait_for_examine" 00:18:07.260 } 00:18:07.260 ] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "nbd", 00:18:07.260 "config": [] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "scheduler", 00:18:07.260 "config": [ 00:18:07.260 { 00:18:07.260 "method": "framework_set_scheduler", 00:18:07.260 "params": { 00:18:07.260 "name": "static" 00:18:07.260 } 00:18:07.260 } 00:18:07.260 ] 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "subsystem": "nvmf", 00:18:07.260 "config": [ 00:18:07.260 { 00:18:07.260 "method": "nvmf_set_config", 00:18:07.260 "params": { 00:18:07.260 "discovery_filter": "match_any", 00:18:07.260 "admin_cmd_passthru": { 00:18:07.260 "identify_ctrlr": false 00:18:07.260 } 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "nvmf_set_max_subsystems", 00:18:07.260 "params": { 00:18:07.260 "max_subsystems": 1024 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "nvmf_set_crdt", 00:18:07.260 "params": { 00:18:07.260 "crdt1": 0, 00:18:07.260 "crdt2": 0, 00:18:07.260 "crdt3": 0 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "nvmf_create_transport", 00:18:07.260 "params": { 00:18:07.260 "trtype": "TCP", 00:18:07.260 "max_queue_depth": 128, 00:18:07.260 "max_io_qpairs_per_ctrlr": 127, 00:18:07.260 "in_capsule_data_size": 4096, 00:18:07.260 "max_io_size": 131072, 00:18:07.260 "io_unit_size": 131072, 00:18:07.260 "max_aq_depth": 128, 00:18:07.260 "num_shared_buffers": 511, 00:18:07.260 "buf_cache_size": 4294967295, 00:18:07.260 "dif_insert_or_strip": false, 00:18:07.260 "zcopy": false, 00:18:07.260 "c2h_success": false, 00:18:07.260 "sock_priority": 0, 00:18:07.260 "abort_timeout_sec": 1 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "nvmf_create_subsystem", 00:18:07.260 "params": { 00:18:07.260 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.260 "allow_any_host": false, 00:18:07.260 "serial_number": "SPDK00000000000001", 00:18:07.260 "model_number": "SPDK bdev Controller", 00:18:07.260 "max_namespaces": 10, 00:18:07.260 "min_cntlid": 1, 00:18:07.260 "max_cntlid": 65519, 00:18:07.260 "ana_reporting": false 00:18:07.260 } 00:18:07.260 }, 00:18:07.260 { 00:18:07.260 "method": "nvmf_subsystem_add_host", 00:18:07.261 "params": { 00:18:07.261 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.261 "host": "nqn.2016-06.io.spdk:host1", 00:18:07.261 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:07.261 } 00:18:07.261 }, 00:18:07.261 { 00:18:07.261 "method": "nvmf_subsystem_add_ns", 00:18:07.261 "params": { 00:18:07.261 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.261 "namespace": { 00:18:07.261 "nsid": 1, 00:18:07.261 "bdev_name": "malloc0", 00:18:07.261 "nguid": "E4D37052BDFC45419DCE1F5765D02B75", 00:18:07.261 "uuid": "e4d37052-bdfc-4541-9dce-1f5765d02b75" 00:18:07.261 } 00:18:07.261 } 00:18:07.261 }, 00:18:07.261 { 00:18:07.261 "method": "nvmf_subsystem_add_listener", 00:18:07.261 "params": { 00:18:07.261 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.261 "listen_address": { 00:18:07.261 "trtype": "TCP", 00:18:07.261 "adrfam": "IPv4", 00:18:07.261 "traddr": "10.0.0.2", 00:18:07.261 "trsvcid": "4420" 00:18:07.261 }, 00:18:07.261 "secure_channel": true 00:18:07.261 } 00:18:07.261 } 00:18:07.261 ] 00:18:07.261 } 00:18:07.261 ] 00:18:07.261 }' 00:18:07.261 19:16:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:07.261 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:18:07.261 19:16:25 -- nvmf/common.sh@469 -- # nvmfpid=3464021 00:18:07.261 19:16:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:07.261 19:16:25 -- nvmf/common.sh@470 -- # waitforlisten 3464021 00:18:07.261 19:16:25 -- common/autotest_common.sh@829 -- # '[' -z 3464021 ']' 00:18:07.261 19:16:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:07.261 19:16:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:07.261 19:16:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:07.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:07.261 19:16:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:07.261 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:18:07.261 [2024-11-18 19:16:25.712870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:07.261 [2024-11-18 19:16:25.712959] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:07.261 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.261 [2024-11-18 19:16:25.779180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.519 [2024-11-18 19:16:25.898481] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:07.519 [2024-11-18 19:16:25.898680] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:07.519 [2024-11-18 19:16:25.898701] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:07.519 [2024-11-18 19:16:25.898716] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:07.519 [2024-11-18 19:16:25.898755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.776 [2024-11-18 19:16:26.128099] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.776 [2024-11-18 19:16:26.160106] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:07.776 [2024-11-18 19:16:26.160411] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:08.343 19:16:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:08.343 19:16:26 -- common/autotest_common.sh@862 -- # return 0 00:18:08.343 19:16:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:08.343 19:16:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:08.343 19:16:26 -- common/autotest_common.sh@10 -- # set +x 00:18:08.343 19:16:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:08.343 19:16:26 -- target/tls.sh@216 -- # bdevperf_pid=3464175 00:18:08.343 19:16:26 -- target/tls.sh@217 -- # waitforlisten 3464175 /var/tmp/bdevperf.sock 00:18:08.343 19:16:26 -- common/autotest_common.sh@829 -- # '[' -z 3464175 ']' 00:18:08.343 19:16:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:08.343 19:16:26 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:08.343 19:16:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.343 19:16:26 -- target/tls.sh@213 -- # echo '{ 00:18:08.343 "subsystems": [ 00:18:08.343 { 00:18:08.343 "subsystem": "iobuf", 00:18:08.343 "config": [ 00:18:08.343 { 00:18:08.343 "method": "iobuf_set_options", 00:18:08.343 "params": { 00:18:08.343 "small_pool_count": 8192, 00:18:08.343 "large_pool_count": 1024, 00:18:08.343 "small_bufsize": 8192, 00:18:08.343 "large_bufsize": 135168 00:18:08.343 } 00:18:08.343 } 00:18:08.343 ] 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "subsystem": "sock", 00:18:08.343 "config": [ 00:18:08.343 { 00:18:08.343 "method": "sock_impl_set_options", 00:18:08.343 "params": { 00:18:08.343 "impl_name": "posix", 00:18:08.343 "recv_buf_size": 2097152, 00:18:08.343 "send_buf_size": 2097152, 00:18:08.343 "enable_recv_pipe": true, 00:18:08.343 "enable_quickack": false, 00:18:08.343 "enable_placement_id": 0, 00:18:08.343 "enable_zerocopy_send_server": true, 00:18:08.343 "enable_zerocopy_send_client": false, 00:18:08.343 "zerocopy_threshold": 0, 00:18:08.343 "tls_version": 0, 00:18:08.343 "enable_ktls": false 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "sock_impl_set_options", 00:18:08.343 "params": { 00:18:08.343 "impl_name": "ssl", 00:18:08.343 "recv_buf_size": 4096, 00:18:08.343 "send_buf_size": 4096, 00:18:08.343 "enable_recv_pipe": true, 00:18:08.343 "enable_quickack": false, 00:18:08.343 "enable_placement_id": 0, 00:18:08.343 "enable_zerocopy_send_server": true, 00:18:08.343 "enable_zerocopy_send_client": false, 00:18:08.343 "zerocopy_threshold": 0, 00:18:08.343 "tls_version": 0, 00:18:08.343 "enable_ktls": false 00:18:08.343 } 00:18:08.343 } 00:18:08.343 ] 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "subsystem": "vmd", 00:18:08.343 "config": [] 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "subsystem": "accel", 00:18:08.343 "config": [ 00:18:08.343 { 00:18:08.343 "method": "accel_set_options", 00:18:08.343 "params": { 00:18:08.343 "small_cache_size": 128, 00:18:08.343 "large_cache_size": 16, 00:18:08.343 "task_count": 2048, 00:18:08.343 "sequence_count": 2048, 00:18:08.343 "buf_count": 2048 00:18:08.343 } 00:18:08.343 } 00:18:08.343 ] 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "subsystem": "bdev", 00:18:08.343 "config": [ 00:18:08.343 { 00:18:08.343 "method": "bdev_set_options", 00:18:08.343 "params": { 00:18:08.343 "bdev_io_pool_size": 65535, 00:18:08.343 "bdev_io_cache_size": 256, 00:18:08.343 "bdev_auto_examine": true, 00:18:08.343 "iobuf_small_cache_size": 128, 00:18:08.343 "iobuf_large_cache_size": 16 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "bdev_raid_set_options", 00:18:08.343 "params": { 00:18:08.343 "process_window_size_kb": 1024 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "bdev_iscsi_set_options", 00:18:08.343 "params": { 00:18:08.343 "timeout_sec": 30 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "bdev_nvme_set_options", 00:18:08.343 "params": { 00:18:08.343 "action_on_timeout": "none", 00:18:08.343 "timeout_us": 0, 00:18:08.343 "timeout_admin_us": 0, 00:18:08.343 "keep_alive_timeout_ms": 10000, 00:18:08.343 "transport_retry_count": 4, 00:18:08.343 "arbitration_burst": 0, 00:18:08.343 "low_priority_weight": 0, 00:18:08.343 "medium_priority_weight": 0, 00:18:08.343 "high_priority_weight": 0, 00:18:08.343 "nvme_adminq_poll_period_us": 10000, 00:18:08.343 "nvme_ioq_poll_period_us": 0, 00:18:08.343 "io_queue_requests": 512, 00:18:08.343 "delay_cmd_submit": true, 00:18:08.343 "bdev_retry_count": 3, 00:18:08.343 "transport_ack_timeout": 0, 00:18:08.343 "ctrlr_loss_timeout_sec": 0, 00:18:08.343 "reconnect_delay_sec": 0, 00:18:08.343 "fast_io_fail_timeout_sec": 0, 00:18:08.343 "generate_uuids": false, 00:18:08.343 "transport_tos": 0, 00:18:08.343 "io_path_stat": false, 00:18:08.343 "allow_accel_sequence": false 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "bdev_nvme_attach_controller", 00:18:08.343 "params": { 00:18:08.343 "name": "TLSTEST", 00:18:08.343 "trtype": "TCP", 00:18:08.343 "adrfam": "IPv4", 00:18:08.343 "traddr": "10.0.0.2", 00:18:08.343 "trsvcid": "4420", 00:18:08.343 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.343 "prchk_reftag": false, 00:18:08.343 "prchk_guard": false, 00:18:08.343 "ctrlr_loss_timeout_sec": 0, 00:18:08.343 "reconnect_delay_sec": 0, 00:18:08.343 "fast_io_fail_timeout_sec": 0, 00:18:08.343 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:08.343 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:08.343 "hdgst": false, 00:18:08.343 "ddgst": false 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "bdev_nvme_set_hotplug", 00:18:08.343 "params": { 00:18:08.343 "period_us": 100000, 00:18:08.343 "enable": false 00:18:08.343 } 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "method": "bdev_wait_for_examine" 00:18:08.343 } 00:18:08.343 ] 00:18:08.343 }, 00:18:08.343 { 00:18:08.343 "subsystem": "nbd", 00:18:08.343 "config": [] 00:18:08.343 } 00:18:08.343 ] 00:18:08.343 }' 00:18:08.343 19:16:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:08.343 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:08.343 19:16:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.343 19:16:26 -- common/autotest_common.sh@10 -- # set +x 00:18:08.343 [2024-11-18 19:16:26.848729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:08.343 [2024-11-18 19:16:26.848824] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3464175 ] 00:18:08.343 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.343 [2024-11-18 19:16:26.911720] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.602 [2024-11-18 19:16:27.031475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:08.602 [2024-11-18 19:16:27.191623] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:09.537 19:16:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.537 19:16:27 -- common/autotest_common.sh@862 -- # return 0 00:18:09.537 19:16:27 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:09.537 Running I/O for 10 seconds... 00:18:19.502 00:18:19.502 Latency(us) 00:18:19.502 [2024-11-18T18:16:38.107Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.502 [2024-11-18T18:16:38.107Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:19.502 Verification LBA range: start 0x0 length 0x2000 00:18:19.502 TLSTESTn1 : 10.02 4629.47 18.08 0.00 0.00 27608.33 5898.24 45244.11 00:18:19.502 [2024-11-18T18:16:38.107Z] =================================================================================================================== 00:18:19.502 [2024-11-18T18:16:38.107Z] Total : 4629.47 18.08 0.00 0.00 27608.33 5898.24 45244.11 00:18:19.502 0 00:18:19.502 19:16:37 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:19.502 19:16:37 -- target/tls.sh@223 -- # killprocess 3464175 00:18:19.502 19:16:37 -- common/autotest_common.sh@936 -- # '[' -z 3464175 ']' 00:18:19.502 19:16:37 -- common/autotest_common.sh@940 -- # kill -0 3464175 00:18:19.502 19:16:37 -- common/autotest_common.sh@941 -- # uname 00:18:19.502 19:16:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.502 19:16:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3464175 00:18:19.502 19:16:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:19.502 19:16:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:19.502 19:16:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3464175' 00:18:19.502 killing process with pid 3464175 00:18:19.502 19:16:38 -- common/autotest_common.sh@955 -- # kill 3464175 00:18:19.502 Received shutdown signal, test time was about 10.000000 seconds 00:18:19.502 00:18:19.502 Latency(us) 00:18:19.502 [2024-11-18T18:16:38.107Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.502 [2024-11-18T18:16:38.107Z] =================================================================================================================== 00:18:19.502 [2024-11-18T18:16:38.107Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:19.502 19:16:38 -- common/autotest_common.sh@960 -- # wait 3464175 00:18:19.760 19:16:38 -- target/tls.sh@224 -- # killprocess 3464021 00:18:19.760 19:16:38 -- common/autotest_common.sh@936 -- # '[' -z 3464021 ']' 00:18:19.760 19:16:38 -- common/autotest_common.sh@940 -- # kill -0 3464021 00:18:19.760 19:16:38 -- common/autotest_common.sh@941 -- # uname 00:18:19.760 19:16:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.760 19:16:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3464021 00:18:19.760 19:16:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:19.760 19:16:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:19.760 19:16:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3464021' 00:18:19.760 killing process with pid 3464021 00:18:19.760 19:16:38 -- common/autotest_common.sh@955 -- # kill 3464021 00:18:19.760 19:16:38 -- common/autotest_common.sh@960 -- # wait 3464021 00:18:20.018 19:16:38 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:20.018 19:16:38 -- target/tls.sh@227 -- # cleanup 00:18:20.018 19:16:38 -- target/tls.sh@15 -- # process_shm --id 0 00:18:20.018 19:16:38 -- common/autotest_common.sh@806 -- # type=--id 00:18:20.018 19:16:38 -- common/autotest_common.sh@807 -- # id=0 00:18:20.018 19:16:38 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:20.018 19:16:38 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:20.018 19:16:38 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:20.018 19:16:38 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:20.018 19:16:38 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:20.018 19:16:38 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:20.018 nvmf_trace.0 00:18:20.277 19:16:38 -- common/autotest_common.sh@821 -- # return 0 00:18:20.277 19:16:38 -- target/tls.sh@16 -- # killprocess 3464175 00:18:20.277 19:16:38 -- common/autotest_common.sh@936 -- # '[' -z 3464175 ']' 00:18:20.277 19:16:38 -- common/autotest_common.sh@940 -- # kill -0 3464175 00:18:20.277 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3464175) - No such process 00:18:20.277 19:16:38 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3464175 is not found' 00:18:20.277 Process with pid 3464175 is not found 00:18:20.277 19:16:38 -- target/tls.sh@17 -- # nvmftestfini 00:18:20.277 19:16:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.277 19:16:38 -- nvmf/common.sh@116 -- # sync 00:18:20.277 19:16:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.277 19:16:38 -- nvmf/common.sh@119 -- # set +e 00:18:20.277 19:16:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.277 19:16:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.277 rmmod nvme_tcp 00:18:20.277 rmmod nvme_fabrics 00:18:20.277 rmmod nvme_keyring 00:18:20.277 19:16:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.277 19:16:38 -- nvmf/common.sh@123 -- # set -e 00:18:20.277 19:16:38 -- nvmf/common.sh@124 -- # return 0 00:18:20.277 19:16:38 -- nvmf/common.sh@477 -- # '[' -n 3464021 ']' 00:18:20.277 19:16:38 -- nvmf/common.sh@478 -- # killprocess 3464021 00:18:20.277 19:16:38 -- common/autotest_common.sh@936 -- # '[' -z 3464021 ']' 00:18:20.277 19:16:38 -- common/autotest_common.sh@940 -- # kill -0 3464021 00:18:20.277 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3464021) - No such process 00:18:20.277 19:16:38 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3464021 is not found' 00:18:20.277 Process with pid 3464021 is not found 00:18:20.277 19:16:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.277 19:16:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.277 19:16:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.277 19:16:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.277 19:16:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.277 19:16:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.277 19:16:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.277 19:16:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.178 19:16:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:22.178 19:16:40 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:22.178 00:18:22.178 real 1m16.185s 00:18:22.178 user 1m58.915s 00:18:22.178 sys 0m24.560s 00:18:22.178 19:16:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:22.178 19:16:40 -- common/autotest_common.sh@10 -- # set +x 00:18:22.178 ************************************ 00:18:22.178 END TEST nvmf_tls 00:18:22.178 ************************************ 00:18:22.178 19:16:40 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:22.178 19:16:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:22.178 19:16:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:22.178 19:16:40 -- common/autotest_common.sh@10 -- # set +x 00:18:22.178 ************************************ 00:18:22.178 START TEST nvmf_fips 00:18:22.178 ************************************ 00:18:22.178 19:16:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:22.437 * Looking for test storage... 00:18:22.437 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:22.437 19:16:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:22.437 19:16:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:22.437 19:16:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:22.437 19:16:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:22.437 19:16:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:22.437 19:16:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.437 19:16:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.437 19:16:40 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.437 19:16:40 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.437 19:16:40 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.437 19:16:40 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.437 19:16:40 -- scripts/common.sh@337 -- # local 'op=<' 00:18:22.437 19:16:40 -- scripts/common.sh@339 -- # ver1_l=2 00:18:22.437 19:16:40 -- scripts/common.sh@340 -- # ver2_l=1 00:18:22.437 19:16:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.437 19:16:40 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.437 19:16:40 -- scripts/common.sh@344 -- # : 1 00:18:22.437 19:16:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.437 19:16:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.437 19:16:40 -- scripts/common.sh@364 -- # decimal 1 00:18:22.437 19:16:40 -- scripts/common.sh@352 -- # local d=1 00:18:22.437 19:16:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.437 19:16:40 -- scripts/common.sh@354 -- # echo 1 00:18:22.437 19:16:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.437 19:16:40 -- scripts/common.sh@365 -- # decimal 2 00:18:22.437 19:16:40 -- scripts/common.sh@352 -- # local d=2 00:18:22.437 19:16:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:22.437 19:16:40 -- scripts/common.sh@354 -- # echo 2 00:18:22.437 19:16:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:22.437 19:16:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.437 19:16:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.437 19:16:40 -- scripts/common.sh@367 -- # return 0 00:18:22.437 19:16:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:22.437 19:16:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:22.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.437 --rc genhtml_branch_coverage=1 00:18:22.437 --rc genhtml_function_coverage=1 00:18:22.437 --rc genhtml_legend=1 00:18:22.437 --rc geninfo_all_blocks=1 00:18:22.437 --rc geninfo_unexecuted_blocks=1 00:18:22.437 00:18:22.437 ' 00:18:22.437 19:16:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:22.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.437 --rc genhtml_branch_coverage=1 00:18:22.437 --rc genhtml_function_coverage=1 00:18:22.437 --rc genhtml_legend=1 00:18:22.437 --rc geninfo_all_blocks=1 00:18:22.437 --rc geninfo_unexecuted_blocks=1 00:18:22.437 00:18:22.437 ' 00:18:22.437 19:16:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:22.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.437 --rc genhtml_branch_coverage=1 00:18:22.437 --rc genhtml_function_coverage=1 00:18:22.437 --rc genhtml_legend=1 00:18:22.437 --rc geninfo_all_blocks=1 00:18:22.437 --rc geninfo_unexecuted_blocks=1 00:18:22.437 00:18:22.437 ' 00:18:22.437 19:16:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:22.437 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.437 --rc genhtml_branch_coverage=1 00:18:22.437 --rc genhtml_function_coverage=1 00:18:22.437 --rc genhtml_legend=1 00:18:22.437 --rc geninfo_all_blocks=1 00:18:22.437 --rc geninfo_unexecuted_blocks=1 00:18:22.437 00:18:22.437 ' 00:18:22.437 19:16:40 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:22.437 19:16:40 -- nvmf/common.sh@7 -- # uname -s 00:18:22.437 19:16:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:22.437 19:16:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:22.437 19:16:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:22.437 19:16:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:22.437 19:16:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:22.437 19:16:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:22.437 19:16:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:22.437 19:16:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:22.437 19:16:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:22.437 19:16:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:22.437 19:16:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.437 19:16:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.437 19:16:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:22.437 19:16:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:22.437 19:16:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:22.437 19:16:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:22.437 19:16:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:22.437 19:16:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:22.437 19:16:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:22.437 19:16:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.437 19:16:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.437 19:16:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.437 19:16:40 -- paths/export.sh@5 -- # export PATH 00:18:22.437 19:16:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.437 19:16:40 -- nvmf/common.sh@46 -- # : 0 00:18:22.437 19:16:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:22.437 19:16:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:22.437 19:16:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:22.437 19:16:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:22.437 19:16:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:22.437 19:16:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:22.437 19:16:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:22.437 19:16:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:22.437 19:16:40 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:22.437 19:16:40 -- fips/fips.sh@89 -- # check_openssl_version 00:18:22.437 19:16:40 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:22.437 19:16:40 -- fips/fips.sh@85 -- # openssl version 00:18:22.437 19:16:40 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:22.437 19:16:40 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:22.437 19:16:40 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:22.437 19:16:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.437 19:16:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.437 19:16:40 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.437 19:16:40 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.437 19:16:40 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.438 19:16:40 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.438 19:16:40 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:22.438 19:16:40 -- scripts/common.sh@339 -- # ver1_l=3 00:18:22.438 19:16:40 -- scripts/common.sh@340 -- # ver2_l=3 00:18:22.438 19:16:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.438 19:16:40 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.438 19:16:40 -- scripts/common.sh@347 -- # : 1 00:18:22.438 19:16:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.438 19:16:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.438 19:16:40 -- scripts/common.sh@364 -- # decimal 3 00:18:22.438 19:16:40 -- scripts/common.sh@352 -- # local d=3 00:18:22.438 19:16:40 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:22.438 19:16:40 -- scripts/common.sh@354 -- # echo 3 00:18:22.438 19:16:40 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:22.438 19:16:40 -- scripts/common.sh@365 -- # decimal 3 00:18:22.438 19:16:40 -- scripts/common.sh@352 -- # local d=3 00:18:22.438 19:16:40 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:22.438 19:16:40 -- scripts/common.sh@354 -- # echo 3 00:18:22.438 19:16:40 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:22.438 19:16:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.438 19:16:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.438 19:16:40 -- scripts/common.sh@363 -- # (( v++ )) 00:18:22.438 19:16:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.438 19:16:40 -- scripts/common.sh@364 -- # decimal 1 00:18:22.438 19:16:40 -- scripts/common.sh@352 -- # local d=1 00:18:22.438 19:16:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.438 19:16:40 -- scripts/common.sh@354 -- # echo 1 00:18:22.438 19:16:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.438 19:16:40 -- scripts/common.sh@365 -- # decimal 0 00:18:22.438 19:16:40 -- scripts/common.sh@352 -- # local d=0 00:18:22.438 19:16:40 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:22.438 19:16:40 -- scripts/common.sh@354 -- # echo 0 00:18:22.438 19:16:40 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:22.438 19:16:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.438 19:16:40 -- scripts/common.sh@366 -- # return 0 00:18:22.438 19:16:40 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:22.438 19:16:40 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:22.438 19:16:40 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:22.438 19:16:40 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:22.438 19:16:40 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:22.438 19:16:40 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:22.438 19:16:40 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:22.438 19:16:40 -- fips/fips.sh@113 -- # build_openssl_config 00:18:22.438 19:16:40 -- fips/fips.sh@37 -- # cat 00:18:22.438 19:16:40 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:22.438 19:16:40 -- fips/fips.sh@58 -- # cat - 00:18:22.438 19:16:40 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:22.438 19:16:40 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:22.438 19:16:40 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:22.438 19:16:40 -- fips/fips.sh@116 -- # openssl list -providers 00:18:22.438 19:16:40 -- fips/fips.sh@116 -- # grep name 00:18:22.438 19:16:41 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:22.438 19:16:41 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:22.438 19:16:41 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:22.438 19:16:41 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:22.438 19:16:41 -- fips/fips.sh@127 -- # : 00:18:22.438 19:16:41 -- common/autotest_common.sh@650 -- # local es=0 00:18:22.438 19:16:41 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:22.438 19:16:41 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:22.438 19:16:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:22.438 19:16:41 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:22.438 19:16:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:22.438 19:16:41 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:22.438 19:16:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:22.438 19:16:41 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:22.438 19:16:41 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:22.438 19:16:41 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:22.696 Error setting digest 00:18:22.696 40E229BCEB7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:22.696 40E229BCEB7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:22.696 19:16:41 -- common/autotest_common.sh@653 -- # es=1 00:18:22.696 19:16:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:22.696 19:16:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:22.696 19:16:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:22.696 19:16:41 -- fips/fips.sh@130 -- # nvmftestinit 00:18:22.696 19:16:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:22.696 19:16:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:22.696 19:16:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:22.696 19:16:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:22.696 19:16:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:22.696 19:16:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:22.696 19:16:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:22.696 19:16:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.696 19:16:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:22.696 19:16:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:22.696 19:16:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:22.696 19:16:41 -- common/autotest_common.sh@10 -- # set +x 00:18:24.597 19:16:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.597 19:16:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:24.597 19:16:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:24.597 19:16:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:24.597 19:16:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:24.597 19:16:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:24.597 19:16:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:24.597 19:16:43 -- nvmf/common.sh@294 -- # net_devs=() 00:18:24.597 19:16:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:24.597 19:16:43 -- nvmf/common.sh@295 -- # e810=() 00:18:24.597 19:16:43 -- nvmf/common.sh@295 -- # local -ga e810 00:18:24.597 19:16:43 -- nvmf/common.sh@296 -- # x722=() 00:18:24.597 19:16:43 -- nvmf/common.sh@296 -- # local -ga x722 00:18:24.597 19:16:43 -- nvmf/common.sh@297 -- # mlx=() 00:18:24.597 19:16:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:24.597 19:16:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.597 19:16:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.598 19:16:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:24.598 19:16:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:24.598 19:16:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:24.598 19:16:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.598 19:16:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:24.598 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:24.598 19:16:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.598 19:16:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:24.598 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:24.598 19:16:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:24.598 19:16:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.598 19:16:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.598 19:16:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.598 19:16:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.598 19:16:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:24.598 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:24.598 19:16:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.598 19:16:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.598 19:16:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.598 19:16:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.598 19:16:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.598 19:16:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:24.598 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:24.598 19:16:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.598 19:16:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:24.598 19:16:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:24.598 19:16:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:24.598 19:16:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:24.598 19:16:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:24.598 19:16:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:24.598 19:16:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:24.598 19:16:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:24.598 19:16:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:24.598 19:16:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:24.598 19:16:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:24.598 19:16:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:24.598 19:16:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:24.598 19:16:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:24.598 19:16:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:24.598 19:16:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:24.598 19:16:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:24.598 19:16:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:24.598 19:16:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:24.598 19:16:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:24.598 19:16:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:24.598 19:16:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:24.598 19:16:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:24.598 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:24.598 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.270 ms 00:18:24.598 00:18:24.598 --- 10.0.0.2 ping statistics --- 00:18:24.598 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.598 rtt min/avg/max/mdev = 0.270/0.270/0.270/0.000 ms 00:18:24.598 19:16:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:24.598 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:24.598 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:18:24.598 00:18:24.598 --- 10.0.0.1 ping statistics --- 00:18:24.598 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.598 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:18:24.598 19:16:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:24.598 19:16:43 -- nvmf/common.sh@410 -- # return 0 00:18:24.598 19:16:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:24.598 19:16:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:24.598 19:16:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:24.598 19:16:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:24.598 19:16:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:24.598 19:16:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:24.598 19:16:43 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:24.598 19:16:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:24.598 19:16:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:24.598 19:16:43 -- common/autotest_common.sh@10 -- # set +x 00:18:24.598 19:16:43 -- nvmf/common.sh@469 -- # nvmfpid=3467638 00:18:24.598 19:16:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:24.598 19:16:43 -- nvmf/common.sh@470 -- # waitforlisten 3467638 00:18:24.598 19:16:43 -- common/autotest_common.sh@829 -- # '[' -z 3467638 ']' 00:18:24.598 19:16:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.598 19:16:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:24.598 19:16:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.598 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.598 19:16:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:24.598 19:16:43 -- common/autotest_common.sh@10 -- # set +x 00:18:24.857 [2024-11-18 19:16:43.238850] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:24.857 [2024-11-18 19:16:43.238939] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.857 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.857 [2024-11-18 19:16:43.305893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.857 [2024-11-18 19:16:43.428741] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:24.857 [2024-11-18 19:16:43.428919] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:24.857 [2024-11-18 19:16:43.428939] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:24.857 [2024-11-18 19:16:43.428963] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:24.857 [2024-11-18 19:16:43.429025] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.792 19:16:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.792 19:16:44 -- common/autotest_common.sh@862 -- # return 0 00:18:25.792 19:16:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:25.792 19:16:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:25.792 19:16:44 -- common/autotest_common.sh@10 -- # set +x 00:18:25.792 19:16:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.792 19:16:44 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:25.792 19:16:44 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:25.792 19:16:44 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.792 19:16:44 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:25.792 19:16:44 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.792 19:16:44 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.792 19:16:44 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.792 19:16:44 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:26.050 [2024-11-18 19:16:44.596358] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:26.050 [2024-11-18 19:16:44.612329] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:26.050 [2024-11-18 19:16:44.612595] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:26.050 malloc0 00:18:26.309 19:16:44 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:26.309 19:16:44 -- fips/fips.sh@147 -- # bdevperf_pid=3467801 00:18:26.309 19:16:44 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:26.309 19:16:44 -- fips/fips.sh@148 -- # waitforlisten 3467801 /var/tmp/bdevperf.sock 00:18:26.309 19:16:44 -- common/autotest_common.sh@829 -- # '[' -z 3467801 ']' 00:18:26.309 19:16:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:26.309 19:16:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.309 19:16:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:26.309 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:26.309 19:16:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.309 19:16:44 -- common/autotest_common.sh@10 -- # set +x 00:18:26.309 [2024-11-18 19:16:44.737273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.309 [2024-11-18 19:16:44.737347] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3467801 ] 00:18:26.309 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.309 [2024-11-18 19:16:44.794424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.309 [2024-11-18 19:16:44.897291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:27.242 19:16:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.242 19:16:45 -- common/autotest_common.sh@862 -- # return 0 00:18:27.242 19:16:45 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.499 [2024-11-18 19:16:45.966540] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:27.499 TLSTESTn1 00:18:27.499 19:16:46 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:27.757 Running I/O for 10 seconds... 00:18:37.721 00:18:37.721 Latency(us) 00:18:37.721 [2024-11-18T18:16:56.326Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.721 [2024-11-18T18:16:56.326Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:37.721 Verification LBA range: start 0x0 length 0x2000 00:18:37.721 TLSTESTn1 : 10.01 4627.24 18.08 0.00 0.00 27630.45 3446.71 43108.12 00:18:37.721 [2024-11-18T18:16:56.326Z] =================================================================================================================== 00:18:37.721 [2024-11-18T18:16:56.326Z] Total : 4627.24 18.08 0.00 0.00 27630.45 3446.71 43108.12 00:18:37.721 0 00:18:37.721 19:16:56 -- fips/fips.sh@1 -- # cleanup 00:18:37.721 19:16:56 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:37.721 19:16:56 -- common/autotest_common.sh@806 -- # type=--id 00:18:37.721 19:16:56 -- common/autotest_common.sh@807 -- # id=0 00:18:37.721 19:16:56 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:37.721 19:16:56 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:37.721 19:16:56 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:37.721 19:16:56 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:37.721 19:16:56 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:37.721 19:16:56 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:37.721 nvmf_trace.0 00:18:37.721 19:16:56 -- common/autotest_common.sh@821 -- # return 0 00:18:37.721 19:16:56 -- fips/fips.sh@16 -- # killprocess 3467801 00:18:37.721 19:16:56 -- common/autotest_common.sh@936 -- # '[' -z 3467801 ']' 00:18:37.721 19:16:56 -- common/autotest_common.sh@940 -- # kill -0 3467801 00:18:37.721 19:16:56 -- common/autotest_common.sh@941 -- # uname 00:18:37.721 19:16:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:37.721 19:16:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3467801 00:18:37.721 19:16:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:37.721 19:16:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:37.721 19:16:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3467801' 00:18:37.721 killing process with pid 3467801 00:18:37.721 19:16:56 -- common/autotest_common.sh@955 -- # kill 3467801 00:18:37.721 Received shutdown signal, test time was about 10.000000 seconds 00:18:37.721 00:18:37.721 Latency(us) 00:18:37.721 [2024-11-18T18:16:56.326Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.721 [2024-11-18T18:16:56.326Z] =================================================================================================================== 00:18:37.721 [2024-11-18T18:16:56.326Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:37.721 19:16:56 -- common/autotest_common.sh@960 -- # wait 3467801 00:18:37.980 19:16:56 -- fips/fips.sh@17 -- # nvmftestfini 00:18:37.980 19:16:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:37.980 19:16:56 -- nvmf/common.sh@116 -- # sync 00:18:37.980 19:16:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:37.980 19:16:56 -- nvmf/common.sh@119 -- # set +e 00:18:37.980 19:16:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:37.980 19:16:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:38.238 rmmod nvme_tcp 00:18:38.238 rmmod nvme_fabrics 00:18:38.238 rmmod nvme_keyring 00:18:38.238 19:16:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:38.238 19:16:56 -- nvmf/common.sh@123 -- # set -e 00:18:38.238 19:16:56 -- nvmf/common.sh@124 -- # return 0 00:18:38.238 19:16:56 -- nvmf/common.sh@477 -- # '[' -n 3467638 ']' 00:18:38.238 19:16:56 -- nvmf/common.sh@478 -- # killprocess 3467638 00:18:38.238 19:16:56 -- common/autotest_common.sh@936 -- # '[' -z 3467638 ']' 00:18:38.238 19:16:56 -- common/autotest_common.sh@940 -- # kill -0 3467638 00:18:38.238 19:16:56 -- common/autotest_common.sh@941 -- # uname 00:18:38.238 19:16:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:38.238 19:16:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3467638 00:18:38.238 19:16:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:38.238 19:16:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:38.238 19:16:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3467638' 00:18:38.238 killing process with pid 3467638 00:18:38.238 19:16:56 -- common/autotest_common.sh@955 -- # kill 3467638 00:18:38.238 19:16:56 -- common/autotest_common.sh@960 -- # wait 3467638 00:18:38.497 19:16:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:38.497 19:16:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:38.497 19:16:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:38.497 19:16:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:38.497 19:16:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:38.497 19:16:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.497 19:16:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.497 19:16:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.029 19:16:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.029 19:16:59 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:41.029 00:18:41.029 real 0m18.281s 00:18:41.029 user 0m24.309s 00:18:41.029 sys 0m5.732s 00:18:41.029 19:16:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:41.029 19:16:59 -- common/autotest_common.sh@10 -- # set +x 00:18:41.029 ************************************ 00:18:41.029 END TEST nvmf_fips 00:18:41.029 ************************************ 00:18:41.029 19:16:59 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:41.029 19:16:59 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:41.029 19:16:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:41.029 19:16:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:41.029 19:16:59 -- common/autotest_common.sh@10 -- # set +x 00:18:41.029 ************************************ 00:18:41.029 START TEST nvmf_fuzz 00:18:41.029 ************************************ 00:18:41.029 19:16:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:41.029 * Looking for test storage... 00:18:41.029 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:41.029 19:16:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:41.029 19:16:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:41.029 19:16:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:41.029 19:16:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:41.029 19:16:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:41.029 19:16:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:41.029 19:16:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:41.029 19:16:59 -- scripts/common.sh@335 -- # IFS=.-: 00:18:41.029 19:16:59 -- scripts/common.sh@335 -- # read -ra ver1 00:18:41.029 19:16:59 -- scripts/common.sh@336 -- # IFS=.-: 00:18:41.029 19:16:59 -- scripts/common.sh@336 -- # read -ra ver2 00:18:41.029 19:16:59 -- scripts/common.sh@337 -- # local 'op=<' 00:18:41.029 19:16:59 -- scripts/common.sh@339 -- # ver1_l=2 00:18:41.029 19:16:59 -- scripts/common.sh@340 -- # ver2_l=1 00:18:41.029 19:16:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:41.029 19:16:59 -- scripts/common.sh@343 -- # case "$op" in 00:18:41.029 19:16:59 -- scripts/common.sh@344 -- # : 1 00:18:41.029 19:16:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:41.029 19:16:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:41.029 19:16:59 -- scripts/common.sh@364 -- # decimal 1 00:18:41.029 19:16:59 -- scripts/common.sh@352 -- # local d=1 00:18:41.029 19:16:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:41.029 19:16:59 -- scripts/common.sh@354 -- # echo 1 00:18:41.029 19:16:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:41.029 19:16:59 -- scripts/common.sh@365 -- # decimal 2 00:18:41.029 19:16:59 -- scripts/common.sh@352 -- # local d=2 00:18:41.029 19:16:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:41.029 19:16:59 -- scripts/common.sh@354 -- # echo 2 00:18:41.029 19:16:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:41.029 19:16:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:41.029 19:16:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:41.029 19:16:59 -- scripts/common.sh@367 -- # return 0 00:18:41.029 19:16:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:41.029 19:16:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:41.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.029 --rc genhtml_branch_coverage=1 00:18:41.029 --rc genhtml_function_coverage=1 00:18:41.029 --rc genhtml_legend=1 00:18:41.029 --rc geninfo_all_blocks=1 00:18:41.029 --rc geninfo_unexecuted_blocks=1 00:18:41.029 00:18:41.029 ' 00:18:41.029 19:16:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:41.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.029 --rc genhtml_branch_coverage=1 00:18:41.029 --rc genhtml_function_coverage=1 00:18:41.029 --rc genhtml_legend=1 00:18:41.029 --rc geninfo_all_blocks=1 00:18:41.029 --rc geninfo_unexecuted_blocks=1 00:18:41.029 00:18:41.029 ' 00:18:41.029 19:16:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:41.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.029 --rc genhtml_branch_coverage=1 00:18:41.029 --rc genhtml_function_coverage=1 00:18:41.029 --rc genhtml_legend=1 00:18:41.029 --rc geninfo_all_blocks=1 00:18:41.029 --rc geninfo_unexecuted_blocks=1 00:18:41.029 00:18:41.029 ' 00:18:41.029 19:16:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:41.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:41.029 --rc genhtml_branch_coverage=1 00:18:41.029 --rc genhtml_function_coverage=1 00:18:41.029 --rc genhtml_legend=1 00:18:41.029 --rc geninfo_all_blocks=1 00:18:41.029 --rc geninfo_unexecuted_blocks=1 00:18:41.029 00:18:41.029 ' 00:18:41.029 19:16:59 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:41.029 19:16:59 -- nvmf/common.sh@7 -- # uname -s 00:18:41.029 19:16:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:41.029 19:16:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:41.029 19:16:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:41.029 19:16:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:41.029 19:16:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:41.029 19:16:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:41.029 19:16:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:41.029 19:16:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:41.029 19:16:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:41.029 19:16:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:41.029 19:16:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.029 19:16:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:41.029 19:16:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:41.029 19:16:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:41.030 19:16:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:41.030 19:16:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:41.030 19:16:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:41.030 19:16:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:41.030 19:16:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:41.030 19:16:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.030 19:16:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.030 19:16:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.030 19:16:59 -- paths/export.sh@5 -- # export PATH 00:18:41.030 19:16:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:41.030 19:16:59 -- nvmf/common.sh@46 -- # : 0 00:18:41.030 19:16:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:41.030 19:16:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:41.030 19:16:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:41.030 19:16:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:41.030 19:16:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:41.030 19:16:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:41.030 19:16:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:41.030 19:16:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:41.030 19:16:59 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:41.030 19:16:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:41.030 19:16:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:41.030 19:16:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:41.030 19:16:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:41.030 19:16:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:41.030 19:16:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.030 19:16:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.030 19:16:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.030 19:16:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:41.030 19:16:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:41.030 19:16:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:41.030 19:16:59 -- common/autotest_common.sh@10 -- # set +x 00:18:42.930 19:17:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:42.930 19:17:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:42.930 19:17:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:42.930 19:17:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:42.930 19:17:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:42.930 19:17:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:42.930 19:17:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:42.930 19:17:01 -- nvmf/common.sh@294 -- # net_devs=() 00:18:42.930 19:17:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:42.930 19:17:01 -- nvmf/common.sh@295 -- # e810=() 00:18:42.930 19:17:01 -- nvmf/common.sh@295 -- # local -ga e810 00:18:42.930 19:17:01 -- nvmf/common.sh@296 -- # x722=() 00:18:42.930 19:17:01 -- nvmf/common.sh@296 -- # local -ga x722 00:18:42.930 19:17:01 -- nvmf/common.sh@297 -- # mlx=() 00:18:42.930 19:17:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:42.930 19:17:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:42.930 19:17:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:42.930 19:17:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:42.930 19:17:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:42.930 19:17:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:42.930 19:17:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:42.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:42.930 19:17:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:42.930 19:17:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:42.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:42.930 19:17:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:42.930 19:17:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:42.930 19:17:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.930 19:17:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:42.930 19:17:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.930 19:17:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:42.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:42.930 19:17:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.930 19:17:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:42.930 19:17:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.930 19:17:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:42.930 19:17:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.930 19:17:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:42.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:42.930 19:17:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.930 19:17:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:42.930 19:17:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:42.930 19:17:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:42.930 19:17:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:42.930 19:17:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:42.930 19:17:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:42.930 19:17:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:42.930 19:17:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:42.930 19:17:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:42.930 19:17:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:42.930 19:17:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:42.930 19:17:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:42.930 19:17:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:42.930 19:17:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:42.930 19:17:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:42.931 19:17:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:42.931 19:17:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:42.931 19:17:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:42.931 19:17:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:42.931 19:17:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:42.931 19:17:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:42.931 19:17:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:42.931 19:17:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:42.931 19:17:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:42.931 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:42.931 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.399 ms 00:18:42.931 00:18:42.931 --- 10.0.0.2 ping statistics --- 00:18:42.931 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.931 rtt min/avg/max/mdev = 0.399/0.399/0.399/0.000 ms 00:18:42.931 19:17:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:42.931 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:42.931 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:18:42.931 00:18:42.931 --- 10.0.0.1 ping statistics --- 00:18:42.931 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.931 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:18:42.931 19:17:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:42.931 19:17:01 -- nvmf/common.sh@410 -- # return 0 00:18:42.931 19:17:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:42.931 19:17:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:42.931 19:17:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:42.931 19:17:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:42.931 19:17:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:42.931 19:17:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:42.931 19:17:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:43.190 19:17:01 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3471244 00:18:43.190 19:17:01 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:43.190 19:17:01 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:43.190 19:17:01 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3471244 00:18:43.190 19:17:01 -- common/autotest_common.sh@829 -- # '[' -z 3471244 ']' 00:18:43.190 19:17:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:43.190 19:17:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:43.190 19:17:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:43.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:43.190 19:17:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:43.190 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:18:44.125 19:17:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:44.125 19:17:02 -- common/autotest_common.sh@862 -- # return 0 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:44.125 19:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.125 19:17:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.125 19:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:44.125 19:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.125 19:17:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.125 Malloc0 00:18:44.125 19:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:44.125 19:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.125 19:17:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.125 19:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:44.125 19:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.125 19:17:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.125 19:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:44.125 19:17:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.125 19:17:02 -- common/autotest_common.sh@10 -- # set +x 00:18:44.125 19:17:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:44.125 19:17:02 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:16.260 Fuzzing completed. Shutting down the fuzz application 00:19:16.260 00:19:16.260 Dumping successful admin opcodes: 00:19:16.260 8, 9, 10, 24, 00:19:16.260 Dumping successful io opcodes: 00:19:16.260 0, 9, 00:19:16.260 NS: 0x200003aeff00 I/O qp, Total commands completed: 491850, total successful commands: 2831, random_seed: 3456086208 00:19:16.260 NS: 0x200003aeff00 admin qp, Total commands completed: 57198, total successful commands: 455, random_seed: 1951155072 00:19:16.260 19:17:33 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:16.260 Fuzzing completed. Shutting down the fuzz application 00:19:16.260 00:19:16.260 Dumping successful admin opcodes: 00:19:16.260 24, 00:19:16.260 Dumping successful io opcodes: 00:19:16.260 00:19:16.260 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2038875236 00:19:16.260 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2039030508 00:19:16.260 19:17:34 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:16.260 19:17:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.260 19:17:34 -- common/autotest_common.sh@10 -- # set +x 00:19:16.260 19:17:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.260 19:17:34 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:16.260 19:17:34 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:16.260 19:17:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:16.260 19:17:34 -- nvmf/common.sh@116 -- # sync 00:19:16.260 19:17:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:16.260 19:17:34 -- nvmf/common.sh@119 -- # set +e 00:19:16.260 19:17:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:16.260 19:17:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:16.260 rmmod nvme_tcp 00:19:16.260 rmmod nvme_fabrics 00:19:16.260 rmmod nvme_keyring 00:19:16.260 19:17:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:16.260 19:17:34 -- nvmf/common.sh@123 -- # set -e 00:19:16.260 19:17:34 -- nvmf/common.sh@124 -- # return 0 00:19:16.260 19:17:34 -- nvmf/common.sh@477 -- # '[' -n 3471244 ']' 00:19:16.260 19:17:34 -- nvmf/common.sh@478 -- # killprocess 3471244 00:19:16.260 19:17:34 -- common/autotest_common.sh@936 -- # '[' -z 3471244 ']' 00:19:16.260 19:17:34 -- common/autotest_common.sh@940 -- # kill -0 3471244 00:19:16.260 19:17:34 -- common/autotest_common.sh@941 -- # uname 00:19:16.260 19:17:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:16.260 19:17:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3471244 00:19:16.260 19:17:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:16.260 19:17:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:16.260 19:17:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3471244' 00:19:16.260 killing process with pid 3471244 00:19:16.260 19:17:34 -- common/autotest_common.sh@955 -- # kill 3471244 00:19:16.260 19:17:34 -- common/autotest_common.sh@960 -- # wait 3471244 00:19:16.518 19:17:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:16.518 19:17:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:16.518 19:17:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:16.518 19:17:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:16.518 19:17:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:16.518 19:17:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:16.518 19:17:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:16.518 19:17:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.420 19:17:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:18.420 19:17:36 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:18.679 00:19:18.679 real 0m37.964s 00:19:18.679 user 0m52.741s 00:19:18.679 sys 0m15.013s 00:19:18.679 19:17:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:18.679 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:19:18.679 ************************************ 00:19:18.679 END TEST nvmf_fuzz 00:19:18.679 ************************************ 00:19:18.679 19:17:37 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:18.679 19:17:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:18.679 19:17:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:18.679 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:19:18.679 ************************************ 00:19:18.679 START TEST nvmf_multiconnection 00:19:18.679 ************************************ 00:19:18.679 19:17:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:18.679 * Looking for test storage... 00:19:18.679 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:18.679 19:17:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:18.679 19:17:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:18.679 19:17:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:18.679 19:17:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:18.679 19:17:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:18.679 19:17:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:18.679 19:17:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:18.679 19:17:37 -- scripts/common.sh@335 -- # IFS=.-: 00:19:18.679 19:17:37 -- scripts/common.sh@335 -- # read -ra ver1 00:19:18.679 19:17:37 -- scripts/common.sh@336 -- # IFS=.-: 00:19:18.679 19:17:37 -- scripts/common.sh@336 -- # read -ra ver2 00:19:18.679 19:17:37 -- scripts/common.sh@337 -- # local 'op=<' 00:19:18.679 19:17:37 -- scripts/common.sh@339 -- # ver1_l=2 00:19:18.679 19:17:37 -- scripts/common.sh@340 -- # ver2_l=1 00:19:18.679 19:17:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:18.679 19:17:37 -- scripts/common.sh@343 -- # case "$op" in 00:19:18.679 19:17:37 -- scripts/common.sh@344 -- # : 1 00:19:18.679 19:17:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:18.679 19:17:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:18.679 19:17:37 -- scripts/common.sh@364 -- # decimal 1 00:19:18.679 19:17:37 -- scripts/common.sh@352 -- # local d=1 00:19:18.679 19:17:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:18.679 19:17:37 -- scripts/common.sh@354 -- # echo 1 00:19:18.679 19:17:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:18.679 19:17:37 -- scripts/common.sh@365 -- # decimal 2 00:19:18.679 19:17:37 -- scripts/common.sh@352 -- # local d=2 00:19:18.679 19:17:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:18.679 19:17:37 -- scripts/common.sh@354 -- # echo 2 00:19:18.679 19:17:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:18.679 19:17:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:18.679 19:17:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:18.679 19:17:37 -- scripts/common.sh@367 -- # return 0 00:19:18.679 19:17:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:18.679 19:17:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:18.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.679 --rc genhtml_branch_coverage=1 00:19:18.679 --rc genhtml_function_coverage=1 00:19:18.679 --rc genhtml_legend=1 00:19:18.679 --rc geninfo_all_blocks=1 00:19:18.679 --rc geninfo_unexecuted_blocks=1 00:19:18.679 00:19:18.679 ' 00:19:18.679 19:17:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:18.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.679 --rc genhtml_branch_coverage=1 00:19:18.679 --rc genhtml_function_coverage=1 00:19:18.679 --rc genhtml_legend=1 00:19:18.680 --rc geninfo_all_blocks=1 00:19:18.680 --rc geninfo_unexecuted_blocks=1 00:19:18.680 00:19:18.680 ' 00:19:18.680 19:17:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:18.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.680 --rc genhtml_branch_coverage=1 00:19:18.680 --rc genhtml_function_coverage=1 00:19:18.680 --rc genhtml_legend=1 00:19:18.680 --rc geninfo_all_blocks=1 00:19:18.680 --rc geninfo_unexecuted_blocks=1 00:19:18.680 00:19:18.680 ' 00:19:18.680 19:17:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:18.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.680 --rc genhtml_branch_coverage=1 00:19:18.680 --rc genhtml_function_coverage=1 00:19:18.680 --rc genhtml_legend=1 00:19:18.680 --rc geninfo_all_blocks=1 00:19:18.680 --rc geninfo_unexecuted_blocks=1 00:19:18.680 00:19:18.680 ' 00:19:18.680 19:17:37 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:18.680 19:17:37 -- nvmf/common.sh@7 -- # uname -s 00:19:18.680 19:17:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:18.680 19:17:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:18.680 19:17:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:18.680 19:17:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:18.680 19:17:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:18.680 19:17:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:18.680 19:17:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:18.680 19:17:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:18.680 19:17:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:18.680 19:17:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:18.680 19:17:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:18.680 19:17:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:18.680 19:17:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:18.680 19:17:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:18.680 19:17:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:18.680 19:17:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:18.680 19:17:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:18.680 19:17:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:18.680 19:17:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:18.680 19:17:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.680 19:17:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.680 19:17:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.680 19:17:37 -- paths/export.sh@5 -- # export PATH 00:19:18.680 19:17:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.680 19:17:37 -- nvmf/common.sh@46 -- # : 0 00:19:18.680 19:17:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:18.680 19:17:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:18.680 19:17:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:18.680 19:17:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:18.680 19:17:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:18.680 19:17:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:18.680 19:17:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:18.680 19:17:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:18.680 19:17:37 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:18.680 19:17:37 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:18.680 19:17:37 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:18.680 19:17:37 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:18.680 19:17:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:18.680 19:17:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:18.680 19:17:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:18.680 19:17:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:18.680 19:17:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:18.680 19:17:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:18.680 19:17:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:18.680 19:17:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.680 19:17:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:18.680 19:17:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:18.680 19:17:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:18.680 19:17:37 -- common/autotest_common.sh@10 -- # set +x 00:19:21.209 19:17:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:21.209 19:17:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:21.209 19:17:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:21.209 19:17:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:21.209 19:17:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:21.209 19:17:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:21.209 19:17:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:21.209 19:17:39 -- nvmf/common.sh@294 -- # net_devs=() 00:19:21.209 19:17:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:21.209 19:17:39 -- nvmf/common.sh@295 -- # e810=() 00:19:21.209 19:17:39 -- nvmf/common.sh@295 -- # local -ga e810 00:19:21.209 19:17:39 -- nvmf/common.sh@296 -- # x722=() 00:19:21.209 19:17:39 -- nvmf/common.sh@296 -- # local -ga x722 00:19:21.209 19:17:39 -- nvmf/common.sh@297 -- # mlx=() 00:19:21.209 19:17:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:21.209 19:17:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:21.209 19:17:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:21.209 19:17:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:21.209 19:17:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:21.209 19:17:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:21.209 19:17:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:21.209 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:21.209 19:17:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:21.209 19:17:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:21.209 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:21.209 19:17:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:21.209 19:17:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:21.209 19:17:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:21.209 19:17:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:21.209 19:17:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:21.209 19:17:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:21.209 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:21.209 19:17:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:21.209 19:17:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:21.209 19:17:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:21.209 19:17:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:21.209 19:17:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:21.209 19:17:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:21.209 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:21.209 19:17:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:21.209 19:17:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:21.209 19:17:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:21.209 19:17:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:21.209 19:17:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:21.209 19:17:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:21.209 19:17:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:21.209 19:17:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:21.209 19:17:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:21.209 19:17:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:21.209 19:17:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:21.209 19:17:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:21.209 19:17:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:21.210 19:17:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:21.210 19:17:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:21.210 19:17:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:21.210 19:17:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:21.210 19:17:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:21.210 19:17:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:21.210 19:17:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:21.210 19:17:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:21.210 19:17:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:21.210 19:17:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:21.210 19:17:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:21.210 19:17:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:21.210 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:21.210 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.370 ms 00:19:21.210 00:19:21.210 --- 10.0.0.2 ping statistics --- 00:19:21.210 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:21.210 rtt min/avg/max/mdev = 0.370/0.370/0.370/0.000 ms 00:19:21.210 19:17:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:21.210 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:21.210 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:19:21.210 00:19:21.210 --- 10.0.0.1 ping statistics --- 00:19:21.210 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:21.210 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:19:21.210 19:17:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:21.210 19:17:39 -- nvmf/common.sh@410 -- # return 0 00:19:21.210 19:17:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:21.210 19:17:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:21.210 19:17:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:21.210 19:17:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:21.210 19:17:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:21.210 19:17:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:21.210 19:17:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:21.210 19:17:39 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:21.210 19:17:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:21.210 19:17:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:21.210 19:17:39 -- common/autotest_common.sh@10 -- # set +x 00:19:21.210 19:17:39 -- nvmf/common.sh@469 -- # nvmfpid=3477146 00:19:21.210 19:17:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:21.210 19:17:39 -- nvmf/common.sh@470 -- # waitforlisten 3477146 00:19:21.210 19:17:39 -- common/autotest_common.sh@829 -- # '[' -z 3477146 ']' 00:19:21.210 19:17:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:21.210 19:17:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:21.210 19:17:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:21.210 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:21.210 19:17:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:21.210 19:17:39 -- common/autotest_common.sh@10 -- # set +x 00:19:21.210 [2024-11-18 19:17:39.560109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:21.210 [2024-11-18 19:17:39.560203] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:21.210 EAL: No free 2048 kB hugepages reported on node 1 00:19:21.210 [2024-11-18 19:17:39.631713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:21.210 [2024-11-18 19:17:39.742168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:21.210 [2024-11-18 19:17:39.742314] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:21.210 [2024-11-18 19:17:39.742331] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:21.210 [2024-11-18 19:17:39.742344] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:21.210 [2024-11-18 19:17:39.742514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:21.210 [2024-11-18 19:17:39.742573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:21.210 [2024-11-18 19:17:39.742636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:21.210 [2024-11-18 19:17:39.742640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:22.144 19:17:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:22.144 19:17:40 -- common/autotest_common.sh@862 -- # return 0 00:19:22.144 19:17:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:22.144 19:17:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 19:17:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:22.144 19:17:40 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 [2024-11-18 19:17:40.569217] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.144 19:17:40 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:22.144 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.144 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 Malloc1 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.144 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.144 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.144 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 [2024-11-18 19:17:40.624282] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.144 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.144 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 Malloc2 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.144 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:22.144 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.144 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.144 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.145 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 Malloc3 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.145 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.145 Malloc4 00:19:22.145 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.145 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:22.145 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.145 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.404 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 Malloc5 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.404 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 Malloc6 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.404 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 Malloc7 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.404 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 Malloc8 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.404 19:17:40 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 Malloc9 00:19:22.404 19:17:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:40 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:22.404 19:17:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:40 -- common/autotest_common.sh@10 -- # set +x 00:19:22.404 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.404 19:17:41 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:22.404 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.404 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.662 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.662 19:17:41 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:22.662 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.662 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.662 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.662 19:17:41 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.662 19:17:41 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:22.662 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.662 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.662 Malloc10 00:19:22.662 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.662 19:17:41 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.663 19:17:41 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 Malloc11 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:22.663 19:17:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.663 19:17:41 -- common/autotest_common.sh@10 -- # set +x 00:19:22.663 19:17:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.663 19:17:41 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:22.663 19:17:41 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.663 19:17:41 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:23.228 19:17:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:23.228 19:17:41 -- common/autotest_common.sh@1187 -- # local i=0 00:19:23.228 19:17:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:23.228 19:17:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:23.228 19:17:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:25.754 19:17:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:25.754 19:17:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:25.754 19:17:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:25.754 19:17:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:25.754 19:17:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.754 19:17:43 -- common/autotest_common.sh@1197 -- # return 0 00:19:25.754 19:17:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:25.754 19:17:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:26.011 19:17:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:26.011 19:17:44 -- common/autotest_common.sh@1187 -- # local i=0 00:19:26.011 19:17:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:26.011 19:17:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:26.011 19:17:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:27.910 19:17:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:27.910 19:17:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:27.910 19:17:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:27.910 19:17:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:27.910 19:17:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:27.910 19:17:46 -- common/autotest_common.sh@1197 -- # return 0 00:19:27.910 19:17:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:27.910 19:17:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:28.842 19:17:47 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:28.842 19:17:47 -- common/autotest_common.sh@1187 -- # local i=0 00:19:28.842 19:17:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:28.842 19:17:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:28.842 19:17:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:30.735 19:17:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:30.735 19:17:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:30.735 19:17:49 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:30.735 19:17:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:30.735 19:17:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:30.735 19:17:49 -- common/autotest_common.sh@1197 -- # return 0 00:19:30.735 19:17:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:30.735 19:17:49 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:31.300 19:17:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:31.300 19:17:49 -- common/autotest_common.sh@1187 -- # local i=0 00:19:31.300 19:17:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:31.300 19:17:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:31.300 19:17:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:33.819 19:17:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:33.819 19:17:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:33.819 19:17:51 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:33.819 19:17:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:33.819 19:17:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:33.819 19:17:51 -- common/autotest_common.sh@1197 -- # return 0 00:19:33.819 19:17:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:33.819 19:17:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:34.075 19:17:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:34.075 19:17:52 -- common/autotest_common.sh@1187 -- # local i=0 00:19:34.075 19:17:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:34.075 19:17:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:34.075 19:17:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:36.598 19:17:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:36.598 19:17:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:36.598 19:17:54 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:36.598 19:17:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:36.598 19:17:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:36.598 19:17:54 -- common/autotest_common.sh@1197 -- # return 0 00:19:36.598 19:17:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.598 19:17:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:36.871 19:17:55 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:36.871 19:17:55 -- common/autotest_common.sh@1187 -- # local i=0 00:19:36.871 19:17:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:36.871 19:17:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:36.871 19:17:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.395 19:17:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.395 19:17:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.395 19:17:57 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:39.395 19:17:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:39.395 19:17:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:39.395 19:17:57 -- common/autotest_common.sh@1197 -- # return 0 00:19:39.395 19:17:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:39.395 19:17:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:39.652 19:17:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:39.652 19:17:58 -- common/autotest_common.sh@1187 -- # local i=0 00:19:39.652 19:17:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:39.652 19:17:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:39.652 19:17:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:41.548 19:18:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:41.548 19:18:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:41.548 19:18:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:41.548 19:18:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:41.548 19:18:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:41.548 19:18:00 -- common/autotest_common.sh@1197 -- # return 0 00:19:41.548 19:18:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:41.548 19:18:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:42.482 19:18:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:42.482 19:18:01 -- common/autotest_common.sh@1187 -- # local i=0 00:19:42.482 19:18:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:42.482 19:18:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:42.482 19:18:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:45.007 19:18:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:45.007 19:18:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:45.007 19:18:03 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:45.007 19:18:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:45.007 19:18:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:45.007 19:18:03 -- common/autotest_common.sh@1197 -- # return 0 00:19:45.007 19:18:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:45.007 19:18:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:45.265 19:18:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:45.265 19:18:03 -- common/autotest_common.sh@1187 -- # local i=0 00:19:45.265 19:18:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:45.265 19:18:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:45.265 19:18:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:47.793 19:18:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:47.793 19:18:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:47.793 19:18:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:47.793 19:18:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:47.793 19:18:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:47.793 19:18:05 -- common/autotest_common.sh@1197 -- # return 0 00:19:47.793 19:18:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:47.793 19:18:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:48.360 19:18:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:48.360 19:18:06 -- common/autotest_common.sh@1187 -- # local i=0 00:19:48.360 19:18:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:48.360 19:18:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:48.360 19:18:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:50.256 19:18:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:50.256 19:18:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:50.256 19:18:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:50.256 19:18:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:50.256 19:18:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:50.256 19:18:08 -- common/autotest_common.sh@1197 -- # return 0 00:19:50.256 19:18:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:50.256 19:18:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:51.190 19:18:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:51.190 19:18:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:51.190 19:18:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:51.190 19:18:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:51.190 19:18:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.185 19:18:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.185 19:18:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.185 19:18:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:53.185 19:18:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.185 19:18:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.185 19:18:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.185 19:18:11 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:53.185 [global] 00:19:53.185 thread=1 00:19:53.185 invalidate=1 00:19:53.185 rw=read 00:19:53.185 time_based=1 00:19:53.185 runtime=10 00:19:53.185 ioengine=libaio 00:19:53.185 direct=1 00:19:53.185 bs=262144 00:19:53.185 iodepth=64 00:19:53.185 norandommap=1 00:19:53.185 numjobs=1 00:19:53.185 00:19:53.185 [job0] 00:19:53.185 filename=/dev/nvme0n1 00:19:53.185 [job1] 00:19:53.185 filename=/dev/nvme10n1 00:19:53.185 [job2] 00:19:53.185 filename=/dev/nvme1n1 00:19:53.185 [job3] 00:19:53.185 filename=/dev/nvme2n1 00:19:53.185 [job4] 00:19:53.185 filename=/dev/nvme3n1 00:19:53.185 [job5] 00:19:53.185 filename=/dev/nvme4n1 00:19:53.185 [job6] 00:19:53.185 filename=/dev/nvme5n1 00:19:53.185 [job7] 00:19:53.185 filename=/dev/nvme6n1 00:19:53.185 [job8] 00:19:53.185 filename=/dev/nvme7n1 00:19:53.185 [job9] 00:19:53.185 filename=/dev/nvme8n1 00:19:53.185 [job10] 00:19:53.185 filename=/dev/nvme9n1 00:19:53.185 Could not set queue depth (nvme0n1) 00:19:53.185 Could not set queue depth (nvme10n1) 00:19:53.185 Could not set queue depth (nvme1n1) 00:19:53.185 Could not set queue depth (nvme2n1) 00:19:53.185 Could not set queue depth (nvme3n1) 00:19:53.185 Could not set queue depth (nvme4n1) 00:19:53.185 Could not set queue depth (nvme5n1) 00:19:53.185 Could not set queue depth (nvme6n1) 00:19:53.185 Could not set queue depth (nvme7n1) 00:19:53.185 Could not set queue depth (nvme8n1) 00:19:53.185 Could not set queue depth (nvme9n1) 00:19:53.444 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.444 fio-3.35 00:19:53.444 Starting 11 threads 00:20:05.648 00:20:05.648 job0: (groupid=0, jobs=1): err= 0: pid=3482266: Mon Nov 18 19:18:22 2024 00:20:05.648 read: IOPS=827, BW=207MiB/s (217MB/s)(2071MiB/10014msec) 00:20:05.648 slat (usec): min=10, max=39925, avg=1147.08, stdev=3145.97 00:20:05.648 clat (msec): min=2, max=189, avg=76.16, stdev=29.40 00:20:05.648 lat (msec): min=2, max=189, avg=77.31, stdev=29.83 00:20:05.648 clat percentiles (msec): 00:20:05.648 | 1.00th=[ 8], 5.00th=[ 34], 10.00th=[ 44], 20.00th=[ 53], 00:20:05.648 | 30.00th=[ 61], 40.00th=[ 68], 50.00th=[ 74], 60.00th=[ 82], 00:20:05.648 | 70.00th=[ 88], 80.00th=[ 97], 90.00th=[ 114], 95.00th=[ 131], 00:20:05.648 | 99.00th=[ 159], 99.50th=[ 165], 99.90th=[ 178], 99.95th=[ 184], 00:20:05.648 | 99.99th=[ 190] 00:20:05.648 bw ( KiB/s): min=114688, max=357376, per=9.89%, avg=210457.60, stdev=59195.25, samples=20 00:20:05.648 iops : min= 448, max= 1396, avg=822.10, stdev=231.23, samples=20 00:20:05.648 lat (msec) : 4=0.63%, 10=1.16%, 20=1.12%, 50=13.36%, 100=66.13% 00:20:05.648 lat (msec) : 250=17.60% 00:20:05.648 cpu : usr=0.59%, sys=2.69%, ctx=1635, majf=0, minf=4097 00:20:05.648 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:05.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.648 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.648 issued rwts: total=8284,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.648 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.648 job1: (groupid=0, jobs=1): err= 0: pid=3482267: Mon Nov 18 19:18:22 2024 00:20:05.648 read: IOPS=614, BW=154MiB/s (161MB/s)(1555MiB/10124msec) 00:20:05.648 slat (usec): min=9, max=113064, avg=1024.84, stdev=4524.62 00:20:05.648 clat (usec): min=666, max=278381, avg=103084.16, stdev=52562.32 00:20:05.648 lat (usec): min=721, max=306791, avg=104108.99, stdev=53227.62 00:20:05.648 clat percentiles (msec): 00:20:05.648 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 36], 20.00th=[ 56], 00:20:05.648 | 30.00th=[ 74], 40.00th=[ 87], 50.00th=[ 100], 60.00th=[ 112], 00:20:05.648 | 70.00th=[ 129], 80.00th=[ 148], 90.00th=[ 184], 95.00th=[ 197], 00:20:05.648 | 99.00th=[ 218], 99.50th=[ 239], 99.90th=[ 271], 99.95th=[ 271], 00:20:05.648 | 99.99th=[ 279] 00:20:05.648 bw ( KiB/s): min=89600, max=253952, per=7.40%, avg=157568.00, stdev=52086.14, samples=20 00:20:05.648 iops : min= 350, max= 992, avg=615.50, stdev=203.46, samples=20 00:20:05.648 lat (usec) : 750=0.02%, 1000=0.06% 00:20:05.648 lat (msec) : 2=0.40%, 4=0.71%, 10=1.50%, 20=2.33%, 50=12.13% 00:20:05.648 lat (msec) : 100=33.61%, 250=48.94%, 500=0.31% 00:20:05.648 cpu : usr=0.19%, sys=1.93%, ctx=1586, majf=0, minf=4097 00:20:05.648 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:05.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.648 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.648 issued rwts: total=6218,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.648 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.648 job2: (groupid=0, jobs=1): err= 0: pid=3482268: Mon Nov 18 19:18:22 2024 00:20:05.648 read: IOPS=614, BW=154MiB/s (161MB/s)(1556MiB/10119msec) 00:20:05.648 slat (usec): min=12, max=125772, avg=1378.22, stdev=5273.15 00:20:05.648 clat (msec): min=3, max=315, avg=102.61, stdev=51.80 00:20:05.648 lat (msec): min=3, max=315, avg=103.99, stdev=52.67 00:20:05.648 clat percentiles (msec): 00:20:05.648 | 1.00th=[ 11], 5.00th=[ 28], 10.00th=[ 46], 20.00th=[ 58], 00:20:05.648 | 30.00th=[ 68], 40.00th=[ 82], 50.00th=[ 97], 60.00th=[ 109], 00:20:05.648 | 70.00th=[ 124], 80.00th=[ 150], 90.00th=[ 186], 95.00th=[ 199], 00:20:05.648 | 99.00th=[ 232], 99.50th=[ 245], 99.90th=[ 262], 99.95th=[ 268], 00:20:05.648 | 99.99th=[ 317] 00:20:05.648 bw ( KiB/s): min=81920, max=285184, per=7.41%, avg=157670.40, stdev=62618.53, samples=20 00:20:05.648 iops : min= 320, max= 1114, avg=615.90, stdev=244.60, samples=20 00:20:05.648 lat (msec) : 4=0.02%, 10=0.85%, 20=2.48%, 50=9.34%, 100=40.02% 00:20:05.648 lat (msec) : 250=46.95%, 500=0.35% 00:20:05.648 cpu : usr=0.43%, sys=2.03%, ctx=1299, majf=0, minf=4098 00:20:05.648 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:05.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.648 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.648 issued rwts: total=6222,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.648 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.648 job3: (groupid=0, jobs=1): err= 0: pid=3482269: Mon Nov 18 19:18:22 2024 00:20:05.648 read: IOPS=710, BW=178MiB/s (186MB/s)(1790MiB/10074msec) 00:20:05.648 slat (usec): min=10, max=121880, avg=925.16, stdev=4532.00 00:20:05.648 clat (usec): min=877, max=278161, avg=89055.72, stdev=47773.07 00:20:05.648 lat (usec): min=932, max=317983, avg=89980.88, stdev=48445.94 00:20:05.648 clat percentiles (msec): 00:20:05.648 | 1.00th=[ 11], 5.00th=[ 28], 10.00th=[ 39], 20.00th=[ 52], 00:20:05.648 | 30.00th=[ 61], 40.00th=[ 69], 50.00th=[ 78], 60.00th=[ 89], 00:20:05.648 | 70.00th=[ 104], 80.00th=[ 124], 90.00th=[ 167], 95.00th=[ 192], 00:20:05.648 | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 245], 99.95th=[ 249], 00:20:05.648 | 99.99th=[ 279] 00:20:05.648 bw ( KiB/s): min=89600, max=317952, per=8.53%, avg=181657.60, stdev=60695.70, samples=20 00:20:05.648 iops : min= 350, max= 1242, avg=709.60, stdev=237.09, samples=20 00:20:05.648 lat (usec) : 1000=0.01% 00:20:05.648 lat (msec) : 2=0.03%, 4=0.08%, 10=0.78%, 20=1.91%, 50=15.42% 00:20:05.648 lat (msec) : 100=49.58%, 250=32.14%, 500=0.04% 00:20:05.648 cpu : usr=0.31%, sys=2.01%, ctx=1667, majf=0, minf=3721 00:20:05.648 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:05.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.648 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.648 issued rwts: total=7160,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.648 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.648 job4: (groupid=0, jobs=1): err= 0: pid=3482270: Mon Nov 18 19:18:22 2024 00:20:05.648 read: IOPS=709, BW=177MiB/s (186MB/s)(1785MiB/10071msec) 00:20:05.648 slat (usec): min=9, max=158629, avg=981.87, stdev=5095.94 00:20:05.648 clat (usec): min=1651, max=324360, avg=89206.62, stdev=53680.19 00:20:05.648 lat (usec): min=1731, max=324409, avg=90188.49, stdev=54426.76 00:20:05.648 clat percentiles (msec): 00:20:05.648 | 1.00th=[ 9], 5.00th=[ 21], 10.00th=[ 29], 20.00th=[ 39], 00:20:05.648 | 30.00th=[ 53], 40.00th=[ 67], 50.00th=[ 83], 60.00th=[ 95], 00:20:05.649 | 70.00th=[ 110], 80.00th=[ 133], 90.00th=[ 171], 95.00th=[ 194], 00:20:05.649 | 99.00th=[ 234], 99.50th=[ 243], 99.90th=[ 284], 99.95th=[ 309], 00:20:05.649 | 99.99th=[ 326] 00:20:05.649 bw ( KiB/s): min=77312, max=331776, per=8.51%, avg=181171.20, stdev=71061.64, samples=20 00:20:05.649 iops : min= 302, max= 1296, avg=707.70, stdev=277.58, samples=20 00:20:05.649 lat (msec) : 2=0.01%, 4=0.25%, 10=1.29%, 20=3.15%, 50=23.92% 00:20:05.649 lat (msec) : 100=34.76%, 250=36.31%, 500=0.31% 00:20:05.649 cpu : usr=0.34%, sys=1.89%, ctx=1625, majf=0, minf=4097 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=7141,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 job5: (groupid=0, jobs=1): err= 0: pid=3482271: Mon Nov 18 19:18:22 2024 00:20:05.649 read: IOPS=686, BW=172MiB/s (180MB/s)(1729MiB/10073msec) 00:20:05.649 slat (usec): min=9, max=136217, avg=866.03, stdev=4906.76 00:20:05.649 clat (usec): min=1697, max=311015, avg=92299.93, stdev=50879.44 00:20:05.649 lat (usec): min=1718, max=311032, avg=93165.96, stdev=51646.81 00:20:05.649 clat percentiles (msec): 00:20:05.649 | 1.00th=[ 8], 5.00th=[ 20], 10.00th=[ 35], 20.00th=[ 50], 00:20:05.649 | 30.00th=[ 59], 40.00th=[ 71], 50.00th=[ 83], 60.00th=[ 97], 00:20:05.649 | 70.00th=[ 114], 80.00th=[ 134], 90.00th=[ 176], 95.00th=[ 192], 00:20:05.649 | 99.00th=[ 209], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 292], 00:20:05.649 | 99.99th=[ 313] 00:20:05.649 bw ( KiB/s): min=83456, max=275456, per=8.24%, avg=175372.65, stdev=50855.10, samples=20 00:20:05.649 iops : min= 326, max= 1076, avg=685.00, stdev=198.70, samples=20 00:20:05.649 lat (msec) : 2=0.01%, 4=0.32%, 10=1.23%, 20=3.53%, 50=15.46% 00:20:05.649 lat (msec) : 100=40.90%, 250=38.43%, 500=0.12% 00:20:05.649 cpu : usr=0.27%, sys=2.08%, ctx=1699, majf=0, minf=4097 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=6914,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 job6: (groupid=0, jobs=1): err= 0: pid=3482272: Mon Nov 18 19:18:22 2024 00:20:05.649 read: IOPS=1197, BW=299MiB/s (314MB/s)(3030MiB/10122msec) 00:20:05.649 slat (usec): min=9, max=27875, avg=754.00, stdev=2248.54 00:20:05.649 clat (msec): min=4, max=262, avg=52.64, stdev=27.94 00:20:05.649 lat (msec): min=4, max=262, avg=53.39, stdev=28.21 00:20:05.649 clat percentiles (msec): 00:20:05.649 | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 28], 20.00th=[ 29], 00:20:05.649 | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 45], 60.00th=[ 55], 00:20:05.649 | 70.00th=[ 64], 80.00th=[ 73], 90.00th=[ 89], 95.00th=[ 107], 00:20:05.649 | 99.00th=[ 136], 99.50th=[ 153], 99.90th=[ 247], 99.95th=[ 247], 00:20:05.649 | 99.99th=[ 264] 00:20:05.649 bw ( KiB/s): min=140288, max=549376, per=14.51%, avg=308730.90, stdev=126875.85, samples=20 00:20:05.649 iops : min= 548, max= 2146, avg=1205.95, stdev=495.57, samples=20 00:20:05.649 lat (msec) : 10=0.20%, 20=0.41%, 50=54.15%, 100=38.78%, 250=6.44% 00:20:05.649 lat (msec) : 500=0.02% 00:20:05.649 cpu : usr=0.58%, sys=3.78%, ctx=2229, majf=0, minf=4097 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=12121,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 job7: (groupid=0, jobs=1): err= 0: pid=3482273: Mon Nov 18 19:18:22 2024 00:20:05.649 read: IOPS=748, BW=187MiB/s (196MB/s)(1894MiB/10117msec) 00:20:05.649 slat (usec): min=8, max=48014, avg=1059.89, stdev=3100.55 00:20:05.649 clat (usec): min=1877, max=256491, avg=84311.84, stdev=29297.77 00:20:05.649 lat (usec): min=1907, max=256518, avg=85371.73, stdev=29606.57 00:20:05.649 clat percentiles (msec): 00:20:05.649 | 1.00th=[ 11], 5.00th=[ 48], 10.00th=[ 55], 20.00th=[ 63], 00:20:05.649 | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 89], 00:20:05.649 | 70.00th=[ 95], 80.00th=[ 104], 90.00th=[ 123], 95.00th=[ 136], 00:20:05.649 | 99.00th=[ 165], 99.50th=[ 178], 99.90th=[ 249], 99.95th=[ 249], 00:20:05.649 | 99.99th=[ 257] 00:20:05.649 bw ( KiB/s): min=110592, max=247296, per=9.04%, avg=192358.40, stdev=41687.55, samples=20 00:20:05.649 iops : min= 432, max= 966, avg=751.40, stdev=162.84, samples=20 00:20:05.649 lat (msec) : 2=0.03%, 4=0.17%, 10=0.79%, 20=1.17%, 50=3.55% 00:20:05.649 lat (msec) : 100=71.39%, 250=22.87%, 500=0.03% 00:20:05.649 cpu : usr=0.47%, sys=2.37%, ctx=1636, majf=0, minf=4097 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=7577,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 job8: (groupid=0, jobs=1): err= 0: pid=3482274: Mon Nov 18 19:18:22 2024 00:20:05.649 read: IOPS=1002, BW=251MiB/s (263MB/s)(2537MiB/10121msec) 00:20:05.649 slat (usec): min=10, max=96806, avg=735.82, stdev=2757.05 00:20:05.649 clat (usec): min=1140, max=268864, avg=63041.10, stdev=40951.62 00:20:05.649 lat (usec): min=1163, max=268887, avg=63776.93, stdev=41317.01 00:20:05.649 clat percentiles (msec): 00:20:05.649 | 1.00th=[ 10], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 33], 00:20:05.649 | 30.00th=[ 35], 40.00th=[ 37], 50.00th=[ 47], 60.00th=[ 59], 00:20:05.649 | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 124], 95.00th=[ 144], 00:20:05.649 | 99.00th=[ 194], 99.50th=[ 224], 99.90th=[ 262], 99.95th=[ 266], 00:20:05.649 | 99.99th=[ 268] 00:20:05.649 bw ( KiB/s): min=97280, max=503296, per=12.13%, avg=258209.40, stdev=126337.92, samples=20 00:20:05.649 iops : min= 380, max= 1966, avg=1008.60, stdev=493.49, samples=20 00:20:05.649 lat (msec) : 2=0.03%, 4=0.11%, 10=0.89%, 20=2.41%, 50=49.04% 00:20:05.649 lat (msec) : 100=29.24%, 250=18.15%, 500=0.13% 00:20:05.649 cpu : usr=0.57%, sys=3.09%, ctx=2109, majf=0, minf=4098 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=10148,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 job9: (groupid=0, jobs=1): err= 0: pid=3482275: Mon Nov 18 19:18:22 2024 00:20:05.649 read: IOPS=693, BW=173MiB/s (182MB/s)(1754MiB/10122msec) 00:20:05.649 slat (usec): min=9, max=134801, avg=916.32, stdev=4453.73 00:20:05.649 clat (msec): min=2, max=340, avg=91.35, stdev=52.31 00:20:05.649 lat (msec): min=2, max=340, avg=92.27, stdev=52.93 00:20:05.649 clat percentiles (msec): 00:20:05.649 | 1.00th=[ 7], 5.00th=[ 15], 10.00th=[ 24], 20.00th=[ 44], 00:20:05.649 | 30.00th=[ 61], 40.00th=[ 72], 50.00th=[ 86], 60.00th=[ 101], 00:20:05.649 | 70.00th=[ 117], 80.00th=[ 136], 90.00th=[ 169], 95.00th=[ 190], 00:20:05.649 | 99.00th=[ 211], 99.50th=[ 220], 99.90th=[ 264], 99.95th=[ 275], 00:20:05.649 | 99.99th=[ 342] 00:20:05.649 bw ( KiB/s): min=110592, max=294400, per=8.36%, avg=177945.60, stdev=53512.28, samples=20 00:20:05.649 iops : min= 432, max= 1150, avg=695.10, stdev=209.03, samples=20 00:20:05.649 lat (msec) : 4=0.10%, 10=2.75%, 20=5.10%, 50=14.73%, 100=37.70% 00:20:05.649 lat (msec) : 250=39.36%, 500=0.26% 00:20:05.649 cpu : usr=0.41%, sys=1.91%, ctx=1736, majf=0, minf=4097 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=7015,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 job10: (groupid=0, jobs=1): err= 0: pid=3482276: Mon Nov 18 19:18:22 2024 00:20:05.649 read: IOPS=533, BW=133MiB/s (140MB/s)(1343MiB/10071msec) 00:20:05.649 slat (usec): min=14, max=121972, avg=1582.06, stdev=5851.20 00:20:05.649 clat (msec): min=13, max=315, avg=118.26, stdev=42.97 00:20:05.649 lat (msec): min=13, max=315, avg=119.85, stdev=43.86 00:20:05.649 clat percentiles (msec): 00:20:05.649 | 1.00th=[ 21], 5.00th=[ 58], 10.00th=[ 74], 20.00th=[ 86], 00:20:05.649 | 30.00th=[ 94], 40.00th=[ 102], 50.00th=[ 110], 60.00th=[ 121], 00:20:05.649 | 70.00th=[ 133], 80.00th=[ 157], 90.00th=[ 186], 95.00th=[ 197], 00:20:05.649 | 99.00th=[ 222], 99.50th=[ 230], 99.90th=[ 262], 99.95th=[ 313], 00:20:05.649 | 99.99th=[ 317] 00:20:05.649 bw ( KiB/s): min=80896, max=193536, per=6.39%, avg=135921.90, stdev=31416.07, samples=20 00:20:05.649 iops : min= 316, max= 756, avg=530.90, stdev=122.71, samples=20 00:20:05.649 lat (msec) : 20=0.86%, 50=3.09%, 100=33.97%, 250=61.98%, 500=0.11% 00:20:05.649 cpu : usr=0.25%, sys=2.01%, ctx=1276, majf=0, minf=4097 00:20:05.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:05.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.649 issued rwts: total=5373,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.649 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.649 00:20:05.649 Run status group 0 (all jobs): 00:20:05.649 READ: bw=2079MiB/s (2180MB/s), 133MiB/s-299MiB/s (140MB/s-314MB/s), io=20.5GiB (22.1GB), run=10014-10124msec 00:20:05.649 00:20:05.649 Disk stats (read/write): 00:20:05.649 nvme0n1: ios=16212/0, merge=0/0, ticks=1232815/0, in_queue=1232815, util=97.06% 00:20:05.649 nvme10n1: ios=12226/0, merge=0/0, ticks=1232450/0, in_queue=1232450, util=97.26% 00:20:05.649 nvme1n1: ios=12286/0, merge=0/0, ticks=1232222/0, in_queue=1232222, util=97.57% 00:20:05.649 nvme2n1: ios=14107/0, merge=0/0, ticks=1238118/0, in_queue=1238118, util=97.73% 00:20:05.649 nvme3n1: ios=14074/0, merge=0/0, ticks=1233483/0, in_queue=1233483, util=97.82% 00:20:05.649 nvme4n1: ios=13612/0, merge=0/0, ticks=1237273/0, in_queue=1237273, util=98.17% 00:20:05.650 nvme5n1: ios=24036/0, merge=0/0, ticks=1228993/0, in_queue=1228993, util=98.33% 00:20:05.650 nvme6n1: ios=14910/0, merge=0/0, ticks=1234173/0, in_queue=1234173, util=98.48% 00:20:05.650 nvme7n1: ios=20135/0, merge=0/0, ticks=1234872/0, in_queue=1234872, util=98.91% 00:20:05.650 nvme8n1: ios=13827/0, merge=0/0, ticks=1239777/0, in_queue=1239777, util=99.11% 00:20:05.650 nvme9n1: ios=10540/0, merge=0/0, ticks=1228359/0, in_queue=1228359, util=99.23% 00:20:05.650 19:18:22 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:05.650 [global] 00:20:05.650 thread=1 00:20:05.650 invalidate=1 00:20:05.650 rw=randwrite 00:20:05.650 time_based=1 00:20:05.650 runtime=10 00:20:05.650 ioengine=libaio 00:20:05.650 direct=1 00:20:05.650 bs=262144 00:20:05.650 iodepth=64 00:20:05.650 norandommap=1 00:20:05.650 numjobs=1 00:20:05.650 00:20:05.650 [job0] 00:20:05.650 filename=/dev/nvme0n1 00:20:05.650 [job1] 00:20:05.650 filename=/dev/nvme10n1 00:20:05.650 [job2] 00:20:05.650 filename=/dev/nvme1n1 00:20:05.650 [job3] 00:20:05.650 filename=/dev/nvme2n1 00:20:05.650 [job4] 00:20:05.650 filename=/dev/nvme3n1 00:20:05.650 [job5] 00:20:05.650 filename=/dev/nvme4n1 00:20:05.650 [job6] 00:20:05.650 filename=/dev/nvme5n1 00:20:05.650 [job7] 00:20:05.650 filename=/dev/nvme6n1 00:20:05.650 [job8] 00:20:05.650 filename=/dev/nvme7n1 00:20:05.650 [job9] 00:20:05.650 filename=/dev/nvme8n1 00:20:05.650 [job10] 00:20:05.650 filename=/dev/nvme9n1 00:20:05.650 Could not set queue depth (nvme0n1) 00:20:05.650 Could not set queue depth (nvme10n1) 00:20:05.650 Could not set queue depth (nvme1n1) 00:20:05.650 Could not set queue depth (nvme2n1) 00:20:05.650 Could not set queue depth (nvme3n1) 00:20:05.650 Could not set queue depth (nvme4n1) 00:20:05.650 Could not set queue depth (nvme5n1) 00:20:05.650 Could not set queue depth (nvme6n1) 00:20:05.650 Could not set queue depth (nvme7n1) 00:20:05.650 Could not set queue depth (nvme8n1) 00:20:05.650 Could not set queue depth (nvme9n1) 00:20:05.650 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.650 fio-3.35 00:20:05.650 Starting 11 threads 00:20:15.624 00:20:15.624 job0: (groupid=0, jobs=1): err= 0: pid=3483478: Mon Nov 18 19:18:33 2024 00:20:15.624 write: IOPS=501, BW=125MiB/s (131MB/s)(1271MiB/10142msec); 0 zone resets 00:20:15.624 slat (usec): min=18, max=120086, avg=1620.94, stdev=5062.74 00:20:15.624 clat (usec): min=1780, max=359425, avg=125991.71, stdev=93160.40 00:20:15.624 lat (usec): min=1830, max=359497, avg=127612.66, stdev=94472.32 00:20:15.624 clat percentiles (msec): 00:20:15.624 | 1.00th=[ 8], 5.00th=[ 34], 10.00th=[ 42], 20.00th=[ 45], 00:20:15.624 | 30.00th=[ 63], 40.00th=[ 81], 50.00th=[ 87], 60.00th=[ 106], 00:20:15.624 | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 288], 95.00th=[ 317], 00:20:15.624 | 99.00th=[ 347], 99.50th=[ 351], 99.90th=[ 355], 99.95th=[ 359], 00:20:15.624 | 99.99th=[ 359] 00:20:15.624 bw ( KiB/s): min=47104, max=308630, per=8.80%, avg=128463.50, stdev=80242.29, samples=20 00:20:15.624 iops : min= 184, max= 1205, avg=501.75, stdev=313.34, samples=20 00:20:15.624 lat (msec) : 2=0.04%, 4=0.31%, 10=0.92%, 20=1.75%, 50=22.27% 00:20:15.624 lat (msec) : 100=32.61%, 250=25.37%, 500=16.72% 00:20:15.624 cpu : usr=1.41%, sys=2.00%, ctx=2234, majf=0, minf=1 00:20:15.624 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:15.624 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.624 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.624 issued rwts: total=0,5084,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.624 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.624 job1: (groupid=0, jobs=1): err= 0: pid=3483480: Mon Nov 18 19:18:33 2024 00:20:15.624 write: IOPS=482, BW=121MiB/s (127MB/s)(1227MiB/10165msec); 0 zone resets 00:20:15.624 slat (usec): min=17, max=123647, avg=1506.66, stdev=4734.46 00:20:15.624 clat (usec): min=823, max=340287, avg=130955.75, stdev=89642.00 00:20:15.624 lat (usec): min=873, max=346746, avg=132462.41, stdev=90883.35 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 23], 20.00th=[ 41], 00:20:15.625 | 30.00th=[ 54], 40.00th=[ 91], 50.00th=[ 122], 60.00th=[ 165], 00:20:15.625 | 70.00th=[ 192], 80.00th=[ 215], 90.00th=[ 262], 95.00th=[ 284], 00:20:15.625 | 99.00th=[ 321], 99.50th=[ 326], 99.90th=[ 334], 99.95th=[ 338], 00:20:15.625 | 99.99th=[ 342] 00:20:15.625 bw ( KiB/s): min=59392, max=325120, per=8.50%, avg=124012.70, stdev=72595.10, samples=20 00:20:15.625 iops : min= 232, max= 1270, avg=484.40, stdev=283.55, samples=20 00:20:15.625 lat (usec) : 1000=0.10% 00:20:15.625 lat (msec) : 2=0.33%, 4=1.77%, 10=3.16%, 20=3.79%, 50=18.97% 00:20:15.625 lat (msec) : 100=15.50%, 250=44.49%, 500=11.90% 00:20:15.625 cpu : usr=1.62%, sys=1.83%, ctx=2667, majf=0, minf=1 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,4909,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job2: (groupid=0, jobs=1): err= 0: pid=3483482: Mon Nov 18 19:18:33 2024 00:20:15.625 write: IOPS=403, BW=101MiB/s (106MB/s)(1025MiB/10161msec); 0 zone resets 00:20:15.625 slat (usec): min=23, max=59756, avg=2055.97, stdev=5000.67 00:20:15.625 clat (usec): min=1292, max=386120, avg=156433.84, stdev=90118.53 00:20:15.625 lat (usec): min=1957, max=386152, avg=158489.81, stdev=91427.40 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 25], 20.00th=[ 71], 00:20:15.625 | 30.00th=[ 108], 40.00th=[ 134], 50.00th=[ 157], 60.00th=[ 176], 00:20:15.625 | 70.00th=[ 205], 80.00th=[ 247], 90.00th=[ 284], 95.00th=[ 305], 00:20:15.625 | 99.00th=[ 342], 99.50th=[ 351], 99.90th=[ 372], 99.95th=[ 372], 00:20:15.625 | 99.99th=[ 388] 00:20:15.625 bw ( KiB/s): min=47104, max=201836, per=7.08%, avg=103342.00, stdev=47345.46, samples=20 00:20:15.625 iops : min= 184, max= 788, avg=403.60, stdev=184.85, samples=20 00:20:15.625 lat (msec) : 2=0.07%, 4=0.66%, 10=2.61%, 20=5.24%, 50=6.73% 00:20:15.625 lat (msec) : 100=12.83%, 250=52.30%, 500=19.56% 00:20:15.625 cpu : usr=1.24%, sys=1.65%, ctx=1864, majf=0, minf=1 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,4101,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job3: (groupid=0, jobs=1): err= 0: pid=3483483: Mon Nov 18 19:18:33 2024 00:20:15.625 write: IOPS=418, BW=105MiB/s (110MB/s)(1062MiB/10144msec); 0 zone resets 00:20:15.625 slat (usec): min=23, max=70625, avg=1904.73, stdev=4908.68 00:20:15.625 clat (usec): min=1268, max=391825, avg=150767.65, stdev=75429.83 00:20:15.625 lat (usec): min=1770, max=396010, avg=152672.38, stdev=76373.39 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 14], 5.00th=[ 45], 10.00th=[ 70], 20.00th=[ 101], 00:20:15.625 | 30.00th=[ 110], 40.00th=[ 116], 50.00th=[ 127], 60.00th=[ 148], 00:20:15.625 | 70.00th=[ 182], 80.00th=[ 215], 90.00th=[ 271], 95.00th=[ 292], 00:20:15.625 | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 388], 99.95th=[ 388], 00:20:15.625 | 99.99th=[ 393] 00:20:15.625 bw ( KiB/s): min=53248, max=174080, per=7.34%, avg=107133.25, stdev=38980.35, samples=20 00:20:15.625 iops : min= 208, max= 680, avg=418.40, stdev=152.25, samples=20 00:20:15.625 lat (msec) : 2=0.05%, 4=0.12%, 10=0.54%, 20=0.85%, 50=4.42% 00:20:15.625 lat (msec) : 100=13.82%, 250=65.76%, 500=14.45% 00:20:15.625 cpu : usr=1.41%, sys=1.41%, ctx=1854, majf=0, minf=1 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,4249,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job4: (groupid=0, jobs=1): err= 0: pid=3483484: Mon Nov 18 19:18:33 2024 00:20:15.625 write: IOPS=498, BW=125MiB/s (131MB/s)(1264MiB/10146msec); 0 zone resets 00:20:15.625 slat (usec): min=15, max=103968, avg=1337.77, stdev=4340.23 00:20:15.625 clat (usec): min=792, max=435532, avg=127000.86, stdev=80450.09 00:20:15.625 lat (usec): min=848, max=435588, avg=128338.63, stdev=81509.88 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 5], 5.00th=[ 22], 10.00th=[ 41], 20.00th=[ 62], 00:20:15.625 | 30.00th=[ 79], 40.00th=[ 96], 50.00th=[ 113], 60.00th=[ 125], 00:20:15.625 | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 245], 95.00th=[ 284], 00:20:15.625 | 99.00th=[ 401], 99.50th=[ 418], 99.90th=[ 435], 99.95th=[ 435], 00:20:15.625 | 99.99th=[ 435] 00:20:15.625 bw ( KiB/s): min=45056, max=231424, per=8.76%, avg=127806.75, stdev=56307.29, samples=20 00:20:15.625 iops : min= 176, max= 904, avg=499.10, stdev=219.92, samples=20 00:20:15.625 lat (usec) : 1000=0.12% 00:20:15.625 lat (msec) : 2=0.22%, 4=0.51%, 10=2.23%, 20=1.60%, 50=9.39% 00:20:15.625 lat (msec) : 100=27.72%, 250=48.68%, 500=9.51% 00:20:15.625 cpu : usr=1.51%, sys=1.90%, ctx=2970, majf=0, minf=1 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,5057,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job5: (groupid=0, jobs=1): err= 0: pid=3483497: Mon Nov 18 19:18:33 2024 00:20:15.625 write: IOPS=372, BW=93.0MiB/s (97.6MB/s)(944MiB/10145msec); 0 zone resets 00:20:15.625 slat (usec): min=20, max=159354, avg=2202.13, stdev=6854.35 00:20:15.625 clat (usec): min=1390, max=461329, avg=169363.57, stdev=88214.33 00:20:15.625 lat (usec): min=1433, max=461418, avg=171565.70, stdev=89341.39 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 11], 5.00th=[ 36], 10.00th=[ 72], 20.00th=[ 100], 00:20:15.625 | 30.00th=[ 113], 40.00th=[ 132], 50.00th=[ 157], 60.00th=[ 178], 00:20:15.625 | 70.00th=[ 201], 80.00th=[ 257], 90.00th=[ 309], 95.00th=[ 334], 00:20:15.625 | 99.00th=[ 368], 99.50th=[ 380], 99.90th=[ 430], 99.95th=[ 460], 00:20:15.625 | 99.99th=[ 460] 00:20:15.625 bw ( KiB/s): min=43008, max=163512, per=6.51%, avg=95023.95, stdev=37176.54, samples=20 00:20:15.625 iops : min= 168, max= 638, avg=371.10, stdev=145.19, samples=20 00:20:15.625 lat (msec) : 2=0.03%, 4=0.50%, 10=0.45%, 20=0.77%, 50=4.93% 00:20:15.625 lat (msec) : 100=13.53%, 250=58.90%, 500=20.90% 00:20:15.625 cpu : usr=1.28%, sys=1.32%, ctx=1595, majf=0, minf=1 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.3% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,3776,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job6: (groupid=0, jobs=1): err= 0: pid=3483498: Mon Nov 18 19:18:33 2024 00:20:15.625 write: IOPS=593, BW=148MiB/s (156MB/s)(1505MiB/10143msec); 0 zone resets 00:20:15.625 slat (usec): min=19, max=84809, avg=1061.36, stdev=3526.87 00:20:15.625 clat (usec): min=862, max=326948, avg=106685.64, stdev=76291.76 00:20:15.625 lat (usec): min=906, max=327547, avg=107747.00, stdev=77119.13 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 3], 5.00th=[ 9], 10.00th=[ 19], 20.00th=[ 38], 00:20:15.625 | 30.00th=[ 46], 40.00th=[ 64], 50.00th=[ 106], 60.00th=[ 120], 00:20:15.625 | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 226], 95.00th=[ 262], 00:20:15.625 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 326], 00:20:15.625 | 99.99th=[ 326] 00:20:15.625 bw ( KiB/s): min=54380, max=403968, per=10.45%, avg=152442.90, stdev=86859.16, samples=20 00:20:15.625 iops : min= 212, max= 1578, avg=595.35, stdev=339.35, samples=20 00:20:15.625 lat (usec) : 1000=0.07% 00:20:15.625 lat (msec) : 2=0.50%, 4=1.40%, 10=3.67%, 20=5.13%, 50=21.38% 00:20:15.625 lat (msec) : 100=15.42%, 250=45.59%, 500=6.84% 00:20:15.625 cpu : usr=1.94%, sys=2.25%, ctx=3653, majf=0, minf=1 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,6019,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job7: (groupid=0, jobs=1): err= 0: pid=3483499: Mon Nov 18 19:18:33 2024 00:20:15.625 write: IOPS=674, BW=169MiB/s (177MB/s)(1698MiB/10068msec); 0 zone resets 00:20:15.625 slat (usec): min=17, max=47916, avg=1041.38, stdev=3055.99 00:20:15.625 clat (usec): min=909, max=373005, avg=93789.98, stdev=72804.17 00:20:15.625 lat (usec): min=978, max=373143, avg=94831.36, stdev=73501.89 00:20:15.625 clat percentiles (msec): 00:20:15.625 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 18], 20.00th=[ 41], 00:20:15.625 | 30.00th=[ 46], 40.00th=[ 50], 50.00th=[ 71], 60.00th=[ 99], 00:20:15.625 | 70.00th=[ 121], 80.00th=[ 157], 90.00th=[ 192], 95.00th=[ 236], 00:20:15.625 | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 368], 00:20:15.625 | 99.99th=[ 372] 00:20:15.625 bw ( KiB/s): min=76288, max=408881, per=11.80%, avg=172267.95, stdev=100008.69, samples=20 00:20:15.625 iops : min= 298, max= 1597, avg=672.85, stdev=390.66, samples=20 00:20:15.625 lat (usec) : 1000=0.03% 00:20:15.625 lat (msec) : 2=0.31%, 4=1.31%, 10=4.08%, 20=5.54%, 50=29.80% 00:20:15.625 lat (msec) : 100=19.70%, 250=35.11%, 500=4.12% 00:20:15.625 cpu : usr=2.01%, sys=2.39%, ctx=3463, majf=0, minf=2 00:20:15.625 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:15.625 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.625 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.625 issued rwts: total=0,6792,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.625 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.625 job8: (groupid=0, jobs=1): err= 0: pid=3483500: Mon Nov 18 19:18:33 2024 00:20:15.626 write: IOPS=508, BW=127MiB/s (133MB/s)(1291MiB/10158msec); 0 zone resets 00:20:15.626 slat (usec): min=17, max=65794, avg=1178.29, stdev=3525.92 00:20:15.626 clat (usec): min=1303, max=405017, avg=124653.30, stdev=71475.83 00:20:15.626 lat (usec): min=1935, max=405056, avg=125831.59, stdev=72253.19 00:20:15.626 clat percentiles (msec): 00:20:15.626 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 59], 00:20:15.626 | 30.00th=[ 82], 40.00th=[ 108], 50.00th=[ 128], 60.00th=[ 138], 00:20:15.626 | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 218], 95.00th=[ 259], 00:20:15.626 | 99.00th=[ 317], 99.50th=[ 355], 99.90th=[ 388], 99.95th=[ 401], 00:20:15.626 | 99.99th=[ 405] 00:20:15.626 bw ( KiB/s): min=59392, max=243736, per=8.95%, avg=130555.60, stdev=38572.09, samples=20 00:20:15.626 iops : min= 232, max= 952, avg=509.90, stdev=150.63, samples=20 00:20:15.626 lat (msec) : 2=0.04%, 4=0.48%, 10=2.34%, 20=3.60%, 50=10.30% 00:20:15.626 lat (msec) : 100=20.31%, 250=56.56%, 500=6.35% 00:20:15.626 cpu : usr=1.68%, sys=1.80%, ctx=3194, majf=0, minf=1 00:20:15.626 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:15.626 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.626 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.626 issued rwts: total=0,5164,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.626 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.626 job9: (groupid=0, jobs=1): err= 0: pid=3483501: Mon Nov 18 19:18:33 2024 00:20:15.626 write: IOPS=582, BW=146MiB/s (153MB/s)(1481MiB/10158msec); 0 zone resets 00:20:15.626 slat (usec): min=20, max=19839, avg=1621.09, stdev=3175.60 00:20:15.626 clat (msec): min=3, max=362, avg=108.10, stdev=44.92 00:20:15.626 lat (msec): min=3, max=362, avg=109.72, stdev=45.52 00:20:15.626 clat percentiles (msec): 00:20:15.626 | 1.00th=[ 21], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 71], 00:20:15.626 | 30.00th=[ 83], 40.00th=[ 96], 50.00th=[ 113], 60.00th=[ 122], 00:20:15.626 | 70.00th=[ 133], 80.00th=[ 140], 90.00th=[ 161], 95.00th=[ 180], 00:20:15.626 | 99.00th=[ 215], 99.50th=[ 275], 99.90th=[ 347], 99.95th=[ 347], 00:20:15.626 | 99.99th=[ 363] 00:20:15.626 bw ( KiB/s): min=78179, max=292864, per=10.28%, avg=149982.55, stdev=52471.60, samples=20 00:20:15.626 iops : min= 305, max= 1144, avg=585.85, stdev=205.00, samples=20 00:20:15.626 lat (msec) : 4=0.02%, 10=0.22%, 20=0.73%, 50=14.71%, 100=25.94% 00:20:15.626 lat (msec) : 250=57.82%, 500=0.57% 00:20:15.626 cpu : usr=1.90%, sys=1.92%, ctx=1777, majf=0, minf=1 00:20:15.626 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:15.626 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.626 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.626 issued rwts: total=0,5922,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.626 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.626 job10: (groupid=0, jobs=1): err= 0: pid=3483502: Mon Nov 18 19:18:33 2024 00:20:15.626 write: IOPS=683, BW=171MiB/s (179MB/s)(1720MiB/10070msec); 0 zone resets 00:20:15.626 slat (usec): min=16, max=46975, avg=1064.55, stdev=2883.60 00:20:15.626 clat (usec): min=906, max=309711, avg=92440.24, stdev=58256.54 00:20:15.626 lat (usec): min=942, max=309755, avg=93504.79, stdev=58931.34 00:20:15.626 clat percentiles (msec): 00:20:15.626 | 1.00th=[ 6], 5.00th=[ 22], 10.00th=[ 31], 20.00th=[ 41], 00:20:15.626 | 30.00th=[ 44], 40.00th=[ 49], 50.00th=[ 85], 60.00th=[ 108], 00:20:15.626 | 70.00th=[ 126], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 194], 00:20:15.626 | 99.00th=[ 213], 99.50th=[ 222], 99.90th=[ 292], 99.95th=[ 300], 00:20:15.626 | 99.99th=[ 309] 00:20:15.626 bw ( KiB/s): min=86016, max=376832, per=11.95%, avg=174440.90, stdev=92869.39, samples=20 00:20:15.626 iops : min= 336, max= 1472, avg=681.35, stdev=362.79, samples=20 00:20:15.626 lat (usec) : 1000=0.03% 00:20:15.626 lat (msec) : 2=0.12%, 4=0.44%, 10=1.60%, 20=2.53%, 50=35.61% 00:20:15.626 lat (msec) : 100=15.31%, 250=44.14%, 500=0.23% 00:20:15.626 cpu : usr=2.04%, sys=2.22%, ctx=3337, majf=0, minf=1 00:20:15.626 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:15.626 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.626 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.626 issued rwts: total=0,6878,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.626 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.626 00:20:15.626 Run status group 0 (all jobs): 00:20:15.626 WRITE: bw=1425MiB/s (1494MB/s), 93.0MiB/s-171MiB/s (97.6MB/s-179MB/s), io=14.1GiB (15.2GB), run=10068-10165msec 00:20:15.626 00:20:15.626 Disk stats (read/write): 00:20:15.626 nvme0n1: ios=49/9899, merge=0/0, ticks=28/1213265, in_queue=1213293, util=97.27% 00:20:15.626 nvme10n1: ios=47/9453, merge=0/0, ticks=1426/1217710, in_queue=1219136, util=99.27% 00:20:15.626 nvme1n1: ios=49/8036, merge=0/0, ticks=119/1207115, in_queue=1207234, util=98.15% 00:20:15.626 nvme2n1: ios=46/8318, merge=0/0, ticks=932/1214433, in_queue=1215365, util=99.71% 00:20:15.626 nvme3n1: ios=49/9930, merge=0/0, ticks=72/1220757, in_queue=1220829, util=98.36% 00:20:15.626 nvme4n1: ios=49/7369, merge=0/0, ticks=5136/1199528, in_queue=1204664, util=100.00% 00:20:15.626 nvme5n1: ios=45/11794, merge=0/0, ticks=795/1224704, in_queue=1225499, util=100.00% 00:20:15.626 nvme6n1: ios=0/13365, merge=0/0, ticks=0/1218853, in_queue=1218853, util=98.42% 00:20:15.626 nvme7n1: ios=0/10177, merge=0/0, ticks=0/1220807, in_queue=1220807, util=98.84% 00:20:15.626 nvme8n1: ios=41/11675, merge=0/0, ticks=712/1202118, in_queue=1202830, util=100.00% 00:20:15.626 nvme9n1: ios=44/13543, merge=0/0, ticks=1074/1217225, in_queue=1218299, util=100.00% 00:20:15.626 19:18:33 -- target/multiconnection.sh@36 -- # sync 00:20:15.626 19:18:33 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:15.626 19:18:33 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.626 19:18:33 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:15.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:15.626 19:18:33 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:15.626 19:18:33 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.626 19:18:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.626 19:18:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:15.626 19:18:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.626 19:18:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:15.626 19:18:33 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.626 19:18:33 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:15.626 19:18:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.626 19:18:33 -- common/autotest_common.sh@10 -- # set +x 00:20:15.626 19:18:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.626 19:18:33 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.626 19:18:33 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:15.626 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:15.626 19:18:33 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:15.626 19:18:33 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.626 19:18:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.626 19:18:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:15.626 19:18:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.626 19:18:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:15.626 19:18:34 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.626 19:18:34 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:15.626 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.626 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:15.626 19:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.626 19:18:34 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.626 19:18:34 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:15.885 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:15.885 19:18:34 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:15.885 19:18:34 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.885 19:18:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.885 19:18:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:15.885 19:18:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.885 19:18:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:15.885 19:18:34 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.885 19:18:34 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:15.885 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.885 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:15.885 19:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.885 19:18:34 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.885 19:18:34 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:16.143 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:16.143 19:18:34 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:16.143 19:18:34 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.143 19:18:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.143 19:18:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:16.143 19:18:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.143 19:18:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:16.143 19:18:34 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.143 19:18:34 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:16.143 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.143 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:16.143 19:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.143 19:18:34 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.143 19:18:34 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:16.403 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:16.403 19:18:34 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:16.403 19:18:34 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.403 19:18:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.403 19:18:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:16.403 19:18:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.403 19:18:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:16.403 19:18:34 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.403 19:18:34 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:16.403 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.403 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:16.403 19:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.403 19:18:34 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.403 19:18:34 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:16.403 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:16.403 19:18:34 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:16.403 19:18:34 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.403 19:18:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.403 19:18:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:16.403 19:18:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.403 19:18:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:16.403 19:18:34 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.403 19:18:34 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:16.403 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.403 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:20:16.403 19:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.403 19:18:34 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.403 19:18:34 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:16.663 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:16.663 19:18:35 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:16.663 19:18:35 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.663 19:18:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.663 19:18:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:16.663 19:18:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.663 19:18:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:16.663 19:18:35 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.663 19:18:35 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:16.663 19:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.663 19:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:16.663 19:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.663 19:18:35 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.663 19:18:35 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:16.663 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:16.663 19:18:35 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:16.663 19:18:35 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.663 19:18:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.663 19:18:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:16.663 19:18:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.663 19:18:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:16.663 19:18:35 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.663 19:18:35 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:16.663 19:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.663 19:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:16.663 19:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.663 19:18:35 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.663 19:18:35 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:16.663 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:16.663 19:18:35 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:16.663 19:18:35 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.922 19:18:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.922 19:18:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:16.922 19:18:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.922 19:18:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:16.922 19:18:35 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.922 19:18:35 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:16.922 19:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.922 19:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:16.922 19:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.922 19:18:35 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.922 19:18:35 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:16.922 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:16.922 19:18:35 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:16.922 19:18:35 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.922 19:18:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.922 19:18:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:16.922 19:18:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.922 19:18:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:16.922 19:18:35 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.922 19:18:35 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:16.922 19:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.922 19:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:16.922 19:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.922 19:18:35 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.922 19:18:35 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:16.922 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:16.922 19:18:35 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:16.922 19:18:35 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.922 19:18:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.922 19:18:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:16.922 19:18:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.922 19:18:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:17.182 19:18:35 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.182 19:18:35 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:17.182 19:18:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.182 19:18:35 -- common/autotest_common.sh@10 -- # set +x 00:20:17.182 19:18:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.182 19:18:35 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:17.182 19:18:35 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:17.182 19:18:35 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:17.182 19:18:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:17.182 19:18:35 -- nvmf/common.sh@116 -- # sync 00:20:17.182 19:18:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:17.182 19:18:35 -- nvmf/common.sh@119 -- # set +e 00:20:17.182 19:18:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:17.182 19:18:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:17.182 rmmod nvme_tcp 00:20:17.182 rmmod nvme_fabrics 00:20:17.182 rmmod nvme_keyring 00:20:17.182 19:18:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:17.182 19:18:35 -- nvmf/common.sh@123 -- # set -e 00:20:17.182 19:18:35 -- nvmf/common.sh@124 -- # return 0 00:20:17.182 19:18:35 -- nvmf/common.sh@477 -- # '[' -n 3477146 ']' 00:20:17.182 19:18:35 -- nvmf/common.sh@478 -- # killprocess 3477146 00:20:17.182 19:18:35 -- common/autotest_common.sh@936 -- # '[' -z 3477146 ']' 00:20:17.182 19:18:35 -- common/autotest_common.sh@940 -- # kill -0 3477146 00:20:17.182 19:18:35 -- common/autotest_common.sh@941 -- # uname 00:20:17.182 19:18:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.182 19:18:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3477146 00:20:17.182 19:18:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:17.182 19:18:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:17.182 19:18:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3477146' 00:20:17.182 killing process with pid 3477146 00:20:17.182 19:18:35 -- common/autotest_common.sh@955 -- # kill 3477146 00:20:17.182 19:18:35 -- common/autotest_common.sh@960 -- # wait 3477146 00:20:17.749 19:18:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:17.749 19:18:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:17.749 19:18:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:17.749 19:18:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:17.749 19:18:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:17.749 19:18:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:17.749 19:18:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:17.749 19:18:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:19.659 19:18:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:19.659 00:20:19.659 real 1m1.202s 00:20:19.659 user 3m29.287s 00:20:19.659 sys 0m24.427s 00:20:19.659 19:18:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:19.659 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:20:19.659 ************************************ 00:20:19.659 END TEST nvmf_multiconnection 00:20:19.659 ************************************ 00:20:19.918 19:18:38 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:19.918 19:18:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:19.918 19:18:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:19.918 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:20:19.918 ************************************ 00:20:19.918 START TEST nvmf_initiator_timeout 00:20:19.918 ************************************ 00:20:19.918 19:18:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:19.918 * Looking for test storage... 00:20:19.918 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:19.918 19:18:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:19.918 19:18:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:19.918 19:18:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:19.918 19:18:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:19.918 19:18:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:19.918 19:18:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:19.918 19:18:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:19.918 19:18:38 -- scripts/common.sh@335 -- # IFS=.-: 00:20:19.918 19:18:38 -- scripts/common.sh@335 -- # read -ra ver1 00:20:19.918 19:18:38 -- scripts/common.sh@336 -- # IFS=.-: 00:20:19.918 19:18:38 -- scripts/common.sh@336 -- # read -ra ver2 00:20:19.918 19:18:38 -- scripts/common.sh@337 -- # local 'op=<' 00:20:19.918 19:18:38 -- scripts/common.sh@339 -- # ver1_l=2 00:20:19.918 19:18:38 -- scripts/common.sh@340 -- # ver2_l=1 00:20:19.918 19:18:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:19.918 19:18:38 -- scripts/common.sh@343 -- # case "$op" in 00:20:19.918 19:18:38 -- scripts/common.sh@344 -- # : 1 00:20:19.918 19:18:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:19.918 19:18:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:19.918 19:18:38 -- scripts/common.sh@364 -- # decimal 1 00:20:19.918 19:18:38 -- scripts/common.sh@352 -- # local d=1 00:20:19.918 19:18:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:19.918 19:18:38 -- scripts/common.sh@354 -- # echo 1 00:20:19.918 19:18:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:19.918 19:18:38 -- scripts/common.sh@365 -- # decimal 2 00:20:19.918 19:18:38 -- scripts/common.sh@352 -- # local d=2 00:20:19.918 19:18:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:19.918 19:18:38 -- scripts/common.sh@354 -- # echo 2 00:20:19.918 19:18:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:19.918 19:18:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:19.918 19:18:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:19.918 19:18:38 -- scripts/common.sh@367 -- # return 0 00:20:19.918 19:18:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:19.918 19:18:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:19.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:19.918 --rc genhtml_branch_coverage=1 00:20:19.918 --rc genhtml_function_coverage=1 00:20:19.918 --rc genhtml_legend=1 00:20:19.918 --rc geninfo_all_blocks=1 00:20:19.918 --rc geninfo_unexecuted_blocks=1 00:20:19.918 00:20:19.918 ' 00:20:19.918 19:18:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:19.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:19.918 --rc genhtml_branch_coverage=1 00:20:19.918 --rc genhtml_function_coverage=1 00:20:19.918 --rc genhtml_legend=1 00:20:19.918 --rc geninfo_all_blocks=1 00:20:19.918 --rc geninfo_unexecuted_blocks=1 00:20:19.918 00:20:19.918 ' 00:20:19.918 19:18:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:19.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:19.918 --rc genhtml_branch_coverage=1 00:20:19.918 --rc genhtml_function_coverage=1 00:20:19.918 --rc genhtml_legend=1 00:20:19.918 --rc geninfo_all_blocks=1 00:20:19.918 --rc geninfo_unexecuted_blocks=1 00:20:19.918 00:20:19.918 ' 00:20:19.918 19:18:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:19.918 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:19.918 --rc genhtml_branch_coverage=1 00:20:19.918 --rc genhtml_function_coverage=1 00:20:19.918 --rc genhtml_legend=1 00:20:19.918 --rc geninfo_all_blocks=1 00:20:19.918 --rc geninfo_unexecuted_blocks=1 00:20:19.918 00:20:19.918 ' 00:20:19.918 19:18:38 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:19.918 19:18:38 -- nvmf/common.sh@7 -- # uname -s 00:20:19.918 19:18:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:19.918 19:18:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:19.918 19:18:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:19.918 19:18:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:19.918 19:18:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:19.918 19:18:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:19.918 19:18:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:19.918 19:18:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:19.918 19:18:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:19.918 19:18:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:19.918 19:18:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:19.918 19:18:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:19.918 19:18:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:19.918 19:18:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:19.918 19:18:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:19.918 19:18:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:19.918 19:18:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:19.918 19:18:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:19.918 19:18:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:19.918 19:18:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.918 19:18:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.918 19:18:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.918 19:18:38 -- paths/export.sh@5 -- # export PATH 00:20:19.918 19:18:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:19.918 19:18:38 -- nvmf/common.sh@46 -- # : 0 00:20:19.919 19:18:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:19.919 19:18:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:19.919 19:18:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:19.919 19:18:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:19.919 19:18:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:19.919 19:18:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:19.919 19:18:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:19.919 19:18:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:19.919 19:18:38 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:19.919 19:18:38 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:19.919 19:18:38 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:19.919 19:18:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:19.919 19:18:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:19.919 19:18:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:19.919 19:18:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:19.919 19:18:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:19.919 19:18:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:19.919 19:18:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:19.919 19:18:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:19.919 19:18:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:19.919 19:18:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:19.919 19:18:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:19.919 19:18:38 -- common/autotest_common.sh@10 -- # set +x 00:20:22.461 19:18:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:22.461 19:18:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:22.461 19:18:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:22.461 19:18:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:22.461 19:18:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:22.461 19:18:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:22.461 19:18:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:22.461 19:18:40 -- nvmf/common.sh@294 -- # net_devs=() 00:20:22.461 19:18:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:22.461 19:18:40 -- nvmf/common.sh@295 -- # e810=() 00:20:22.462 19:18:40 -- nvmf/common.sh@295 -- # local -ga e810 00:20:22.462 19:18:40 -- nvmf/common.sh@296 -- # x722=() 00:20:22.462 19:18:40 -- nvmf/common.sh@296 -- # local -ga x722 00:20:22.462 19:18:40 -- nvmf/common.sh@297 -- # mlx=() 00:20:22.462 19:18:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:22.462 19:18:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:22.462 19:18:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:22.462 19:18:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:22.462 19:18:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:22.462 19:18:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:22.462 19:18:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:22.462 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:22.462 19:18:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:22.462 19:18:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:22.462 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:22.462 19:18:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:22.462 19:18:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:22.462 19:18:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:22.462 19:18:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:22.462 19:18:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:22.462 19:18:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:22.462 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:22.462 19:18:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:22.462 19:18:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:22.462 19:18:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:22.462 19:18:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:22.462 19:18:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:22.462 19:18:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:22.462 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:22.462 19:18:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:22.462 19:18:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:22.462 19:18:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:22.462 19:18:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:22.462 19:18:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:22.462 19:18:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:22.462 19:18:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:22.462 19:18:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:22.462 19:18:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:22.462 19:18:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:22.462 19:18:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:22.462 19:18:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:22.462 19:18:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:22.462 19:18:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:22.462 19:18:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:22.462 19:18:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:22.462 19:18:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:22.462 19:18:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:22.462 19:18:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:22.462 19:18:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:22.462 19:18:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:22.462 19:18:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:22.462 19:18:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:22.462 19:18:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:22.462 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:22.462 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.363 ms 00:20:22.462 00:20:22.462 --- 10.0.0.2 ping statistics --- 00:20:22.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:22.462 rtt min/avg/max/mdev = 0.363/0.363/0.363/0.000 ms 00:20:22.462 19:18:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:22.462 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:22.462 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.161 ms 00:20:22.462 00:20:22.462 --- 10.0.0.1 ping statistics --- 00:20:22.462 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:22.462 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:20:22.462 19:18:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:22.462 19:18:40 -- nvmf/common.sh@410 -- # return 0 00:20:22.462 19:18:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:22.462 19:18:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:22.462 19:18:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:22.462 19:18:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:22.462 19:18:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:22.462 19:18:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:22.462 19:18:40 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:22.462 19:18:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:22.462 19:18:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:22.462 19:18:40 -- common/autotest_common.sh@10 -- # set +x 00:20:22.462 19:18:40 -- nvmf/common.sh@469 -- # nvmfpid=3486877 00:20:22.462 19:18:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:22.462 19:18:40 -- nvmf/common.sh@470 -- # waitforlisten 3486877 00:20:22.462 19:18:40 -- common/autotest_common.sh@829 -- # '[' -z 3486877 ']' 00:20:22.462 19:18:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:22.462 19:18:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:22.462 19:18:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:22.462 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:22.462 19:18:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:22.462 19:18:40 -- common/autotest_common.sh@10 -- # set +x 00:20:22.462 [2024-11-18 19:18:40.747709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:22.462 [2024-11-18 19:18:40.747803] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:22.462 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.462 [2024-11-18 19:18:40.823516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:22.462 [2024-11-18 19:18:40.946682] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:22.462 [2024-11-18 19:18:40.946843] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:22.462 [2024-11-18 19:18:40.946863] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:22.462 [2024-11-18 19:18:40.946878] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:22.462 [2024-11-18 19:18:40.946938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:22.462 [2024-11-18 19:18:40.946991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:22.462 [2024-11-18 19:18:40.950633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:22.462 [2024-11-18 19:18:40.950646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:23.398 19:18:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:23.398 19:18:41 -- common/autotest_common.sh@862 -- # return 0 00:20:23.398 19:18:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:23.398 19:18:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:23.398 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.398 19:18:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:23.398 19:18:41 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:23.398 19:18:41 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:23.398 19:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.398 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.398 Malloc0 00:20:23.398 19:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.398 19:18:41 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:23.398 19:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.398 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.398 Delay0 00:20:23.398 19:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.398 19:18:41 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:23.398 19:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.398 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.398 [2024-11-18 19:18:41.837175] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:23.398 19:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.398 19:18:41 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:23.398 19:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.398 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.398 19:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.398 19:18:41 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:23.398 19:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.398 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.398 19:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.399 19:18:41 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:23.399 19:18:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.399 19:18:41 -- common/autotest_common.sh@10 -- # set +x 00:20:23.399 [2024-11-18 19:18:41.865476] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:23.399 19:18:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.399 19:18:41 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:23.967 19:18:42 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:23.967 19:18:42 -- common/autotest_common.sh@1187 -- # local i=0 00:20:23.967 19:18:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:23.967 19:18:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:23.967 19:18:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:26.498 19:18:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:26.498 19:18:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:26.498 19:18:44 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:26.498 19:18:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:26.498 19:18:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:26.498 19:18:44 -- common/autotest_common.sh@1197 -- # return 0 00:20:26.498 19:18:44 -- target/initiator_timeout.sh@35 -- # fio_pid=3487322 00:20:26.498 19:18:44 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:26.498 19:18:44 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:26.498 [global] 00:20:26.498 thread=1 00:20:26.498 invalidate=1 00:20:26.498 rw=write 00:20:26.498 time_based=1 00:20:26.498 runtime=60 00:20:26.498 ioengine=libaio 00:20:26.498 direct=1 00:20:26.498 bs=4096 00:20:26.498 iodepth=1 00:20:26.498 norandommap=0 00:20:26.498 numjobs=1 00:20:26.498 00:20:26.498 verify_dump=1 00:20:26.498 verify_backlog=512 00:20:26.498 verify_state_save=0 00:20:26.498 do_verify=1 00:20:26.498 verify=crc32c-intel 00:20:26.498 [job0] 00:20:26.498 filename=/dev/nvme0n1 00:20:26.498 Could not set queue depth (nvme0n1) 00:20:26.498 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:26.498 fio-3.35 00:20:26.498 Starting 1 thread 00:20:29.032 19:18:47 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:29.032 19:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.032 19:18:47 -- common/autotest_common.sh@10 -- # set +x 00:20:29.032 true 00:20:29.032 19:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.032 19:18:47 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:29.032 19:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.032 19:18:47 -- common/autotest_common.sh@10 -- # set +x 00:20:29.032 true 00:20:29.032 19:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.032 19:18:47 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:29.032 19:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.032 19:18:47 -- common/autotest_common.sh@10 -- # set +x 00:20:29.032 true 00:20:29.032 19:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.032 19:18:47 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:29.032 19:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.032 19:18:47 -- common/autotest_common.sh@10 -- # set +x 00:20:29.032 true 00:20:29.032 19:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.032 19:18:47 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:32.320 19:18:50 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:32.320 19:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.320 19:18:50 -- common/autotest_common.sh@10 -- # set +x 00:20:32.320 true 00:20:32.320 19:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.320 19:18:50 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:32.320 19:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.320 19:18:50 -- common/autotest_common.sh@10 -- # set +x 00:20:32.320 true 00:20:32.320 19:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.320 19:18:50 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:32.320 19:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.320 19:18:50 -- common/autotest_common.sh@10 -- # set +x 00:20:32.320 true 00:20:32.320 19:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.320 19:18:50 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:32.320 19:18:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.320 19:18:50 -- common/autotest_common.sh@10 -- # set +x 00:20:32.320 true 00:20:32.320 19:18:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.320 19:18:50 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:32.320 19:18:50 -- target/initiator_timeout.sh@54 -- # wait 3487322 00:21:28.543 00:21:28.543 job0: (groupid=0, jobs=1): err= 0: pid=3487526: Mon Nov 18 19:19:44 2024 00:21:28.543 read: IOPS=26, BW=105KiB/s (108kB/s)(6324KiB/60027msec) 00:21:28.543 slat (nsec): min=5316, max=69616, avg=21523.59, stdev=10088.79 00:21:28.543 clat (usec): min=191, max=40888k, avg=37595.95, stdev=1028201.07 00:21:28.543 lat (usec): min=230, max=40888k, avg=37617.47, stdev=1028200.97 00:21:28.543 clat percentiles (usec): 00:21:28.543 | 1.00th=[ 235], 5.00th=[ 243], 10.00th=[ 247], 00:21:28.543 | 20.00th=[ 255], 30.00th=[ 265], 40.00th=[ 285], 00:21:28.543 | 50.00th=[ 297], 60.00th=[ 343], 70.00th=[ 375], 00:21:28.543 | 80.00th=[ 41157], 90.00th=[ 42206], 95.00th=[ 42206], 00:21:28.543 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 45876], 00:21:28.543 | 99.95th=[17112761], 99.99th=[17112761] 00:21:28.543 write: IOPS=34, BW=136KiB/s (140kB/s)(8192KiB/60027msec); 0 zone resets 00:21:28.543 slat (usec): min=6, max=28147, avg=38.35, stdev=662.33 00:21:28.543 clat (usec): min=165, max=495, avg=222.47, stdev=38.29 00:21:28.543 lat (usec): min=173, max=28421, avg=260.82, stdev=664.77 00:21:28.543 clat percentiles (usec): 00:21:28.543 | 1.00th=[ 174], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 190], 00:21:28.543 | 30.00th=[ 196], 40.00th=[ 202], 50.00th=[ 215], 60.00th=[ 227], 00:21:28.543 | 70.00th=[ 241], 80.00th=[ 249], 90.00th=[ 273], 95.00th=[ 293], 00:21:28.543 | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 429], 99.95th=[ 449], 00:21:28.543 | 99.99th=[ 494] 00:21:28.543 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=4 00:21:28.543 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=4 00:21:28.543 lat (usec) : 250=51.72%, 500=36.13%, 750=0.06% 00:21:28.543 lat (msec) : 50=12.07%, >=2000=0.03% 00:21:28.543 cpu : usr=0.05%, sys=0.15%, ctx=3635, majf=0, minf=1 00:21:28.543 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:28.543 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.543 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.543 issued rwts: total=1581,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.543 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:28.543 00:21:28.543 Run status group 0 (all jobs): 00:21:28.543 READ: bw=105KiB/s (108kB/s), 105KiB/s-105KiB/s (108kB/s-108kB/s), io=6324KiB (6476kB), run=60027-60027msec 00:21:28.543 WRITE: bw=136KiB/s (140kB/s), 136KiB/s-136KiB/s (140kB/s-140kB/s), io=8192KiB (8389kB), run=60027-60027msec 00:21:28.543 00:21:28.543 Disk stats (read/write): 00:21:28.543 nvme0n1: ios=1629/2048, merge=0/0, ticks=19663/435, in_queue=20098, util=99.68% 00:21:28.543 19:19:44 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:28.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:28.543 19:19:44 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:28.543 19:19:44 -- common/autotest_common.sh@1208 -- # local i=0 00:21:28.544 19:19:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:28.544 19:19:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:28.544 19:19:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:28.544 19:19:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:28.544 19:19:45 -- common/autotest_common.sh@1220 -- # return 0 00:21:28.544 19:19:45 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:28.544 19:19:45 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:28.544 nvmf hotplug test: fio successful as expected 00:21:28.544 19:19:45 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:28.544 19:19:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:28.544 19:19:45 -- common/autotest_common.sh@10 -- # set +x 00:21:28.544 19:19:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:28.544 19:19:45 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:28.544 19:19:45 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:28.544 19:19:45 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:28.544 19:19:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:28.544 19:19:45 -- nvmf/common.sh@116 -- # sync 00:21:28.544 19:19:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:28.544 19:19:45 -- nvmf/common.sh@119 -- # set +e 00:21:28.544 19:19:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:28.544 19:19:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:28.544 rmmod nvme_tcp 00:21:28.544 rmmod nvme_fabrics 00:21:28.544 rmmod nvme_keyring 00:21:28.544 19:19:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:28.544 19:19:45 -- nvmf/common.sh@123 -- # set -e 00:21:28.544 19:19:45 -- nvmf/common.sh@124 -- # return 0 00:21:28.544 19:19:45 -- nvmf/common.sh@477 -- # '[' -n 3486877 ']' 00:21:28.544 19:19:45 -- nvmf/common.sh@478 -- # killprocess 3486877 00:21:28.544 19:19:45 -- common/autotest_common.sh@936 -- # '[' -z 3486877 ']' 00:21:28.544 19:19:45 -- common/autotest_common.sh@940 -- # kill -0 3486877 00:21:28.544 19:19:45 -- common/autotest_common.sh@941 -- # uname 00:21:28.544 19:19:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:28.544 19:19:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3486877 00:21:28.544 19:19:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:28.544 19:19:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:28.544 19:19:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3486877' 00:21:28.544 killing process with pid 3486877 00:21:28.544 19:19:45 -- common/autotest_common.sh@955 -- # kill 3486877 00:21:28.544 19:19:45 -- common/autotest_common.sh@960 -- # wait 3486877 00:21:28.544 19:19:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:28.544 19:19:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:28.544 19:19:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:28.544 19:19:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:28.544 19:19:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:28.544 19:19:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:28.544 19:19:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:28.544 19:19:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:29.112 19:19:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:29.112 00:21:29.112 real 1m9.176s 00:21:29.112 user 4m14.338s 00:21:29.112 sys 0m6.507s 00:21:29.113 19:19:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:29.113 19:19:47 -- common/autotest_common.sh@10 -- # set +x 00:21:29.113 ************************************ 00:21:29.113 END TEST nvmf_initiator_timeout 00:21:29.113 ************************************ 00:21:29.113 19:19:47 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:29.113 19:19:47 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:29.113 19:19:47 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:29.113 19:19:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:29.113 19:19:47 -- common/autotest_common.sh@10 -- # set +x 00:21:31.017 19:19:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:31.017 19:19:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:31.017 19:19:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:31.017 19:19:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:31.017 19:19:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:31.017 19:19:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:31.017 19:19:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:31.017 19:19:49 -- nvmf/common.sh@294 -- # net_devs=() 00:21:31.017 19:19:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:31.017 19:19:49 -- nvmf/common.sh@295 -- # e810=() 00:21:31.017 19:19:49 -- nvmf/common.sh@295 -- # local -ga e810 00:21:31.017 19:19:49 -- nvmf/common.sh@296 -- # x722=() 00:21:31.017 19:19:49 -- nvmf/common.sh@296 -- # local -ga x722 00:21:31.017 19:19:49 -- nvmf/common.sh@297 -- # mlx=() 00:21:31.017 19:19:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:31.017 19:19:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:31.017 19:19:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:31.017 19:19:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:31.017 19:19:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:31.017 19:19:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.017 19:19:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:31.017 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:31.017 19:19:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.017 19:19:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:31.017 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:31.017 19:19:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:31.017 19:19:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:31.017 19:19:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.017 19:19:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.017 19:19:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.017 19:19:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.017 19:19:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:31.017 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:31.017 19:19:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.017 19:19:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.017 19:19:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.017 19:19:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.017 19:19:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.017 19:19:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:31.017 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:31.017 19:19:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.017 19:19:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:31.017 19:19:49 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:31.017 19:19:49 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:31.017 19:19:49 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:31.017 19:19:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:31.017 19:19:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:31.017 19:19:49 -- common/autotest_common.sh@10 -- # set +x 00:21:31.017 ************************************ 00:21:31.017 START TEST nvmf_perf_adq 00:21:31.017 ************************************ 00:21:31.017 19:19:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:31.017 * Looking for test storage... 00:21:31.017 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:31.017 19:19:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:31.017 19:19:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:31.017 19:19:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:31.275 19:19:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:31.275 19:19:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:31.275 19:19:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:31.275 19:19:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:31.275 19:19:49 -- scripts/common.sh@335 -- # IFS=.-: 00:21:31.275 19:19:49 -- scripts/common.sh@335 -- # read -ra ver1 00:21:31.276 19:19:49 -- scripts/common.sh@336 -- # IFS=.-: 00:21:31.276 19:19:49 -- scripts/common.sh@336 -- # read -ra ver2 00:21:31.276 19:19:49 -- scripts/common.sh@337 -- # local 'op=<' 00:21:31.276 19:19:49 -- scripts/common.sh@339 -- # ver1_l=2 00:21:31.276 19:19:49 -- scripts/common.sh@340 -- # ver2_l=1 00:21:31.276 19:19:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:31.276 19:19:49 -- scripts/common.sh@343 -- # case "$op" in 00:21:31.276 19:19:49 -- scripts/common.sh@344 -- # : 1 00:21:31.276 19:19:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:31.276 19:19:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:31.276 19:19:49 -- scripts/common.sh@364 -- # decimal 1 00:21:31.276 19:19:49 -- scripts/common.sh@352 -- # local d=1 00:21:31.276 19:19:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:31.276 19:19:49 -- scripts/common.sh@354 -- # echo 1 00:21:31.276 19:19:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:31.276 19:19:49 -- scripts/common.sh@365 -- # decimal 2 00:21:31.276 19:19:49 -- scripts/common.sh@352 -- # local d=2 00:21:31.276 19:19:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:31.276 19:19:49 -- scripts/common.sh@354 -- # echo 2 00:21:31.276 19:19:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:31.276 19:19:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:31.276 19:19:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:31.276 19:19:49 -- scripts/common.sh@367 -- # return 0 00:21:31.276 19:19:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:31.276 19:19:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:31.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.276 --rc genhtml_branch_coverage=1 00:21:31.276 --rc genhtml_function_coverage=1 00:21:31.276 --rc genhtml_legend=1 00:21:31.276 --rc geninfo_all_blocks=1 00:21:31.276 --rc geninfo_unexecuted_blocks=1 00:21:31.276 00:21:31.276 ' 00:21:31.276 19:19:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:31.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.276 --rc genhtml_branch_coverage=1 00:21:31.276 --rc genhtml_function_coverage=1 00:21:31.276 --rc genhtml_legend=1 00:21:31.276 --rc geninfo_all_blocks=1 00:21:31.276 --rc geninfo_unexecuted_blocks=1 00:21:31.276 00:21:31.276 ' 00:21:31.276 19:19:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:31.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.276 --rc genhtml_branch_coverage=1 00:21:31.276 --rc genhtml_function_coverage=1 00:21:31.276 --rc genhtml_legend=1 00:21:31.276 --rc geninfo_all_blocks=1 00:21:31.276 --rc geninfo_unexecuted_blocks=1 00:21:31.276 00:21:31.276 ' 00:21:31.276 19:19:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:31.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.276 --rc genhtml_branch_coverage=1 00:21:31.276 --rc genhtml_function_coverage=1 00:21:31.276 --rc genhtml_legend=1 00:21:31.276 --rc geninfo_all_blocks=1 00:21:31.276 --rc geninfo_unexecuted_blocks=1 00:21:31.276 00:21:31.276 ' 00:21:31.276 19:19:49 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:31.276 19:19:49 -- nvmf/common.sh@7 -- # uname -s 00:21:31.276 19:19:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:31.276 19:19:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:31.276 19:19:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:31.276 19:19:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:31.276 19:19:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:31.276 19:19:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:31.276 19:19:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:31.276 19:19:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:31.276 19:19:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:31.276 19:19:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:31.276 19:19:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:31.276 19:19:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:31.276 19:19:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:31.276 19:19:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:31.276 19:19:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:31.276 19:19:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:31.276 19:19:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:31.276 19:19:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:31.276 19:19:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:31.276 19:19:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.276 19:19:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.276 19:19:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.276 19:19:49 -- paths/export.sh@5 -- # export PATH 00:21:31.276 19:19:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.276 19:19:49 -- nvmf/common.sh@46 -- # : 0 00:21:31.276 19:19:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:31.276 19:19:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:31.276 19:19:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:31.276 19:19:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:31.276 19:19:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:31.276 19:19:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:31.276 19:19:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:31.276 19:19:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:31.276 19:19:49 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:31.276 19:19:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:31.276 19:19:49 -- common/autotest_common.sh@10 -- # set +x 00:21:33.250 19:19:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:33.250 19:19:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:33.250 19:19:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:33.250 19:19:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:33.250 19:19:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:33.250 19:19:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:33.250 19:19:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:33.250 19:19:51 -- nvmf/common.sh@294 -- # net_devs=() 00:21:33.250 19:19:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:33.250 19:19:51 -- nvmf/common.sh@295 -- # e810=() 00:21:33.250 19:19:51 -- nvmf/common.sh@295 -- # local -ga e810 00:21:33.250 19:19:51 -- nvmf/common.sh@296 -- # x722=() 00:21:33.250 19:19:51 -- nvmf/common.sh@296 -- # local -ga x722 00:21:33.250 19:19:51 -- nvmf/common.sh@297 -- # mlx=() 00:21:33.250 19:19:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:33.250 19:19:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:33.250 19:19:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:33.250 19:19:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:33.250 19:19:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:33.250 19:19:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:33.250 19:19:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:33.250 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:33.250 19:19:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:33.250 19:19:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:33.250 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:33.250 19:19:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:33.250 19:19:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:33.250 19:19:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:33.250 19:19:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:33.250 19:19:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:33.250 19:19:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:33.250 19:19:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:33.250 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:33.250 19:19:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:33.250 19:19:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:33.250 19:19:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:33.250 19:19:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:33.250 19:19:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:33.250 19:19:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:33.250 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:33.250 19:19:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:33.250 19:19:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:33.250 19:19:51 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:33.250 19:19:51 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:33.250 19:19:51 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:33.250 19:19:51 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:33.250 19:19:51 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:33.820 19:19:52 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:36.352 19:19:54 -- target/perf_adq.sh@54 -- # sleep 5 00:21:41.638 19:19:59 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:41.638 19:19:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:41.638 19:19:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:41.638 19:19:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:41.638 19:19:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:41.638 19:19:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:41.638 19:19:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.638 19:19:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.638 19:19:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.638 19:19:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:41.638 19:19:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.638 19:19:59 -- common/autotest_common.sh@10 -- # set +x 00:21:41.638 19:19:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:41.638 19:19:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:41.638 19:19:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:41.638 19:19:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:41.638 19:19:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:41.638 19:19:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:41.638 19:19:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:41.638 19:19:59 -- nvmf/common.sh@294 -- # net_devs=() 00:21:41.638 19:19:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:41.638 19:19:59 -- nvmf/common.sh@295 -- # e810=() 00:21:41.638 19:19:59 -- nvmf/common.sh@295 -- # local -ga e810 00:21:41.638 19:19:59 -- nvmf/common.sh@296 -- # x722=() 00:21:41.638 19:19:59 -- nvmf/common.sh@296 -- # local -ga x722 00:21:41.638 19:19:59 -- nvmf/common.sh@297 -- # mlx=() 00:21:41.638 19:19:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:41.638 19:19:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:41.638 19:19:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:41.638 19:19:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:41.638 19:19:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:41.638 19:19:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:41.638 19:19:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:41.638 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:41.638 19:19:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:41.638 19:19:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:41.638 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:41.638 19:19:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:41.638 19:19:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:41.638 19:19:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:41.638 19:19:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:41.638 19:19:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:41.638 19:19:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:41.638 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:41.638 19:19:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:41.638 19:19:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:41.638 19:19:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:41.638 19:19:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:41.638 19:19:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:41.638 19:19:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:41.638 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:41.638 19:19:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:41.638 19:19:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:41.638 19:19:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:41.638 19:19:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:41.638 19:19:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:41.638 19:19:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:41.638 19:19:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:41.638 19:19:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:41.638 19:19:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:41.638 19:19:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:41.638 19:19:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:41.638 19:19:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:41.638 19:19:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:41.638 19:19:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:41.638 19:19:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:41.638 19:19:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:41.638 19:19:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:41.638 19:19:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:41.638 19:19:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:41.638 19:19:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:41.638 19:19:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:41.638 19:19:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:41.638 19:19:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:41.638 19:19:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:41.638 19:19:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:41.638 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:41.638 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:21:41.639 00:21:41.639 --- 10.0.0.2 ping statistics --- 00:21:41.639 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:41.639 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:21:41.639 19:19:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:41.639 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:41.639 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:21:41.639 00:21:41.639 --- 10.0.0.1 ping statistics --- 00:21:41.639 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:41.639 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:21:41.639 19:19:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:41.639 19:19:59 -- nvmf/common.sh@410 -- # return 0 00:21:41.639 19:19:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:41.639 19:19:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:41.639 19:19:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:41.639 19:19:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:41.639 19:19:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:41.639 19:19:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:41.639 19:19:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:41.639 19:19:59 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:41.639 19:19:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:41.639 19:19:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:41.639 19:19:59 -- common/autotest_common.sh@10 -- # set +x 00:21:41.639 19:19:59 -- nvmf/common.sh@469 -- # nvmfpid=3499330 00:21:41.639 19:19:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:41.639 19:19:59 -- nvmf/common.sh@470 -- # waitforlisten 3499330 00:21:41.639 19:19:59 -- common/autotest_common.sh@829 -- # '[' -z 3499330 ']' 00:21:41.639 19:19:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:41.639 19:19:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:41.639 19:19:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:41.639 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:41.639 19:19:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:41.639 19:19:59 -- common/autotest_common.sh@10 -- # set +x 00:21:41.639 [2024-11-18 19:19:59.829729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:41.639 [2024-11-18 19:19:59.829815] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:41.639 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.639 [2024-11-18 19:19:59.892224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:41.639 [2024-11-18 19:20:00.005022] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:41.639 [2024-11-18 19:20:00.005167] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:41.639 [2024-11-18 19:20:00.005186] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:41.639 [2024-11-18 19:20:00.005199] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:41.639 [2024-11-18 19:20:00.005254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:41.639 [2024-11-18 19:20:00.005275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:41.639 [2024-11-18 19:20:00.005292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:41.639 [2024-11-18 19:20:00.005295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:41.639 19:20:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:41.639 19:20:00 -- common/autotest_common.sh@862 -- # return 0 00:21:41.639 19:20:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:41.639 19:20:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:41.639 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.639 19:20:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:41.639 19:20:00 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:41.639 19:20:00 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:41.639 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.639 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.639 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.639 19:20:00 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:41.639 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.639 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.639 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.639 19:20:00 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:41.639 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.639 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.639 [2024-11-18 19:20:00.214720] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:41.639 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.639 19:20:00 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:41.639 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.639 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.899 Malloc1 00:21:41.899 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.899 19:20:00 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:41.899 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.899 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.899 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.899 19:20:00 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:41.899 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.899 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.899 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.899 19:20:00 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:41.899 19:20:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.899 19:20:00 -- common/autotest_common.sh@10 -- # set +x 00:21:41.899 [2024-11-18 19:20:00.266757] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:41.899 19:20:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.899 19:20:00 -- target/perf_adq.sh@73 -- # perfpid=3499479 00:21:41.899 19:20:00 -- target/perf_adq.sh@74 -- # sleep 2 00:21:41.899 19:20:00 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:41.899 EAL: No free 2048 kB hugepages reported on node 1 00:21:43.804 19:20:02 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:43.804 19:20:02 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:43.804 19:20:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.804 19:20:02 -- target/perf_adq.sh@76 -- # wc -l 00:21:43.804 19:20:02 -- common/autotest_common.sh@10 -- # set +x 00:21:43.804 19:20:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.804 19:20:02 -- target/perf_adq.sh@76 -- # count=4 00:21:43.804 19:20:02 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:43.804 19:20:02 -- target/perf_adq.sh@81 -- # wait 3499479 00:21:51.922 Initializing NVMe Controllers 00:21:51.922 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:51.922 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:51.922 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:51.922 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:51.922 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:51.922 Initialization complete. Launching workers. 00:21:51.922 ======================================================== 00:21:51.922 Latency(us) 00:21:51.922 Device Information : IOPS MiB/s Average min max 00:21:51.922 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11246.70 43.93 5690.69 1182.61 9442.09 00:21:51.922 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11067.30 43.23 5785.19 1494.68 10107.35 00:21:51.922 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11193.00 43.72 5719.72 1374.92 9888.89 00:21:51.922 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11131.00 43.48 5750.78 1595.47 9606.48 00:21:51.922 ======================================================== 00:21:51.922 Total : 44638.00 174.37 5736.38 1182.61 10107.35 00:21:51.922 00:21:51.922 19:20:10 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:51.922 19:20:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:51.922 19:20:10 -- nvmf/common.sh@116 -- # sync 00:21:51.922 19:20:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:51.922 19:20:10 -- nvmf/common.sh@119 -- # set +e 00:21:51.922 19:20:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:51.922 19:20:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:51.922 rmmod nvme_tcp 00:21:51.922 rmmod nvme_fabrics 00:21:51.922 rmmod nvme_keyring 00:21:51.922 19:20:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:51.922 19:20:10 -- nvmf/common.sh@123 -- # set -e 00:21:51.922 19:20:10 -- nvmf/common.sh@124 -- # return 0 00:21:51.922 19:20:10 -- nvmf/common.sh@477 -- # '[' -n 3499330 ']' 00:21:51.922 19:20:10 -- nvmf/common.sh@478 -- # killprocess 3499330 00:21:51.922 19:20:10 -- common/autotest_common.sh@936 -- # '[' -z 3499330 ']' 00:21:51.922 19:20:10 -- common/autotest_common.sh@940 -- # kill -0 3499330 00:21:51.922 19:20:10 -- common/autotest_common.sh@941 -- # uname 00:21:51.922 19:20:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:51.922 19:20:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3499330 00:21:51.922 19:20:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:51.922 19:20:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:51.922 19:20:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3499330' 00:21:51.922 killing process with pid 3499330 00:21:51.922 19:20:10 -- common/autotest_common.sh@955 -- # kill 3499330 00:21:51.922 19:20:10 -- common/autotest_common.sh@960 -- # wait 3499330 00:21:52.494 19:20:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:52.494 19:20:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:52.494 19:20:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:52.494 19:20:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:52.494 19:20:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:52.494 19:20:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:52.494 19:20:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:52.494 19:20:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:54.399 19:20:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:54.399 19:20:12 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:54.399 19:20:12 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:55.339 19:20:13 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:57.878 19:20:16 -- target/perf_adq.sh@54 -- # sleep 5 00:22:03.143 19:20:21 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:03.143 19:20:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:03.143 19:20:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:03.143 19:20:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:03.143 19:20:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:03.143 19:20:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:03.143 19:20:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:03.143 19:20:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:03.143 19:20:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:03.143 19:20:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:03.143 19:20:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:03.143 19:20:21 -- common/autotest_common.sh@10 -- # set +x 00:22:03.143 19:20:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:03.143 19:20:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:03.143 19:20:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:03.143 19:20:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:03.143 19:20:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:03.143 19:20:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:03.143 19:20:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:03.143 19:20:21 -- nvmf/common.sh@294 -- # net_devs=() 00:22:03.143 19:20:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:03.143 19:20:21 -- nvmf/common.sh@295 -- # e810=() 00:22:03.143 19:20:21 -- nvmf/common.sh@295 -- # local -ga e810 00:22:03.143 19:20:21 -- nvmf/common.sh@296 -- # x722=() 00:22:03.143 19:20:21 -- nvmf/common.sh@296 -- # local -ga x722 00:22:03.143 19:20:21 -- nvmf/common.sh@297 -- # mlx=() 00:22:03.143 19:20:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:03.143 19:20:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:03.143 19:20:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:03.143 19:20:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:03.143 19:20:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:03.143 19:20:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.143 19:20:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:03.143 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:03.143 19:20:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.143 19:20:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.143 19:20:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:03.143 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:03.143 19:20:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:03.144 19:20:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.144 19:20:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.144 19:20:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.144 19:20:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.144 19:20:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:03.144 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:03.144 19:20:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.144 19:20:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.144 19:20:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.144 19:20:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.144 19:20:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.144 19:20:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:03.144 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:03.144 19:20:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.144 19:20:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:03.144 19:20:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:03.144 19:20:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:03.144 19:20:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:03.144 19:20:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:03.144 19:20:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:03.144 19:20:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:03.144 19:20:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:03.144 19:20:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:03.144 19:20:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:03.144 19:20:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:03.144 19:20:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:03.144 19:20:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:03.144 19:20:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:03.144 19:20:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:03.144 19:20:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:03.144 19:20:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:03.144 19:20:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:03.144 19:20:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:03.144 19:20:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:03.144 19:20:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:03.144 19:20:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:03.144 19:20:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:03.144 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:03.144 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.194 ms 00:22:03.144 00:22:03.144 --- 10.0.0.2 ping statistics --- 00:22:03.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.144 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:22:03.144 19:20:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:03.144 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:03.144 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:22:03.144 00:22:03.144 --- 10.0.0.1 ping statistics --- 00:22:03.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.144 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:22:03.144 19:20:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:03.144 19:20:21 -- nvmf/common.sh@410 -- # return 0 00:22:03.144 19:20:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:03.144 19:20:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:03.144 19:20:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:03.144 19:20:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:03.144 19:20:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:03.144 19:20:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:03.144 19:20:21 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:03.144 19:20:21 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:03.144 19:20:21 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:03.144 19:20:21 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:03.144 net.core.busy_poll = 1 00:22:03.144 19:20:21 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:03.144 net.core.busy_read = 1 00:22:03.144 19:20:21 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:03.144 19:20:21 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:03.144 19:20:21 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:03.144 19:20:21 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:03.144 19:20:21 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:03.144 19:20:21 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:03.144 19:20:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:03.144 19:20:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:03.144 19:20:21 -- common/autotest_common.sh@10 -- # set +x 00:22:03.144 19:20:21 -- nvmf/common.sh@469 -- # nvmfpid=3502290 00:22:03.144 19:20:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:03.144 19:20:21 -- nvmf/common.sh@470 -- # waitforlisten 3502290 00:22:03.144 19:20:21 -- common/autotest_common.sh@829 -- # '[' -z 3502290 ']' 00:22:03.144 19:20:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:03.144 19:20:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:03.144 19:20:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:03.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:03.144 19:20:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:03.144 19:20:21 -- common/autotest_common.sh@10 -- # set +x 00:22:03.144 [2024-11-18 19:20:21.656182] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:03.144 [2024-11-18 19:20:21.656252] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:03.144 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.144 [2024-11-18 19:20:21.732527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:03.402 [2024-11-18 19:20:21.863355] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:03.402 [2024-11-18 19:20:21.863538] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:03.402 [2024-11-18 19:20:21.863567] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:03.402 [2024-11-18 19:20:21.863591] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:03.402 [2024-11-18 19:20:21.863675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:03.402 [2024-11-18 19:20:21.863738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:03.402 [2024-11-18 19:20:21.863806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:03.402 [2024-11-18 19:20:21.863814] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:03.402 19:20:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:03.402 19:20:21 -- common/autotest_common.sh@862 -- # return 0 00:22:03.402 19:20:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:03.402 19:20:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:03.402 19:20:21 -- common/autotest_common.sh@10 -- # set +x 00:22:03.403 19:20:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:03.403 19:20:21 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:03.403 19:20:21 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:03.403 19:20:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.403 19:20:21 -- common/autotest_common.sh@10 -- # set +x 00:22:03.403 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.403 19:20:22 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:03.403 19:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.403 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:03.661 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.661 19:20:22 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:03.661 19:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.661 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:03.661 [2024-11-18 19:20:22.106218] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:03.661 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.661 19:20:22 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:03.661 19:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.661 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:03.661 Malloc1 00:22:03.661 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.661 19:20:22 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:03.661 19:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.661 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:03.661 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.661 19:20:22 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:03.661 19:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.661 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:03.661 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.661 19:20:22 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:03.661 19:20:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.661 19:20:22 -- common/autotest_common.sh@10 -- # set +x 00:22:03.661 [2024-11-18 19:20:22.157069] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:03.661 19:20:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.661 19:20:22 -- target/perf_adq.sh@94 -- # perfpid=3502324 00:22:03.661 19:20:22 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:03.661 19:20:22 -- target/perf_adq.sh@95 -- # sleep 2 00:22:03.661 EAL: No free 2048 kB hugepages reported on node 1 00:22:06.191 19:20:24 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:06.191 19:20:24 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:06.191 19:20:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:06.191 19:20:24 -- target/perf_adq.sh@97 -- # wc -l 00:22:06.191 19:20:24 -- common/autotest_common.sh@10 -- # set +x 00:22:06.191 19:20:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:06.191 19:20:24 -- target/perf_adq.sh@97 -- # count=2 00:22:06.191 19:20:24 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:06.191 19:20:24 -- target/perf_adq.sh@103 -- # wait 3502324 00:22:14.301 Initializing NVMe Controllers 00:22:14.301 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:14.301 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:14.301 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:14.302 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:14.302 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:14.302 Initialization complete. Launching workers. 00:22:14.302 ======================================================== 00:22:14.302 Latency(us) 00:22:14.302 Device Information : IOPS MiB/s Average min max 00:22:14.302 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5128.93 20.03 12483.31 1384.40 61593.03 00:22:14.302 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 4866.83 19.01 13154.87 1111.84 59659.76 00:22:14.302 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5672.52 22.16 11284.60 1228.97 57969.45 00:22:14.302 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 13106.92 51.20 4883.04 1079.04 46926.56 00:22:14.302 ======================================================== 00:22:14.302 Total : 28775.19 112.40 8898.72 1079.04 61593.03 00:22:14.302 00:22:14.302 19:20:32 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:14.302 19:20:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.302 19:20:32 -- nvmf/common.sh@116 -- # sync 00:22:14.302 19:20:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.302 19:20:32 -- nvmf/common.sh@119 -- # set +e 00:22:14.302 19:20:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.302 19:20:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.302 rmmod nvme_tcp 00:22:14.302 rmmod nvme_fabrics 00:22:14.302 rmmod nvme_keyring 00:22:14.302 19:20:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.302 19:20:32 -- nvmf/common.sh@123 -- # set -e 00:22:14.302 19:20:32 -- nvmf/common.sh@124 -- # return 0 00:22:14.302 19:20:32 -- nvmf/common.sh@477 -- # '[' -n 3502290 ']' 00:22:14.302 19:20:32 -- nvmf/common.sh@478 -- # killprocess 3502290 00:22:14.302 19:20:32 -- common/autotest_common.sh@936 -- # '[' -z 3502290 ']' 00:22:14.302 19:20:32 -- common/autotest_common.sh@940 -- # kill -0 3502290 00:22:14.302 19:20:32 -- common/autotest_common.sh@941 -- # uname 00:22:14.302 19:20:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.302 19:20:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3502290 00:22:14.302 19:20:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.302 19:20:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.302 19:20:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3502290' 00:22:14.302 killing process with pid 3502290 00:22:14.302 19:20:32 -- common/autotest_common.sh@955 -- # kill 3502290 00:22:14.302 19:20:32 -- common/autotest_common.sh@960 -- # wait 3502290 00:22:14.302 19:20:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:14.302 19:20:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:14.302 19:20:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:14.302 19:20:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:14.302 19:20:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:14.302 19:20:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:14.302 19:20:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:14.302 19:20:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.587 19:20:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.587 19:20:35 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:17.587 00:22:17.587 real 0m46.151s 00:22:17.587 user 2m38.703s 00:22:17.587 sys 0m9.802s 00:22:17.587 19:20:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:17.587 19:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:17.587 ************************************ 00:22:17.587 END TEST nvmf_perf_adq 00:22:17.587 ************************************ 00:22:17.587 19:20:35 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:17.587 19:20:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:17.587 19:20:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.587 19:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:17.587 ************************************ 00:22:17.587 START TEST nvmf_shutdown 00:22:17.587 ************************************ 00:22:17.587 19:20:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:17.587 * Looking for test storage... 00:22:17.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:17.587 19:20:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:17.587 19:20:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:17.587 19:20:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:17.587 19:20:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:17.587 19:20:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:17.587 19:20:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:17.587 19:20:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:17.587 19:20:35 -- scripts/common.sh@335 -- # IFS=.-: 00:22:17.587 19:20:35 -- scripts/common.sh@335 -- # read -ra ver1 00:22:17.587 19:20:35 -- scripts/common.sh@336 -- # IFS=.-: 00:22:17.587 19:20:35 -- scripts/common.sh@336 -- # read -ra ver2 00:22:17.587 19:20:35 -- scripts/common.sh@337 -- # local 'op=<' 00:22:17.587 19:20:35 -- scripts/common.sh@339 -- # ver1_l=2 00:22:17.587 19:20:35 -- scripts/common.sh@340 -- # ver2_l=1 00:22:17.587 19:20:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:17.587 19:20:35 -- scripts/common.sh@343 -- # case "$op" in 00:22:17.587 19:20:35 -- scripts/common.sh@344 -- # : 1 00:22:17.587 19:20:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:17.587 19:20:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:17.587 19:20:35 -- scripts/common.sh@364 -- # decimal 1 00:22:17.587 19:20:35 -- scripts/common.sh@352 -- # local d=1 00:22:17.587 19:20:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:17.587 19:20:35 -- scripts/common.sh@354 -- # echo 1 00:22:17.587 19:20:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:17.587 19:20:35 -- scripts/common.sh@365 -- # decimal 2 00:22:17.587 19:20:35 -- scripts/common.sh@352 -- # local d=2 00:22:17.587 19:20:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:17.587 19:20:35 -- scripts/common.sh@354 -- # echo 2 00:22:17.587 19:20:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:17.587 19:20:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:17.587 19:20:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:17.587 19:20:35 -- scripts/common.sh@367 -- # return 0 00:22:17.587 19:20:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:17.587 19:20:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:17.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.587 --rc genhtml_branch_coverage=1 00:22:17.587 --rc genhtml_function_coverage=1 00:22:17.587 --rc genhtml_legend=1 00:22:17.587 --rc geninfo_all_blocks=1 00:22:17.587 --rc geninfo_unexecuted_blocks=1 00:22:17.587 00:22:17.587 ' 00:22:17.587 19:20:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:17.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.587 --rc genhtml_branch_coverage=1 00:22:17.587 --rc genhtml_function_coverage=1 00:22:17.587 --rc genhtml_legend=1 00:22:17.588 --rc geninfo_all_blocks=1 00:22:17.588 --rc geninfo_unexecuted_blocks=1 00:22:17.588 00:22:17.588 ' 00:22:17.588 19:20:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:17.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.588 --rc genhtml_branch_coverage=1 00:22:17.588 --rc genhtml_function_coverage=1 00:22:17.588 --rc genhtml_legend=1 00:22:17.588 --rc geninfo_all_blocks=1 00:22:17.588 --rc geninfo_unexecuted_blocks=1 00:22:17.588 00:22:17.588 ' 00:22:17.588 19:20:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:17.588 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:17.588 --rc genhtml_branch_coverage=1 00:22:17.588 --rc genhtml_function_coverage=1 00:22:17.588 --rc genhtml_legend=1 00:22:17.588 --rc geninfo_all_blocks=1 00:22:17.588 --rc geninfo_unexecuted_blocks=1 00:22:17.588 00:22:17.588 ' 00:22:17.588 19:20:35 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:17.588 19:20:35 -- nvmf/common.sh@7 -- # uname -s 00:22:17.588 19:20:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:17.588 19:20:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:17.588 19:20:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:17.588 19:20:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:17.588 19:20:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:17.588 19:20:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:17.588 19:20:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:17.588 19:20:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:17.588 19:20:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:17.588 19:20:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:17.588 19:20:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.588 19:20:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.588 19:20:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:17.588 19:20:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:17.588 19:20:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:17.588 19:20:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:17.588 19:20:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:17.588 19:20:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:17.588 19:20:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:17.588 19:20:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.588 19:20:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.588 19:20:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.588 19:20:35 -- paths/export.sh@5 -- # export PATH 00:22:17.588 19:20:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.588 19:20:35 -- nvmf/common.sh@46 -- # : 0 00:22:17.588 19:20:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:17.588 19:20:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:17.588 19:20:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:17.588 19:20:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:17.588 19:20:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:17.588 19:20:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:17.588 19:20:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:17.588 19:20:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:17.588 19:20:35 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:17.588 19:20:35 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:17.588 19:20:35 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:17.588 19:20:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:17.588 19:20:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:17.588 19:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:17.588 ************************************ 00:22:17.588 START TEST nvmf_shutdown_tc1 00:22:17.588 ************************************ 00:22:17.588 19:20:35 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:17.588 19:20:35 -- target/shutdown.sh@74 -- # starttarget 00:22:17.588 19:20:35 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:17.588 19:20:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.588 19:20:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.588 19:20:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.588 19:20:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.588 19:20:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.588 19:20:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.588 19:20:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.588 19:20:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.588 19:20:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.588 19:20:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.588 19:20:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.588 19:20:35 -- common/autotest_common.sh@10 -- # set +x 00:22:19.490 19:20:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:19.490 19:20:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:19.490 19:20:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:19.490 19:20:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:19.490 19:20:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:19.490 19:20:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:19.490 19:20:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:19.490 19:20:37 -- nvmf/common.sh@294 -- # net_devs=() 00:22:19.490 19:20:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:19.490 19:20:37 -- nvmf/common.sh@295 -- # e810=() 00:22:19.490 19:20:37 -- nvmf/common.sh@295 -- # local -ga e810 00:22:19.490 19:20:37 -- nvmf/common.sh@296 -- # x722=() 00:22:19.490 19:20:37 -- nvmf/common.sh@296 -- # local -ga x722 00:22:19.490 19:20:37 -- nvmf/common.sh@297 -- # mlx=() 00:22:19.490 19:20:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:19.490 19:20:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:19.490 19:20:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:19.490 19:20:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:19.490 19:20:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:19.490 19:20:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.490 19:20:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:19.490 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:19.490 19:20:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.490 19:20:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:19.490 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:19.490 19:20:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:19.490 19:20:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:19.490 19:20:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.490 19:20:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.490 19:20:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.491 19:20:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.491 19:20:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:19.491 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:19.491 19:20:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.491 19:20:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.491 19:20:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.491 19:20:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.491 19:20:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.491 19:20:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:19.491 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:19.491 19:20:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.491 19:20:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:19.491 19:20:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:19.491 19:20:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:19.491 19:20:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:19.491 19:20:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:19.491 19:20:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:19.491 19:20:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:19.491 19:20:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:19.491 19:20:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:19.491 19:20:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:19.491 19:20:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:19.491 19:20:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:19.491 19:20:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:19.491 19:20:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:19.491 19:20:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:19.491 19:20:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:19.491 19:20:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:19.491 19:20:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:19.491 19:20:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:19.491 19:20:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:19.491 19:20:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:19.491 19:20:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:19.491 19:20:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:19.491 19:20:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:19.491 19:20:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:19.491 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:19.491 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.293 ms 00:22:19.491 00:22:19.491 --- 10.0.0.2 ping statistics --- 00:22:19.491 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.491 rtt min/avg/max/mdev = 0.293/0.293/0.293/0.000 ms 00:22:19.491 19:20:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:19.749 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:19.749 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:22:19.749 00:22:19.749 --- 10.0.0.1 ping statistics --- 00:22:19.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.749 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:22:19.749 19:20:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:19.749 19:20:38 -- nvmf/common.sh@410 -- # return 0 00:22:19.749 19:20:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:19.749 19:20:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:19.749 19:20:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:19.749 19:20:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:19.749 19:20:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:19.749 19:20:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:19.749 19:20:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:19.749 19:20:38 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:19.749 19:20:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:19.749 19:20:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:19.749 19:20:38 -- common/autotest_common.sh@10 -- # set +x 00:22:19.749 19:20:38 -- nvmf/common.sh@469 -- # nvmfpid=3505665 00:22:19.749 19:20:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:19.749 19:20:38 -- nvmf/common.sh@470 -- # waitforlisten 3505665 00:22:19.749 19:20:38 -- common/autotest_common.sh@829 -- # '[' -z 3505665 ']' 00:22:19.749 19:20:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:19.749 19:20:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:19.749 19:20:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:19.749 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:19.749 19:20:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:19.749 19:20:38 -- common/autotest_common.sh@10 -- # set +x 00:22:19.749 [2024-11-18 19:20:38.167908] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:19.749 [2024-11-18 19:20:38.168016] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:19.749 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.749 [2024-11-18 19:20:38.231911] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:19.749 [2024-11-18 19:20:38.342254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:19.749 [2024-11-18 19:20:38.342417] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:19.749 [2024-11-18 19:20:38.342449] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:19.749 [2024-11-18 19:20:38.342462] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:19.749 [2024-11-18 19:20:38.342533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:19.749 [2024-11-18 19:20:38.342628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:19.749 [2024-11-18 19:20:38.342632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:19.749 [2024-11-18 19:20:38.342564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:20.747 19:20:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:20.747 19:20:39 -- common/autotest_common.sh@862 -- # return 0 00:22:20.747 19:20:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:20.747 19:20:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:20.747 19:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:20.747 19:20:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:20.747 19:20:39 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:20.747 19:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.747 19:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:20.747 [2024-11-18 19:20:39.189312] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:20.747 19:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:20.747 19:20:39 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:20.747 19:20:39 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:20.747 19:20:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:20.747 19:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:20.747 19:20:39 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:20.747 19:20:39 -- target/shutdown.sh@28 -- # cat 00:22:20.747 19:20:39 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:20.747 19:20:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:20.747 19:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:20.747 Malloc1 00:22:20.747 [2024-11-18 19:20:39.264600] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:20.747 Malloc2 00:22:20.747 Malloc3 00:22:21.004 Malloc4 00:22:21.004 Malloc5 00:22:21.004 Malloc6 00:22:21.004 Malloc7 00:22:21.004 Malloc8 00:22:21.263 Malloc9 00:22:21.263 Malloc10 00:22:21.263 19:20:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:21.263 19:20:39 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:21.263 19:20:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:21.263 19:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:21.263 19:20:39 -- target/shutdown.sh@78 -- # perfpid=3505944 00:22:21.263 19:20:39 -- target/shutdown.sh@79 -- # waitforlisten 3505944 /var/tmp/bdevperf.sock 00:22:21.263 19:20:39 -- common/autotest_common.sh@829 -- # '[' -z 3505944 ']' 00:22:21.263 19:20:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:21.263 19:20:39 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:21.263 19:20:39 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:21.263 19:20:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:21.263 19:20:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:21.263 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:21.263 19:20:39 -- nvmf/common.sh@520 -- # config=() 00:22:21.263 19:20:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:21.263 19:20:39 -- nvmf/common.sh@520 -- # local subsystem config 00:22:21.263 19:20:39 -- common/autotest_common.sh@10 -- # set +x 00:22:21.263 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.263 { 00:22:21.263 "params": { 00:22:21.263 "name": "Nvme$subsystem", 00:22:21.263 "trtype": "$TEST_TRANSPORT", 00:22:21.263 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.263 "adrfam": "ipv4", 00:22:21.263 "trsvcid": "$NVMF_PORT", 00:22:21.263 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.263 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.263 "hdgst": ${hdgst:-false}, 00:22:21.263 "ddgst": ${ddgst:-false} 00:22:21.263 }, 00:22:21.263 "method": "bdev_nvme_attach_controller" 00:22:21.263 } 00:22:21.263 EOF 00:22:21.263 )") 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.263 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.263 { 00:22:21.263 "params": { 00:22:21.263 "name": "Nvme$subsystem", 00:22:21.263 "trtype": "$TEST_TRANSPORT", 00:22:21.263 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.263 "adrfam": "ipv4", 00:22:21.263 "trsvcid": "$NVMF_PORT", 00:22:21.263 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.263 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.263 "hdgst": ${hdgst:-false}, 00:22:21.263 "ddgst": ${ddgst:-false} 00:22:21.263 }, 00:22:21.263 "method": "bdev_nvme_attach_controller" 00:22:21.263 } 00:22:21.263 EOF 00:22:21.263 )") 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.263 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.263 { 00:22:21.263 "params": { 00:22:21.263 "name": "Nvme$subsystem", 00:22:21.263 "trtype": "$TEST_TRANSPORT", 00:22:21.263 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.263 "adrfam": "ipv4", 00:22:21.263 "trsvcid": "$NVMF_PORT", 00:22:21.263 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.263 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.263 "hdgst": ${hdgst:-false}, 00:22:21.263 "ddgst": ${ddgst:-false} 00:22:21.263 }, 00:22:21.263 "method": "bdev_nvme_attach_controller" 00:22:21.263 } 00:22:21.263 EOF 00:22:21.263 )") 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.263 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.263 { 00:22:21.263 "params": { 00:22:21.263 "name": "Nvme$subsystem", 00:22:21.263 "trtype": "$TEST_TRANSPORT", 00:22:21.263 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.263 "adrfam": "ipv4", 00:22:21.263 "trsvcid": "$NVMF_PORT", 00:22:21.263 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.263 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.263 "hdgst": ${hdgst:-false}, 00:22:21.263 "ddgst": ${ddgst:-false} 00:22:21.263 }, 00:22:21.263 "method": "bdev_nvme_attach_controller" 00:22:21.263 } 00:22:21.263 EOF 00:22:21.263 )") 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.263 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.263 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.263 { 00:22:21.263 "params": { 00:22:21.263 "name": "Nvme$subsystem", 00:22:21.263 "trtype": "$TEST_TRANSPORT", 00:22:21.263 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.263 "adrfam": "ipv4", 00:22:21.263 "trsvcid": "$NVMF_PORT", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.264 "hdgst": ${hdgst:-false}, 00:22:21.264 "ddgst": ${ddgst:-false} 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 } 00:22:21.264 EOF 00:22:21.264 )") 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.264 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.264 { 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme$subsystem", 00:22:21.264 "trtype": "$TEST_TRANSPORT", 00:22:21.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "$NVMF_PORT", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.264 "hdgst": ${hdgst:-false}, 00:22:21.264 "ddgst": ${ddgst:-false} 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 } 00:22:21.264 EOF 00:22:21.264 )") 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.264 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.264 { 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme$subsystem", 00:22:21.264 "trtype": "$TEST_TRANSPORT", 00:22:21.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "$NVMF_PORT", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.264 "hdgst": ${hdgst:-false}, 00:22:21.264 "ddgst": ${ddgst:-false} 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 } 00:22:21.264 EOF 00:22:21.264 )") 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.264 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.264 { 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme$subsystem", 00:22:21.264 "trtype": "$TEST_TRANSPORT", 00:22:21.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "$NVMF_PORT", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.264 "hdgst": ${hdgst:-false}, 00:22:21.264 "ddgst": ${ddgst:-false} 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 } 00:22:21.264 EOF 00:22:21.264 )") 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.264 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.264 { 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme$subsystem", 00:22:21.264 "trtype": "$TEST_TRANSPORT", 00:22:21.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "$NVMF_PORT", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.264 "hdgst": ${hdgst:-false}, 00:22:21.264 "ddgst": ${ddgst:-false} 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 } 00:22:21.264 EOF 00:22:21.264 )") 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.264 19:20:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:21.264 { 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme$subsystem", 00:22:21.264 "trtype": "$TEST_TRANSPORT", 00:22:21.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "$NVMF_PORT", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:21.264 "hdgst": ${hdgst:-false}, 00:22:21.264 "ddgst": ${ddgst:-false} 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 } 00:22:21.264 EOF 00:22:21.264 )") 00:22:21.264 19:20:39 -- nvmf/common.sh@542 -- # cat 00:22:21.264 19:20:39 -- nvmf/common.sh@544 -- # jq . 00:22:21.264 19:20:39 -- nvmf/common.sh@545 -- # IFS=, 00:22:21.264 19:20:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme1", 00:22:21.264 "trtype": "tcp", 00:22:21.264 "traddr": "10.0.0.2", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "4420", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:21.264 "hdgst": false, 00:22:21.264 "ddgst": false 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 },{ 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme2", 00:22:21.264 "trtype": "tcp", 00:22:21.264 "traddr": "10.0.0.2", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "4420", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:21.264 "hdgst": false, 00:22:21.264 "ddgst": false 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 },{ 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme3", 00:22:21.264 "trtype": "tcp", 00:22:21.264 "traddr": "10.0.0.2", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "4420", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:21.264 "hdgst": false, 00:22:21.264 "ddgst": false 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 },{ 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme4", 00:22:21.264 "trtype": "tcp", 00:22:21.264 "traddr": "10.0.0.2", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "4420", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:21.264 "hdgst": false, 00:22:21.264 "ddgst": false 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 },{ 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme5", 00:22:21.264 "trtype": "tcp", 00:22:21.264 "traddr": "10.0.0.2", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "4420", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:21.264 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:21.264 "hdgst": false, 00:22:21.264 "ddgst": false 00:22:21.264 }, 00:22:21.264 "method": "bdev_nvme_attach_controller" 00:22:21.264 },{ 00:22:21.264 "params": { 00:22:21.264 "name": "Nvme6", 00:22:21.264 "trtype": "tcp", 00:22:21.264 "traddr": "10.0.0.2", 00:22:21.264 "adrfam": "ipv4", 00:22:21.264 "trsvcid": "4420", 00:22:21.264 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:21.265 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:21.265 "hdgst": false, 00:22:21.265 "ddgst": false 00:22:21.265 }, 00:22:21.265 "method": "bdev_nvme_attach_controller" 00:22:21.265 },{ 00:22:21.265 "params": { 00:22:21.265 "name": "Nvme7", 00:22:21.265 "trtype": "tcp", 00:22:21.265 "traddr": "10.0.0.2", 00:22:21.265 "adrfam": "ipv4", 00:22:21.265 "trsvcid": "4420", 00:22:21.265 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:21.265 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:21.265 "hdgst": false, 00:22:21.265 "ddgst": false 00:22:21.265 }, 00:22:21.265 "method": "bdev_nvme_attach_controller" 00:22:21.265 },{ 00:22:21.265 "params": { 00:22:21.265 "name": "Nvme8", 00:22:21.265 "trtype": "tcp", 00:22:21.265 "traddr": "10.0.0.2", 00:22:21.265 "adrfam": "ipv4", 00:22:21.265 "trsvcid": "4420", 00:22:21.265 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:21.265 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:21.265 "hdgst": false, 00:22:21.265 "ddgst": false 00:22:21.265 }, 00:22:21.265 "method": "bdev_nvme_attach_controller" 00:22:21.265 },{ 00:22:21.265 "params": { 00:22:21.265 "name": "Nvme9", 00:22:21.265 "trtype": "tcp", 00:22:21.265 "traddr": "10.0.0.2", 00:22:21.265 "adrfam": "ipv4", 00:22:21.265 "trsvcid": "4420", 00:22:21.265 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:21.265 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:21.265 "hdgst": false, 00:22:21.265 "ddgst": false 00:22:21.265 }, 00:22:21.265 "method": "bdev_nvme_attach_controller" 00:22:21.265 },{ 00:22:21.265 "params": { 00:22:21.265 "name": "Nvme10", 00:22:21.265 "trtype": "tcp", 00:22:21.265 "traddr": "10.0.0.2", 00:22:21.265 "adrfam": "ipv4", 00:22:21.265 "trsvcid": "4420", 00:22:21.265 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:21.265 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:21.265 "hdgst": false, 00:22:21.265 "ddgst": false 00:22:21.265 }, 00:22:21.265 "method": "bdev_nvme_attach_controller" 00:22:21.265 }' 00:22:21.265 [2024-11-18 19:20:39.774358] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:21.265 [2024-11-18 19:20:39.774432] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:21.265 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.265 [2024-11-18 19:20:39.838364] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:21.522 [2024-11-18 19:20:39.947017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:23.422 19:20:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:23.422 19:20:41 -- common/autotest_common.sh@862 -- # return 0 00:22:23.422 19:20:41 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:23.422 19:20:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:23.422 19:20:41 -- common/autotest_common.sh@10 -- # set +x 00:22:23.422 19:20:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:23.422 19:20:41 -- target/shutdown.sh@83 -- # kill -9 3505944 00:22:23.422 19:20:41 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:23.422 19:20:41 -- target/shutdown.sh@87 -- # sleep 1 00:22:23.990 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3505944 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:23.990 19:20:42 -- target/shutdown.sh@88 -- # kill -0 3505665 00:22:23.990 19:20:42 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:23.990 19:20:42 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:23.990 19:20:42 -- nvmf/common.sh@520 -- # config=() 00:22:23.990 19:20:42 -- nvmf/common.sh@520 -- # local subsystem config 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.990 }, 00:22:23.990 "method": "bdev_nvme_attach_controller" 00:22:23.990 } 00:22:23.990 EOF 00:22:23.990 )") 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.990 }, 00:22:23.990 "method": "bdev_nvme_attach_controller" 00:22:23.990 } 00:22:23.990 EOF 00:22:23.990 )") 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.990 }, 00:22:23.990 "method": "bdev_nvme_attach_controller" 00:22:23.990 } 00:22:23.990 EOF 00:22:23.990 )") 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.990 }, 00:22:23.990 "method": "bdev_nvme_attach_controller" 00:22:23.990 } 00:22:23.990 EOF 00:22:23.990 )") 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.990 }, 00:22:23.990 "method": "bdev_nvme_attach_controller" 00:22:23.990 } 00:22:23.990 EOF 00:22:23.990 )") 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.990 }, 00:22:23.990 "method": "bdev_nvme_attach_controller" 00:22:23.990 } 00:22:23.990 EOF 00:22:23.990 )") 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.990 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.990 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.990 { 00:22:23.990 "params": { 00:22:23.990 "name": "Nvme$subsystem", 00:22:23.990 "trtype": "$TEST_TRANSPORT", 00:22:23.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.990 "adrfam": "ipv4", 00:22:23.990 "trsvcid": "$NVMF_PORT", 00:22:23.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.990 "hdgst": ${hdgst:-false}, 00:22:23.990 "ddgst": ${ddgst:-false} 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 } 00:22:23.991 EOF 00:22:23.991 )") 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.991 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.991 { 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme$subsystem", 00:22:23.991 "trtype": "$TEST_TRANSPORT", 00:22:23.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "$NVMF_PORT", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.991 "hdgst": ${hdgst:-false}, 00:22:23.991 "ddgst": ${ddgst:-false} 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 } 00:22:23.991 EOF 00:22:23.991 )") 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.991 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.991 { 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme$subsystem", 00:22:23.991 "trtype": "$TEST_TRANSPORT", 00:22:23.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "$NVMF_PORT", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.991 "hdgst": ${hdgst:-false}, 00:22:23.991 "ddgst": ${ddgst:-false} 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 } 00:22:23.991 EOF 00:22:23.991 )") 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.991 19:20:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.991 { 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme$subsystem", 00:22:23.991 "trtype": "$TEST_TRANSPORT", 00:22:23.991 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "$NVMF_PORT", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.991 "hdgst": ${hdgst:-false}, 00:22:23.991 "ddgst": ${ddgst:-false} 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 } 00:22:23.991 EOF 00:22:23.991 )") 00:22:23.991 19:20:42 -- nvmf/common.sh@542 -- # cat 00:22:23.991 19:20:42 -- nvmf/common.sh@544 -- # jq . 00:22:23.991 19:20:42 -- nvmf/common.sh@545 -- # IFS=, 00:22:23.991 19:20:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme1", 00:22:23.991 "trtype": "tcp", 00:22:23.991 "traddr": "10.0.0.2", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "4420", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:23.991 "hdgst": false, 00:22:23.991 "ddgst": false 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 },{ 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme2", 00:22:23.991 "trtype": "tcp", 00:22:23.991 "traddr": "10.0.0.2", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "4420", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:23.991 "hdgst": false, 00:22:23.991 "ddgst": false 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 },{ 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme3", 00:22:23.991 "trtype": "tcp", 00:22:23.991 "traddr": "10.0.0.2", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "4420", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:23.991 "hdgst": false, 00:22:23.991 "ddgst": false 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 },{ 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme4", 00:22:23.991 "trtype": "tcp", 00:22:23.991 "traddr": "10.0.0.2", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "4420", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:23.991 "hdgst": false, 00:22:23.991 "ddgst": false 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 },{ 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme5", 00:22:23.991 "trtype": "tcp", 00:22:23.991 "traddr": "10.0.0.2", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "4420", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:23.991 "hdgst": false, 00:22:23.991 "ddgst": false 00:22:23.991 }, 00:22:23.991 "method": "bdev_nvme_attach_controller" 00:22:23.991 },{ 00:22:23.991 "params": { 00:22:23.991 "name": "Nvme6", 00:22:23.991 "trtype": "tcp", 00:22:23.991 "traddr": "10.0.0.2", 00:22:23.991 "adrfam": "ipv4", 00:22:23.991 "trsvcid": "4420", 00:22:23.991 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:23.991 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:23.991 "hdgst": false, 00:22:23.992 "ddgst": false 00:22:23.992 }, 00:22:23.992 "method": "bdev_nvme_attach_controller" 00:22:23.992 },{ 00:22:23.992 "params": { 00:22:23.992 "name": "Nvme7", 00:22:23.992 "trtype": "tcp", 00:22:23.992 "traddr": "10.0.0.2", 00:22:23.992 "adrfam": "ipv4", 00:22:23.992 "trsvcid": "4420", 00:22:23.992 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:23.992 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:23.992 "hdgst": false, 00:22:23.992 "ddgst": false 00:22:23.992 }, 00:22:23.992 "method": "bdev_nvme_attach_controller" 00:22:23.992 },{ 00:22:23.992 "params": { 00:22:23.992 "name": "Nvme8", 00:22:23.992 "trtype": "tcp", 00:22:23.992 "traddr": "10.0.0.2", 00:22:23.992 "adrfam": "ipv4", 00:22:23.992 "trsvcid": "4420", 00:22:23.992 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:23.992 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:23.992 "hdgst": false, 00:22:23.992 "ddgst": false 00:22:23.992 }, 00:22:23.992 "method": "bdev_nvme_attach_controller" 00:22:23.992 },{ 00:22:23.992 "params": { 00:22:23.992 "name": "Nvme9", 00:22:23.992 "trtype": "tcp", 00:22:23.992 "traddr": "10.0.0.2", 00:22:23.992 "adrfam": "ipv4", 00:22:23.992 "trsvcid": "4420", 00:22:23.992 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:23.992 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:23.992 "hdgst": false, 00:22:23.992 "ddgst": false 00:22:23.992 }, 00:22:23.992 "method": "bdev_nvme_attach_controller" 00:22:23.992 },{ 00:22:23.992 "params": { 00:22:23.992 "name": "Nvme10", 00:22:23.992 "trtype": "tcp", 00:22:23.992 "traddr": "10.0.0.2", 00:22:23.992 "adrfam": "ipv4", 00:22:23.992 "trsvcid": "4420", 00:22:23.992 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:23.992 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:23.992 "hdgst": false, 00:22:23.992 "ddgst": false 00:22:23.992 }, 00:22:23.992 "method": "bdev_nvme_attach_controller" 00:22:23.992 }' 00:22:23.992 [2024-11-18 19:20:42.559113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:23.992 [2024-11-18 19:20:42.559191] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3506293 ] 00:22:23.992 EAL: No free 2048 kB hugepages reported on node 1 00:22:24.257 [2024-11-18 19:20:42.623432] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:24.257 [2024-11-18 19:20:42.734140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:25.706 Running I/O for 1 seconds... 00:22:27.081 00:22:27.081 Latency(us) 00:22:27.081 [2024-11-18T18:20:45.686Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme1n1 : 1.06 374.19 23.39 0.00 0.00 165332.70 53205.52 137479.96 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme2n1 : 1.10 393.00 24.56 0.00 0.00 158912.22 18641.35 125829.12 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme3n1 : 1.10 394.47 24.65 0.00 0.00 157302.62 17476.27 119615.34 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme4n1 : 1.11 392.02 24.50 0.00 0.00 157023.65 19029.71 124275.67 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme5n1 : 1.11 390.81 24.43 0.00 0.00 156336.86 19515.16 120392.06 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme6n1 : 1.11 389.68 24.36 0.00 0.00 156144.92 15728.64 122722.23 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme7n1 : 1.12 388.95 24.31 0.00 0.00 155587.43 13592.65 125829.12 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme8n1 : 1.12 387.64 24.23 0.00 0.00 154986.35 5655.51 127382.57 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme9n1 : 1.09 363.85 22.74 0.00 0.00 162537.09 31457.28 128936.01 00:22:27.081 [2024-11-18T18:20:45.686Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:27.081 Verification LBA range: start 0x0 length 0x400 00:22:27.081 Nvme10n1 : 1.13 385.70 24.11 0.00 0.00 154259.12 4684.61 131266.18 00:22:27.081 [2024-11-18T18:20:45.686Z] =================================================================================================================== 00:22:27.081 [2024-11-18T18:20:45.686Z] Total : 3860.32 241.27 0.00 0.00 157739.51 4684.61 137479.96 00:22:27.081 19:20:45 -- target/shutdown.sh@93 -- # stoptarget 00:22:27.081 19:20:45 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:27.081 19:20:45 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:27.081 19:20:45 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:27.081 19:20:45 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:27.081 19:20:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:27.081 19:20:45 -- nvmf/common.sh@116 -- # sync 00:22:27.081 19:20:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:27.081 19:20:45 -- nvmf/common.sh@119 -- # set +e 00:22:27.081 19:20:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:27.081 19:20:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:27.081 rmmod nvme_tcp 00:22:27.081 rmmod nvme_fabrics 00:22:27.081 rmmod nvme_keyring 00:22:27.081 19:20:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:27.081 19:20:45 -- nvmf/common.sh@123 -- # set -e 00:22:27.081 19:20:45 -- nvmf/common.sh@124 -- # return 0 00:22:27.081 19:20:45 -- nvmf/common.sh@477 -- # '[' -n 3505665 ']' 00:22:27.081 19:20:45 -- nvmf/common.sh@478 -- # killprocess 3505665 00:22:27.081 19:20:45 -- common/autotest_common.sh@936 -- # '[' -z 3505665 ']' 00:22:27.081 19:20:45 -- common/autotest_common.sh@940 -- # kill -0 3505665 00:22:27.081 19:20:45 -- common/autotest_common.sh@941 -- # uname 00:22:27.081 19:20:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:27.081 19:20:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3505665 00:22:27.081 19:20:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:27.081 19:20:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:27.081 19:20:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3505665' 00:22:27.081 killing process with pid 3505665 00:22:27.081 19:20:45 -- common/autotest_common.sh@955 -- # kill 3505665 00:22:27.081 19:20:45 -- common/autotest_common.sh@960 -- # wait 3505665 00:22:27.648 19:20:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:27.648 19:20:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:27.648 19:20:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:27.648 19:20:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:27.648 19:20:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:27.648 19:20:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:27.648 19:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:27.648 19:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.192 19:20:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:30.192 00:22:30.192 real 0m12.365s 00:22:30.192 user 0m36.018s 00:22:30.192 sys 0m3.362s 00:22:30.192 19:20:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:30.192 19:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:30.192 ************************************ 00:22:30.192 END TEST nvmf_shutdown_tc1 00:22:30.192 ************************************ 00:22:30.192 19:20:48 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:30.192 19:20:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:30.192 19:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:30.192 19:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:30.192 ************************************ 00:22:30.192 START TEST nvmf_shutdown_tc2 00:22:30.192 ************************************ 00:22:30.192 19:20:48 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:30.192 19:20:48 -- target/shutdown.sh@98 -- # starttarget 00:22:30.192 19:20:48 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:30.192 19:20:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:30.192 19:20:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:30.192 19:20:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:30.192 19:20:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:30.192 19:20:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:30.192 19:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:30.192 19:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:30.193 19:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:30.193 19:20:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:30.193 19:20:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:30.193 19:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:30.193 19:20:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:30.193 19:20:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:30.193 19:20:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:30.193 19:20:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:30.193 19:20:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:30.193 19:20:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:30.193 19:20:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:30.193 19:20:48 -- nvmf/common.sh@294 -- # net_devs=() 00:22:30.193 19:20:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:30.193 19:20:48 -- nvmf/common.sh@295 -- # e810=() 00:22:30.193 19:20:48 -- nvmf/common.sh@295 -- # local -ga e810 00:22:30.193 19:20:48 -- nvmf/common.sh@296 -- # x722=() 00:22:30.193 19:20:48 -- nvmf/common.sh@296 -- # local -ga x722 00:22:30.193 19:20:48 -- nvmf/common.sh@297 -- # mlx=() 00:22:30.193 19:20:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:30.193 19:20:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:30.193 19:20:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:30.193 19:20:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:30.193 19:20:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:30.193 19:20:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:30.193 19:20:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:30.193 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:30.193 19:20:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:30.193 19:20:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:30.193 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:30.193 19:20:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:30.193 19:20:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:30.193 19:20:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:30.193 19:20:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:30.193 19:20:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:30.193 19:20:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:30.193 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:30.193 19:20:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:30.193 19:20:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:30.193 19:20:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:30.193 19:20:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:30.193 19:20:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:30.193 19:20:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:30.193 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:30.193 19:20:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:30.193 19:20:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:30.193 19:20:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:30.193 19:20:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:30.193 19:20:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:30.193 19:20:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:30.193 19:20:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:30.193 19:20:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:30.193 19:20:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:30.193 19:20:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:30.193 19:20:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:30.193 19:20:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:30.193 19:20:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:30.193 19:20:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:30.193 19:20:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:30.193 19:20:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:30.193 19:20:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:30.193 19:20:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:30.193 19:20:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:30.193 19:20:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:30.193 19:20:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:30.193 19:20:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:30.193 19:20:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:30.193 19:20:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:30.193 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:30.193 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:22:30.193 00:22:30.193 --- 10.0.0.2 ping statistics --- 00:22:30.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:30.193 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:22:30.193 19:20:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:30.193 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:30.193 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:22:30.193 00:22:30.193 --- 10.0.0.1 ping statistics --- 00:22:30.193 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:30.193 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:22:30.193 19:20:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:30.193 19:20:48 -- nvmf/common.sh@410 -- # return 0 00:22:30.193 19:20:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:30.193 19:20:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:30.193 19:20:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:30.193 19:20:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:30.193 19:20:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:30.193 19:20:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:30.193 19:20:48 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:30.193 19:20:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:30.193 19:20:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:30.193 19:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:30.193 19:20:48 -- nvmf/common.sh@469 -- # nvmfpid=3507083 00:22:30.193 19:20:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:30.193 19:20:48 -- nvmf/common.sh@470 -- # waitforlisten 3507083 00:22:30.193 19:20:48 -- common/autotest_common.sh@829 -- # '[' -z 3507083 ']' 00:22:30.193 19:20:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:30.193 19:20:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.193 19:20:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:30.193 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:30.193 19:20:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.193 19:20:48 -- common/autotest_common.sh@10 -- # set +x 00:22:30.193 [2024-11-18 19:20:48.590048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.193 [2024-11-18 19:20:48.590144] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:30.193 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.193 [2024-11-18 19:20:48.655762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:30.193 [2024-11-18 19:20:48.769269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:30.193 [2024-11-18 19:20:48.769424] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:30.193 [2024-11-18 19:20:48.769442] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:30.193 [2024-11-18 19:20:48.769455] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:30.193 [2024-11-18 19:20:48.769753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:30.193 [2024-11-18 19:20:48.769805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:30.193 [2024-11-18 19:20:48.769828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:30.193 [2024-11-18 19:20:48.769833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:31.128 19:20:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:31.128 19:20:49 -- common/autotest_common.sh@862 -- # return 0 00:22:31.128 19:20:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:31.128 19:20:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:31.128 19:20:49 -- common/autotest_common.sh@10 -- # set +x 00:22:31.128 19:20:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:31.128 19:20:49 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:31.128 19:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.128 19:20:49 -- common/autotest_common.sh@10 -- # set +x 00:22:31.128 [2024-11-18 19:20:49.607302] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:31.128 19:20:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.128 19:20:49 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:31.128 19:20:49 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:31.128 19:20:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:31.128 19:20:49 -- common/autotest_common.sh@10 -- # set +x 00:22:31.128 19:20:49 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:31.128 19:20:49 -- target/shutdown.sh@28 -- # cat 00:22:31.128 19:20:49 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:31.128 19:20:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:31.128 19:20:49 -- common/autotest_common.sh@10 -- # set +x 00:22:31.128 Malloc1 00:22:31.128 [2024-11-18 19:20:49.696621] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:31.128 Malloc2 00:22:31.387 Malloc3 00:22:31.387 Malloc4 00:22:31.387 Malloc5 00:22:31.387 Malloc6 00:22:31.387 Malloc7 00:22:31.647 Malloc8 00:22:31.647 Malloc9 00:22:31.647 Malloc10 00:22:31.647 19:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:31.647 19:20:50 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:31.647 19:20:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:31.647 19:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:31.647 19:20:50 -- target/shutdown.sh@102 -- # perfpid=3507391 00:22:31.647 19:20:50 -- target/shutdown.sh@103 -- # waitforlisten 3507391 /var/tmp/bdevperf.sock 00:22:31.647 19:20:50 -- common/autotest_common.sh@829 -- # '[' -z 3507391 ']' 00:22:31.647 19:20:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:31.647 19:20:50 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:31.647 19:20:50 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:31.647 19:20:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:31.647 19:20:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:31.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:31.647 19:20:50 -- nvmf/common.sh@520 -- # config=() 00:22:31.647 19:20:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:31.647 19:20:50 -- nvmf/common.sh@520 -- # local subsystem config 00:22:31.647 19:20:50 -- common/autotest_common.sh@10 -- # set +x 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.647 "ddgst": ${ddgst:-false} 00:22:31.647 }, 00:22:31.647 "method": "bdev_nvme_attach_controller" 00:22:31.647 } 00:22:31.647 EOF 00:22:31.647 )") 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.647 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.647 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.647 { 00:22:31.647 "params": { 00:22:31.647 "name": "Nvme$subsystem", 00:22:31.647 "trtype": "$TEST_TRANSPORT", 00:22:31.647 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.647 "adrfam": "ipv4", 00:22:31.647 "trsvcid": "$NVMF_PORT", 00:22:31.647 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.647 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.647 "hdgst": ${hdgst:-false}, 00:22:31.648 "ddgst": ${ddgst:-false} 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 } 00:22:31.648 EOF 00:22:31.648 )") 00:22:31.648 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.648 19:20:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.648 19:20:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.648 { 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme$subsystem", 00:22:31.648 "trtype": "$TEST_TRANSPORT", 00:22:31.648 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "$NVMF_PORT", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.648 "hdgst": ${hdgst:-false}, 00:22:31.648 "ddgst": ${ddgst:-false} 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 } 00:22:31.648 EOF 00:22:31.648 )") 00:22:31.648 19:20:50 -- nvmf/common.sh@542 -- # cat 00:22:31.648 19:20:50 -- nvmf/common.sh@544 -- # jq . 00:22:31.648 19:20:50 -- nvmf/common.sh@545 -- # IFS=, 00:22:31.648 19:20:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme1", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme2", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme3", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme4", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme5", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme6", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme7", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme8", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme9", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 },{ 00:22:31.648 "params": { 00:22:31.648 "name": "Nvme10", 00:22:31.648 "trtype": "tcp", 00:22:31.648 "traddr": "10.0.0.2", 00:22:31.648 "adrfam": "ipv4", 00:22:31.648 "trsvcid": "4420", 00:22:31.648 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:31.648 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:31.648 "hdgst": false, 00:22:31.648 "ddgst": false 00:22:31.648 }, 00:22:31.648 "method": "bdev_nvme_attach_controller" 00:22:31.648 }' 00:22:31.648 [2024-11-18 19:20:50.213507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.648 [2024-11-18 19:20:50.213578] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3507391 ] 00:22:31.648 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.906 [2024-11-18 19:20:50.277400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:31.907 [2024-11-18 19:20:50.386763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.806 Running I/O for 10 seconds... 00:22:34.373 19:20:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:34.373 19:20:52 -- common/autotest_common.sh@862 -- # return 0 00:22:34.373 19:20:52 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:34.373 19:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.373 19:20:52 -- common/autotest_common.sh@10 -- # set +x 00:22:34.373 19:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.373 19:20:52 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:34.373 19:20:52 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:34.373 19:20:52 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:34.373 19:20:52 -- target/shutdown.sh@57 -- # local ret=1 00:22:34.373 19:20:52 -- target/shutdown.sh@58 -- # local i 00:22:34.373 19:20:52 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:34.373 19:20:52 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:34.373 19:20:52 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:34.373 19:20:52 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:34.373 19:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:34.373 19:20:52 -- common/autotest_common.sh@10 -- # set +x 00:22:34.373 19:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:34.373 19:20:52 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:34.373 19:20:52 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:34.373 19:20:52 -- target/shutdown.sh@64 -- # ret=0 00:22:34.373 19:20:52 -- target/shutdown.sh@65 -- # break 00:22:34.373 19:20:52 -- target/shutdown.sh@69 -- # return 0 00:22:34.373 19:20:52 -- target/shutdown.sh@109 -- # killprocess 3507391 00:22:34.373 19:20:52 -- common/autotest_common.sh@936 -- # '[' -z 3507391 ']' 00:22:34.373 19:20:52 -- common/autotest_common.sh@940 -- # kill -0 3507391 00:22:34.373 19:20:52 -- common/autotest_common.sh@941 -- # uname 00:22:34.373 19:20:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:34.373 19:20:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3507391 00:22:34.373 19:20:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:34.373 19:20:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:34.373 19:20:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3507391' 00:22:34.373 killing process with pid 3507391 00:22:34.373 19:20:52 -- common/autotest_common.sh@955 -- # kill 3507391 00:22:34.373 19:20:52 -- common/autotest_common.sh@960 -- # wait 3507391 00:22:34.373 Received shutdown signal, test time was about 0.559503 seconds 00:22:34.373 00:22:34.373 Latency(us) 00:22:34.373 [2024-11-18T18:20:52.978Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme1n1 : 0.54 421.12 26.32 0.00 0.00 145976.22 20291.89 120392.06 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme2n1 : 0.56 408.11 25.51 0.00 0.00 148868.92 21262.79 152237.70 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme3n1 : 0.54 420.03 26.25 0.00 0.00 142198.64 24369.68 119615.34 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme4n1 : 0.54 419.01 26.19 0.00 0.00 140461.23 23495.87 118838.61 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme5n1 : 0.55 415.21 25.95 0.00 0.00 139193.52 26991.12 115731.72 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme6n1 : 0.53 357.78 22.36 0.00 0.00 158049.84 33010.73 132819.63 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme7n1 : 0.55 414.15 25.88 0.00 0.00 135470.02 26991.12 115731.72 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme8n1 : 0.55 411.49 25.72 0.00 0.00 134356.04 25631.86 116508.44 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme9n1 : 0.56 409.85 25.62 0.00 0.00 133650.86 23495.87 119615.34 00:22:34.373 [2024-11-18T18:20:52.978Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:34.373 Verification LBA range: start 0x0 length 0x400 00:22:34.373 Nvme10n1 : 0.55 350.79 21.92 0.00 0.00 150208.66 11845.03 125829.12 00:22:34.373 [2024-11-18T18:20:52.978Z] =================================================================================================================== 00:22:34.373 [2024-11-18T18:20:52.978Z] Total : 4027.55 251.72 0.00 0.00 142461.26 11845.03 152237.70 00:22:34.632 19:20:53 -- target/shutdown.sh@112 -- # sleep 1 00:22:35.565 19:20:54 -- target/shutdown.sh@113 -- # kill -0 3507083 00:22:35.565 19:20:54 -- target/shutdown.sh@115 -- # stoptarget 00:22:35.565 19:20:54 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:35.565 19:20:54 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:35.565 19:20:54 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:35.565 19:20:54 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:35.565 19:20:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:35.565 19:20:54 -- nvmf/common.sh@116 -- # sync 00:22:35.565 19:20:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:35.565 19:20:54 -- nvmf/common.sh@119 -- # set +e 00:22:35.565 19:20:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:35.565 19:20:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:35.565 rmmod nvme_tcp 00:22:35.823 rmmod nvme_fabrics 00:22:35.823 rmmod nvme_keyring 00:22:35.823 19:20:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:35.823 19:20:54 -- nvmf/common.sh@123 -- # set -e 00:22:35.823 19:20:54 -- nvmf/common.sh@124 -- # return 0 00:22:35.823 19:20:54 -- nvmf/common.sh@477 -- # '[' -n 3507083 ']' 00:22:35.823 19:20:54 -- nvmf/common.sh@478 -- # killprocess 3507083 00:22:35.823 19:20:54 -- common/autotest_common.sh@936 -- # '[' -z 3507083 ']' 00:22:35.823 19:20:54 -- common/autotest_common.sh@940 -- # kill -0 3507083 00:22:35.823 19:20:54 -- common/autotest_common.sh@941 -- # uname 00:22:35.823 19:20:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:35.823 19:20:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3507083 00:22:35.823 19:20:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:35.823 19:20:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:35.823 19:20:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3507083' 00:22:35.823 killing process with pid 3507083 00:22:35.823 19:20:54 -- common/autotest_common.sh@955 -- # kill 3507083 00:22:35.823 19:20:54 -- common/autotest_common.sh@960 -- # wait 3507083 00:22:36.390 19:20:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:36.390 19:20:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:36.390 19:20:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:36.390 19:20:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:36.390 19:20:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:36.390 19:20:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.390 19:20:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.390 19:20:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.292 19:20:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:38.292 00:22:38.292 real 0m8.584s 00:22:38.292 user 0m26.977s 00:22:38.292 sys 0m1.500s 00:22:38.292 19:20:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:38.292 19:20:56 -- common/autotest_common.sh@10 -- # set +x 00:22:38.292 ************************************ 00:22:38.292 END TEST nvmf_shutdown_tc2 00:22:38.292 ************************************ 00:22:38.292 19:20:56 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:38.292 19:20:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:38.292 19:20:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:38.292 19:20:56 -- common/autotest_common.sh@10 -- # set +x 00:22:38.292 ************************************ 00:22:38.292 START TEST nvmf_shutdown_tc3 00:22:38.292 ************************************ 00:22:38.292 19:20:56 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:38.292 19:20:56 -- target/shutdown.sh@120 -- # starttarget 00:22:38.292 19:20:56 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:38.292 19:20:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:38.292 19:20:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:38.292 19:20:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:38.292 19:20:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:38.292 19:20:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:38.292 19:20:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.292 19:20:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:38.292 19:20:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.292 19:20:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:38.292 19:20:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:38.292 19:20:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:38.292 19:20:56 -- common/autotest_common.sh@10 -- # set +x 00:22:38.292 19:20:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:38.292 19:20:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:38.292 19:20:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:38.292 19:20:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:38.293 19:20:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:38.293 19:20:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:38.293 19:20:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:38.293 19:20:56 -- nvmf/common.sh@294 -- # net_devs=() 00:22:38.293 19:20:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:38.293 19:20:56 -- nvmf/common.sh@295 -- # e810=() 00:22:38.293 19:20:56 -- nvmf/common.sh@295 -- # local -ga e810 00:22:38.293 19:20:56 -- nvmf/common.sh@296 -- # x722=() 00:22:38.293 19:20:56 -- nvmf/common.sh@296 -- # local -ga x722 00:22:38.293 19:20:56 -- nvmf/common.sh@297 -- # mlx=() 00:22:38.293 19:20:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:38.293 19:20:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:38.293 19:20:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:38.293 19:20:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:38.293 19:20:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:38.293 19:20:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.293 19:20:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:38.293 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:38.293 19:20:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:38.293 19:20:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:38.293 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:38.293 19:20:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:38.293 19:20:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.293 19:20:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.293 19:20:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.293 19:20:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.293 19:20:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:38.293 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:38.293 19:20:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.293 19:20:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:38.293 19:20:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:38.293 19:20:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:38.293 19:20:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:38.293 19:20:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:38.293 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:38.293 19:20:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:38.293 19:20:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:38.293 19:20:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:38.293 19:20:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:38.293 19:20:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:38.293 19:20:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:38.293 19:20:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:38.293 19:20:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:38.293 19:20:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:38.293 19:20:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:38.293 19:20:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:38.293 19:20:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:38.293 19:20:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:38.293 19:20:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:38.293 19:20:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:38.293 19:20:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:38.552 19:20:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:38.552 19:20:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:38.552 19:20:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:38.552 19:20:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:38.552 19:20:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:38.552 19:20:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:38.552 19:20:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:38.552 19:20:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:38.552 19:20:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:38.552 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:38.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:22:38.552 00:22:38.552 --- 10.0.0.2 ping statistics --- 00:22:38.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.552 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:22:38.552 19:20:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:38.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:38.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:22:38.552 00:22:38.552 --- 10.0.0.1 ping statistics --- 00:22:38.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:38.552 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:22:38.552 19:20:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:38.552 19:20:57 -- nvmf/common.sh@410 -- # return 0 00:22:38.552 19:20:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:38.552 19:20:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:38.552 19:20:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:38.552 19:20:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:38.552 19:20:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:38.552 19:20:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:38.552 19:20:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:38.552 19:20:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:38.552 19:20:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:38.552 19:20:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.552 19:20:57 -- common/autotest_common.sh@10 -- # set +x 00:22:38.552 19:20:57 -- nvmf/common.sh@469 -- # nvmfpid=3508327 00:22:38.552 19:20:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:38.552 19:20:57 -- nvmf/common.sh@470 -- # waitforlisten 3508327 00:22:38.552 19:20:57 -- common/autotest_common.sh@829 -- # '[' -z 3508327 ']' 00:22:38.552 19:20:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:38.552 19:20:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.552 19:20:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:38.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:38.552 19:20:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.552 19:20:57 -- common/autotest_common.sh@10 -- # set +x 00:22:38.552 [2024-11-18 19:20:57.088188] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.552 [2024-11-18 19:20:57.088259] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:38.552 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.552 [2024-11-18 19:20:57.150515] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:38.811 [2024-11-18 19:20:57.257115] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:38.811 [2024-11-18 19:20:57.257262] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:38.811 [2024-11-18 19:20:57.257279] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:38.811 [2024-11-18 19:20:57.257292] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:38.811 [2024-11-18 19:20:57.257384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:38.811 [2024-11-18 19:20:57.257429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:38.811 [2024-11-18 19:20:57.257490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:38.811 [2024-11-18 19:20:57.257492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:39.746 19:20:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:39.746 19:20:58 -- common/autotest_common.sh@862 -- # return 0 00:22:39.746 19:20:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:39.746 19:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:39.746 19:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:39.746 19:20:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:39.746 19:20:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:39.746 19:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.746 19:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:39.746 [2024-11-18 19:20:58.104329] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:39.746 19:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.746 19:20:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:39.746 19:20:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:39.746 19:20:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:39.746 19:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:39.746 19:20:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:39.746 19:20:58 -- target/shutdown.sh@28 -- # cat 00:22:39.746 19:20:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:39.746 19:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.746 19:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:39.746 Malloc1 00:22:39.746 [2024-11-18 19:20:58.194109] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:39.746 Malloc2 00:22:39.746 Malloc3 00:22:39.746 Malloc4 00:22:40.005 Malloc5 00:22:40.005 Malloc6 00:22:40.005 Malloc7 00:22:40.005 Malloc8 00:22:40.005 Malloc9 00:22:40.264 Malloc10 00:22:40.264 19:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:40.264 19:20:58 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:40.264 19:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:40.264 19:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:40.264 19:20:58 -- target/shutdown.sh@124 -- # perfpid=3508521 00:22:40.264 19:20:58 -- target/shutdown.sh@125 -- # waitforlisten 3508521 /var/tmp/bdevperf.sock 00:22:40.264 19:20:58 -- common/autotest_common.sh@829 -- # '[' -z 3508521 ']' 00:22:40.264 19:20:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:40.264 19:20:58 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:40.264 19:20:58 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:40.264 19:20:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:40.264 19:20:58 -- nvmf/common.sh@520 -- # config=() 00:22:40.264 19:20:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:40.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:40.264 19:20:58 -- nvmf/common.sh@520 -- # local subsystem config 00:22:40.264 19:20:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.264 19:20:58 -- common/autotest_common.sh@10 -- # set +x 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.264 { 00:22:40.264 "params": { 00:22:40.264 "name": "Nvme$subsystem", 00:22:40.264 "trtype": "$TEST_TRANSPORT", 00:22:40.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.264 "adrfam": "ipv4", 00:22:40.264 "trsvcid": "$NVMF_PORT", 00:22:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.264 "hdgst": ${hdgst:-false}, 00:22:40.264 "ddgst": ${ddgst:-false} 00:22:40.264 }, 00:22:40.264 "method": "bdev_nvme_attach_controller" 00:22:40.264 } 00:22:40.264 EOF 00:22:40.264 )") 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.264 { 00:22:40.264 "params": { 00:22:40.264 "name": "Nvme$subsystem", 00:22:40.264 "trtype": "$TEST_TRANSPORT", 00:22:40.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.264 "adrfam": "ipv4", 00:22:40.264 "trsvcid": "$NVMF_PORT", 00:22:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.264 "hdgst": ${hdgst:-false}, 00:22:40.264 "ddgst": ${ddgst:-false} 00:22:40.264 }, 00:22:40.264 "method": "bdev_nvme_attach_controller" 00:22:40.264 } 00:22:40.264 EOF 00:22:40.264 )") 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.264 { 00:22:40.264 "params": { 00:22:40.264 "name": "Nvme$subsystem", 00:22:40.264 "trtype": "$TEST_TRANSPORT", 00:22:40.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.264 "adrfam": "ipv4", 00:22:40.264 "trsvcid": "$NVMF_PORT", 00:22:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.264 "hdgst": ${hdgst:-false}, 00:22:40.264 "ddgst": ${ddgst:-false} 00:22:40.264 }, 00:22:40.264 "method": "bdev_nvme_attach_controller" 00:22:40.264 } 00:22:40.264 EOF 00:22:40.264 )") 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.264 { 00:22:40.264 "params": { 00:22:40.264 "name": "Nvme$subsystem", 00:22:40.264 "trtype": "$TEST_TRANSPORT", 00:22:40.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.264 "adrfam": "ipv4", 00:22:40.264 "trsvcid": "$NVMF_PORT", 00:22:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.264 "hdgst": ${hdgst:-false}, 00:22:40.264 "ddgst": ${ddgst:-false} 00:22:40.264 }, 00:22:40.264 "method": "bdev_nvme_attach_controller" 00:22:40.264 } 00:22:40.264 EOF 00:22:40.264 )") 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.264 { 00:22:40.264 "params": { 00:22:40.264 "name": "Nvme$subsystem", 00:22:40.264 "trtype": "$TEST_TRANSPORT", 00:22:40.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.264 "adrfam": "ipv4", 00:22:40.264 "trsvcid": "$NVMF_PORT", 00:22:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.264 "hdgst": ${hdgst:-false}, 00:22:40.264 "ddgst": ${ddgst:-false} 00:22:40.264 }, 00:22:40.264 "method": "bdev_nvme_attach_controller" 00:22:40.264 } 00:22:40.264 EOF 00:22:40.264 )") 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.264 { 00:22:40.264 "params": { 00:22:40.264 "name": "Nvme$subsystem", 00:22:40.264 "trtype": "$TEST_TRANSPORT", 00:22:40.264 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.264 "adrfam": "ipv4", 00:22:40.264 "trsvcid": "$NVMF_PORT", 00:22:40.264 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.264 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.264 "hdgst": ${hdgst:-false}, 00:22:40.264 "ddgst": ${ddgst:-false} 00:22:40.264 }, 00:22:40.264 "method": "bdev_nvme_attach_controller" 00:22:40.264 } 00:22:40.264 EOF 00:22:40.264 )") 00:22:40.264 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.264 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.265 { 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme$subsystem", 00:22:40.265 "trtype": "$TEST_TRANSPORT", 00:22:40.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "$NVMF_PORT", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.265 "hdgst": ${hdgst:-false}, 00:22:40.265 "ddgst": ${ddgst:-false} 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 } 00:22:40.265 EOF 00:22:40.265 )") 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.265 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.265 { 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme$subsystem", 00:22:40.265 "trtype": "$TEST_TRANSPORT", 00:22:40.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "$NVMF_PORT", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.265 "hdgst": ${hdgst:-false}, 00:22:40.265 "ddgst": ${ddgst:-false} 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 } 00:22:40.265 EOF 00:22:40.265 )") 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.265 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.265 { 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme$subsystem", 00:22:40.265 "trtype": "$TEST_TRANSPORT", 00:22:40.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "$NVMF_PORT", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.265 "hdgst": ${hdgst:-false}, 00:22:40.265 "ddgst": ${ddgst:-false} 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 } 00:22:40.265 EOF 00:22:40.265 )") 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.265 19:20:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:40.265 { 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme$subsystem", 00:22:40.265 "trtype": "$TEST_TRANSPORT", 00:22:40.265 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "$NVMF_PORT", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:40.265 "hdgst": ${hdgst:-false}, 00:22:40.265 "ddgst": ${ddgst:-false} 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 } 00:22:40.265 EOF 00:22:40.265 )") 00:22:40.265 19:20:58 -- nvmf/common.sh@542 -- # cat 00:22:40.265 19:20:58 -- nvmf/common.sh@544 -- # jq . 00:22:40.265 19:20:58 -- nvmf/common.sh@545 -- # IFS=, 00:22:40.265 19:20:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme1", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme2", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme3", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme4", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme5", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme6", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme7", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme8", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme9", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 },{ 00:22:40.265 "params": { 00:22:40.265 "name": "Nvme10", 00:22:40.265 "trtype": "tcp", 00:22:40.265 "traddr": "10.0.0.2", 00:22:40.265 "adrfam": "ipv4", 00:22:40.265 "trsvcid": "4420", 00:22:40.265 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:40.265 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:40.265 "hdgst": false, 00:22:40.265 "ddgst": false 00:22:40.265 }, 00:22:40.265 "method": "bdev_nvme_attach_controller" 00:22:40.265 }' 00:22:40.265 [2024-11-18 19:20:58.706225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:40.265 [2024-11-18 19:20:58.706295] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3508521 ] 00:22:40.265 EAL: No free 2048 kB hugepages reported on node 1 00:22:40.265 [2024-11-18 19:20:58.767995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:40.524 [2024-11-18 19:20:58.877089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:41.898 Running I/O for 10 seconds... 00:22:42.852 19:21:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:42.852 19:21:01 -- common/autotest_common.sh@862 -- # return 0 00:22:42.852 19:21:01 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:42.853 19:21:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.853 19:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:42.853 19:21:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.853 19:21:01 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:42.853 19:21:01 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:42.853 19:21:01 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:42.853 19:21:01 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:42.853 19:21:01 -- target/shutdown.sh@57 -- # local ret=1 00:22:42.853 19:21:01 -- target/shutdown.sh@58 -- # local i 00:22:42.853 19:21:01 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:42.853 19:21:01 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:42.853 19:21:01 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:42.853 19:21:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:42.853 19:21:01 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:42.853 19:21:01 -- common/autotest_common.sh@10 -- # set +x 00:22:42.853 19:21:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:42.853 19:21:01 -- target/shutdown.sh@60 -- # read_io_count=257 00:22:42.853 19:21:01 -- target/shutdown.sh@63 -- # '[' 257 -ge 100 ']' 00:22:42.853 19:21:01 -- target/shutdown.sh@64 -- # ret=0 00:22:42.853 19:21:01 -- target/shutdown.sh@65 -- # break 00:22:42.853 19:21:01 -- target/shutdown.sh@69 -- # return 0 00:22:42.853 19:21:01 -- target/shutdown.sh@134 -- # killprocess 3508327 00:22:42.853 19:21:01 -- common/autotest_common.sh@936 -- # '[' -z 3508327 ']' 00:22:42.853 19:21:01 -- common/autotest_common.sh@940 -- # kill -0 3508327 00:22:42.853 19:21:01 -- common/autotest_common.sh@941 -- # uname 00:22:42.853 19:21:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:42.853 19:21:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3508327 00:22:42.853 19:21:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:42.853 19:21:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:42.853 19:21:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3508327' 00:22:42.853 killing process with pid 3508327 00:22:42.853 19:21:01 -- common/autotest_common.sh@955 -- # kill 3508327 00:22:42.853 19:21:01 -- common/autotest_common.sh@960 -- # wait 3508327 00:22:42.853 [2024-11-18 19:21:01.286555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.286993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287317] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.853 [2024-11-18 19:21:01.287457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc2e0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.288991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.289505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbecb0 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.290133] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.854 [2024-11-18 19:21:01.290173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.854 [2024-11-18 19:21:01.290191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.854 [2024-11-18 19:21:01.290205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.854 [2024-11-18 19:21:01.290220] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.854 [2024-11-18 19:21:01.290234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.854 [2024-11-18 19:21:01.290248] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.854 [2024-11-18 19:21:01.290262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.854 [2024-11-18 19:21:01.290275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd42f70 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.854 [2024-11-18 19:21:01.291937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.291951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.291963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.291976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.291988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.292833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbc790 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.855 [2024-11-18 19:21:01.298428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.298844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbcc40 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.856 [2024-11-18 19:21:01.300905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.300990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301010] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-18 19:21:01.301025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:42.857 the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd0d0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301067] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301096] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301124] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd9b590 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301240] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301277] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301304] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301332] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd6e690 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301404] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301466] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf09600 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd42f70 (9): Bad file descriptor 00:22:42.857 [2024-11-18 19:21:01.301602] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301714] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.857 [2024-11-18 19:21:01.301727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.857 [2024-11-18 19:21:01.301741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd651b0 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.301841] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.857 [2024-11-18 19:21:01.302491] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.857 [2024-11-18 19:21:01.302852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.302983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbd580 is same with the state(5) to be set 00:22:42.857 [2024-11-18 19:21:01.303756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.857 [2024-11-18 19:21:01.303780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.303807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.303823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.303845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.303862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.303884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.303900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.303916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.303929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.303945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.303959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.303974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.303988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35328 len:128[2024-11-18 19:21:01.304097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:42.858 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:36480 len:12the state(5) to be set 00:22:42.858 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:42.858 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 19:21:01.304305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41600 len:1the state(5) to be set 00:22:42.858 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:41856 len:12[2024-11-18 19:21:01.304479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:42.858 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.858 [2024-11-18 19:21:01.304508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.858 [2024-11-18 19:21:01.304521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.858 [2024-11-18 19:21:01.304526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42112 len:12[2024-11-18 19:21:01.304547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:42.859 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:42752 len:1[2024-11-18 19:21:01.304716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with [2024-11-18 19:21:01.304731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:42.859 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43136 len:1[2024-11-18 19:21:01.304814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-18 19:21:01.304893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbda30 is same with the state(5) to be set 00:22:42.859 [2024-11-18 19:21:01.304924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.304979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.304993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.859 [2024-11-18 19:21:01.305314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.859 [2024-11-18 19:21:01.305334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.860 [2024-11-18 19:21:01.305774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.860 [2024-11-18 19:21:01.305788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf92950 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.305862] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf92950 was disconnected and freed. reset controller. 00:22:42.860 [2024-11-18 19:21:01.306191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with [2024-11-18 19:21:01.306315] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.860 the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306389] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.860 [2024-11-18 19:21:01.306398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with [2024-11-18 19:21:01.306455] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.860 the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.860 [2024-11-18 19:21:01.306875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.306991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.307003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.307015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.307028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.307040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbdee0 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.307840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:42.861 [2024-11-18 19:21:01.307916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef9150 (9): Bad file descriptor 00:22:42.861 [2024-11-18 19:21:01.308091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.308893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe370 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.309011] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.861 [2024-11-18 19:21:01.309361] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.861 [2024-11-18 19:21:01.309574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.309616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.309634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.861 [2024-11-18 19:21:01.309648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.309994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dbe800 is same with the state(5) to be set 00:22:42.862 [2024-11-18 19:21:01.310808] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:42.862 [2024-11-18 19:21:01.310916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.310939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.310961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.310986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.311016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.311047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.311076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.311105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.311134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.862 [2024-11-18 19:21:01.311164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.862 [2024-11-18 19:21:01.311179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.863 [2024-11-18 19:21:01.311755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf97fa0 is same with the state(5) to be set 00:22:42.863 [2024-11-18 19:21:01.311838] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf97fa0 was disconnected and freed. reset controller. 00:22:42.863 [2024-11-18 19:21:01.311916] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.311938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311954] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.311968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.311982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.311995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee40a0 is same with the state(5) to be set 00:22:42.863 [2024-11-18 19:21:01.312086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312195] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd90490 is same with the state(5) to be set 00:22:42.863 [2024-11-18 19:21:01.312244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd9b590 (9): Bad file descriptor 00:22:42.863 [2024-11-18 19:21:01.312295] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312331] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef3a60 is same with the state(5) to be set 00:22:42.863 [2024-11-18 19:21:01.312460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312496] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.863 [2024-11-18 19:21:01.312570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.863 [2024-11-18 19:21:01.312583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef8c70 is same with the state(5) to be set 00:22:42.863 [2024-11-18 19:21:01.312636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd6e690 (9): Bad file descriptor 00:22:42.863 [2024-11-18 19:21:01.312667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf09600 (9): Bad file descriptor 00:22:42.863 [2024-11-18 19:21:01.312701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd651b0 (9): Bad file descriptor 00:22:42.863 [2024-11-18 19:21:01.313782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:42.864 [2024-11-18 19:21:01.313814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd90490 (9): Bad file descriptor 00:22:42.864 [2024-11-18 19:21:01.313883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.313914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.313934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.313949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.313966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.313988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.314975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.314990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.315007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.315024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.315038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.315054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.864 [2024-11-18 19:21:01.315067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.864 [2024-11-18 19:21:01.315083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.865 [2024-11-18 19:21:01.315857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.865 [2024-11-18 19:21:01.315871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf87260 is same with the state(5) to be set 00:22:42.865 [2024-11-18 19:21:01.317118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:42.865 [2024-11-18 19:21:01.317169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef9150 (9): Bad file descriptor 00:22:42.865 [2024-11-18 19:21:01.317676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.865 [2024-11-18 19:21:01.317785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.865 [2024-11-18 19:21:01.317811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd90490 with addr=10.0.0.2, port=4420 00:22:42.865 [2024-11-18 19:21:01.317828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd90490 is same with the state(5) to be set 00:22:42.865 [2024-11-18 19:21:01.317928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.865 [2024-11-18 19:21:01.318038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.865 [2024-11-18 19:21:01.318062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd42f70 with addr=10.0.0.2, port=4420 00:22:42.865 [2024-11-18 19:21:01.318077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd42f70 is same with the state(5) to be set 00:22:42.865 [2024-11-18 19:21:01.318093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:42.865 [2024-11-18 19:21:01.318106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:42.865 [2024-11-18 19:21:01.318123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:42.865 [2024-11-18 19:21:01.318460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.865 [2024-11-18 19:21:01.318490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd90490 (9): Bad file descriptor 00:22:42.865 [2024-11-18 19:21:01.318510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd42f70 (9): Bad file descriptor 00:22:42.865 [2024-11-18 19:21:01.318602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:42.865 [2024-11-18 19:21:01.318630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:42.865 [2024-11-18 19:21:01.318646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:42.865 [2024-11-18 19:21:01.318668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:42.865 [2024-11-18 19:21:01.318683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:42.865 [2024-11-18 19:21:01.318702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:42.865 [2024-11-18 19:21:01.318769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:42.865 [2024-11-18 19:21:01.318792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.865 [2024-11-18 19:21:01.318805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.865 [2024-11-18 19:21:01.318957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.865 [2024-11-18 19:21:01.319046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.865 [2024-11-18 19:21:01.319070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef9150 with addr=10.0.0.2, port=4420 00:22:42.865 [2024-11-18 19:21:01.319085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef9150 is same with the state(5) to be set 00:22:42.865 [2024-11-18 19:21:01.319144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef9150 (9): Bad file descriptor 00:22:42.865 [2024-11-18 19:21:01.319202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:42.865 [2024-11-18 19:21:01.319219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:42.866 [2024-11-18 19:21:01.319233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:42.866 [2024-11-18 19:21:01.319292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.866 [2024-11-18 19:21:01.321912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xee40a0 (9): Bad file descriptor 00:22:42.866 [2024-11-18 19:21:01.321968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef3a60 (9): Bad file descriptor 00:22:42.866 [2024-11-18 19:21:01.322000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef8c70 (9): Bad file descriptor 00:22:42.866 [2024-11-18 19:21:01.322175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.322973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.322987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.866 [2024-11-18 19:21:01.323223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.866 [2024-11-18 19:21:01.323237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.323971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.323991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.324221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.324235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd33550 is same with the state(5) to be set 00:22:42.867 [2024-11-18 19:21:01.325546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.867 [2024-11-18 19:21:01.325786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.867 [2024-11-18 19:21:01.325800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.325815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.325829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.325844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.325858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.325874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.325888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.325909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.325923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.325938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.325951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.325974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.325988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.326975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.868 [2024-11-18 19:21:01.326989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.868 [2024-11-18 19:21:01.327005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.327491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.327505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xecf1a0 is same with the state(5) to be set 00:22:42.869 [2024-11-18 19:21:01.328774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.328818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.328853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.328885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.328922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.328953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.328982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.328995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.869 [2024-11-18 19:21:01.329436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.869 [2024-11-18 19:21:01.329449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.329979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.329994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.870 [2024-11-18 19:21:01.330583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.870 [2024-11-18 19:21:01.330597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.330618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.330634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.330660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.330673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.330688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.330702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.330718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.330732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.330746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xed06f0 is same with the state(5) to be set 00:22:42.871 [2024-11-18 19:21:01.332007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.871 [2024-11-18 19:21:01.332958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.871 [2024-11-18 19:21:01.332972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.332987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.872 [2024-11-18 19:21:01.333968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.872 [2024-11-18 19:21:01.333982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf995b0 is same with the state(5) to be set 00:22:42.872 [2024-11-18 19:21:01.336202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:42.872 [2024-11-18 19:21:01.336236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:42.872 [2024-11-18 19:21:01.336255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:42.872 [2024-11-18 19:21:01.336273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:42.872 [2024-11-18 19:21:01.336764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.872 [2024-11-18 19:21:01.336867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.872 [2024-11-18 19:21:01.336904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf09600 with addr=10.0.0.2, port=4420 00:22:42.872 [2024-11-18 19:21:01.336921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf09600 is same with the state(5) to be set 00:22:42.872 [2024-11-18 19:21:01.337019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.872 [2024-11-18 19:21:01.337109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.872 [2024-11-18 19:21:01.337133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd651b0 with addr=10.0.0.2, port=4420 00:22:42.872 [2024-11-18 19:21:01.337148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd651b0 is same with the state(5) to be set 00:22:42.872 [2024-11-18 19:21:01.337235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.872 [2024-11-18 19:21:01.337333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.872 [2024-11-18 19:21:01.337356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd6e690 with addr=10.0.0.2, port=4420 00:22:42.873 [2024-11-18 19:21:01.337372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd6e690 is same with the state(5) to be set 00:22:42.873 [2024-11-18 19:21:01.337467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.873 [2024-11-18 19:21:01.337559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.873 [2024-11-18 19:21:01.337583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd9b590 with addr=10.0.0.2, port=4420 00:22:42.873 [2024-11-18 19:21:01.337599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd9b590 is same with the state(5) to be set 00:22:42.873 [2024-11-18 19:21:01.338480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.338978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.338996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.873 [2024-11-18 19:21:01.339604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.873 [2024-11-18 19:21:01.339627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.339978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.339992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.340434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.340448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf93e00 is same with the state(5) to be set 00:22:42.874 [2024-11-18 19:21:01.341714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.341981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.341995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.342011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.342025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.342040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.342054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.874 [2024-11-18 19:21:01.342070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.874 [2024-11-18 19:21:01.342084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.342979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.342993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.343008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.343022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.343038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.343051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.343066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.343080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.343096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.343110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.875 [2024-11-18 19:21:01.343125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.875 [2024-11-18 19:21:01.343139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.343643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.343666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf953e0 is same with the state(5) to be set 00:22:42.876 [2024-11-18 19:21:01.344867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.344890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.344915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.344930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.344945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.344960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.344976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.344990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.876 [2024-11-18 19:21:01.345508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.876 [2024-11-18 19:21:01.345521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.345967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.345986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.877 [2024-11-18 19:21:01.346688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.877 [2024-11-18 19:21:01.346701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.878 [2024-11-18 19:21:01.346716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.878 [2024-11-18 19:21:01.346730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.878 [2024-11-18 19:21:01.346749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.878 [2024-11-18 19:21:01.346764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.878 [2024-11-18 19:21:01.346779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:42.878 [2024-11-18 19:21:01.346792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.878 [2024-11-18 19:21:01.346807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf969c0 is same with the state(5) to be set 00:22:42.878 [2024-11-18 19:21:01.348740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:42.878 [2024-11-18 19:21:01.348773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:42.878 [2024-11-18 19:21:01.348792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:42.878 [2024-11-18 19:21:01.348810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:42.878 [2024-11-18 19:21:01.348828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:42.878 task offset: 40320 on job bdev=Nvme5n1 fails 00:22:42.878 00:22:42.878 Latency(us) 00:22:42.878 [2024-11-18T18:21:01.483Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme1n1 ended in about 0.85 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme1n1 : 0.85 297.48 18.59 74.95 0.00 170800.97 10194.49 173985.94 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme2n1 ended in about 0.86 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme2n1 : 0.86 337.49 21.09 74.23 0.00 153140.23 81944.27 122722.23 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme3n1 ended in about 0.87 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme3n1 : 0.87 336.24 21.01 73.95 0.00 152346.00 75342.13 120392.06 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme4n1 ended in about 0.87 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme4n1 : 0.87 334.99 20.94 73.67 0.00 151538.65 70293.43 118838.61 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme5n1 ended in about 0.84 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme5n1 : 0.84 344.59 21.54 75.79 0.00 145815.65 6456.51 136703.24 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme6n1 ended in about 0.88 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme6n1 : 0.88 331.29 20.71 72.86 0.00 150543.13 72235.24 120392.06 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme7n1 ended in about 0.88 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme7n1 : 0.88 330.09 20.63 72.60 0.00 149749.45 65633.09 122722.23 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme8n1 ended in about 0.88 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme8n1 : 0.88 328.92 20.56 72.34 0.00 148948.66 55535.69 124275.67 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme9n1 ended in about 0.85 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme9n1 : 0.85 339.75 21.23 31.74 0.00 158690.73 2402.99 130489.46 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.878 [2024-11-18T18:21:01.483Z] Job: Nvme10n1 ended in about 0.87 seconds with error 00:22:42.878 Verification LBA range: start 0x0 length 0x400 00:22:42.878 Nvme10n1 : 0.87 287.87 17.99 73.40 0.00 162356.67 87769.69 141363.58 00:22:42.878 [2024-11-18T18:21:01.483Z] =================================================================================================================== 00:22:42.878 [2024-11-18T18:21:01.483Z] Total : 3268.72 204.30 695.53 0.00 154074.66 2402.99 173985.94 00:22:42.878 [2024-11-18 19:21:01.374430] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:42.878 [2024-11-18 19:21:01.374612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf09600 (9): Bad file descriptor 00:22:42.878 [2024-11-18 19:21:01.374659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd651b0 (9): Bad file descriptor 00:22:42.878 [2024-11-18 19:21:01.374679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd6e690 (9): Bad file descriptor 00:22:42.878 [2024-11-18 19:21:01.374698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd9b590 (9): Bad file descriptor 00:22:42.878 [2024-11-18 19:21:01.374764] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.878 [2024-11-18 19:21:01.374788] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.878 [2024-11-18 19:21:01.374807] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.878 [2024-11-18 19:21:01.374826] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.878 [2024-11-18 19:21:01.374845] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.878 [2024-11-18 19:21:01.375006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:42.878 [2024-11-18 19:21:01.375323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.375444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.375473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd42f70 with addr=10.0.0.2, port=4420 00:22:42.878 [2024-11-18 19:21:01.375494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd42f70 is same with the state(5) to be set 00:22:42.878 [2024-11-18 19:21:01.375588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.375692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.375719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd90490 with addr=10.0.0.2, port=4420 00:22:42.878 [2024-11-18 19:21:01.375736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd90490 is same with the state(5) to be set 00:22:42.878 [2024-11-18 19:21:01.375832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.375948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.375977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef9150 with addr=10.0.0.2, port=4420 00:22:42.878 [2024-11-18 19:21:01.375992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef9150 is same with the state(5) to be set 00:22:42.878 [2024-11-18 19:21:01.376083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.376181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.376205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xee40a0 with addr=10.0.0.2, port=4420 00:22:42.878 [2024-11-18 19:21:01.376233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xee40a0 is same with the state(5) to be set 00:22:42.878 [2024-11-18 19:21:01.376308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.376388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.878 [2024-11-18 19:21:01.376412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef3a60 with addr=10.0.0.2, port=4420 00:22:42.878 [2024-11-18 19:21:01.376428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef3a60 is same with the state(5) to be set 00:22:42.878 [2024-11-18 19:21:01.376443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:42.878 [2024-11-18 19:21:01.376457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:42.878 [2024-11-18 19:21:01.376475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:42.878 [2024-11-18 19:21:01.376496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:42.878 [2024-11-18 19:21:01.376510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:42.878 [2024-11-18 19:21:01.376523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:42.878 [2024-11-18 19:21:01.376540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:42.878 [2024-11-18 19:21:01.376554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:42.878 [2024-11-18 19:21:01.376568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:42.878 [2024-11-18 19:21:01.376584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:42.878 [2024-11-18 19:21:01.376598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:42.878 [2024-11-18 19:21:01.376620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:42.878 [2024-11-18 19:21:01.376666] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.879 [2024-11-18 19:21:01.376689] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.879 [2024-11-18 19:21:01.376711] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.879 [2024-11-18 19:21:01.376730] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.879 [2024-11-18 19:21:01.377643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.377672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.377686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.377698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.377776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.879 [2024-11-18 19:21:01.377866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:42.879 [2024-11-18 19:21:01.377891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef8c70 with addr=10.0.0.2, port=4420 00:22:42.879 [2024-11-18 19:21:01.377914] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef8c70 is same with the state(5) to be set 00:22:42.879 [2024-11-18 19:21:01.377933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd42f70 (9): Bad file descriptor 00:22:42.879 [2024-11-18 19:21:01.377969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd90490 (9): Bad file descriptor 00:22:42.879 [2024-11-18 19:21:01.377988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef9150 (9): Bad file descriptor 00:22:42.879 [2024-11-18 19:21:01.378005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xee40a0 (9): Bad file descriptor 00:22:42.879 [2024-11-18 19:21:01.378022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef3a60 (9): Bad file descriptor 00:22:42.879 [2024-11-18 19:21:01.378094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef8c70 (9): Bad file descriptor 00:22:42.879 [2024-11-18 19:21:01.378117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:42.879 [2024-11-18 19:21:01.378131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:42.879 [2024-11-18 19:21:01.378144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:42.879 [2024-11-18 19:21:01.378161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:42.879 [2024-11-18 19:21:01.378175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:42.879 [2024-11-18 19:21:01.378189] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:42.879 [2024-11-18 19:21:01.378205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:42.879 [2024-11-18 19:21:01.378219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:42.879 [2024-11-18 19:21:01.378231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:42.879 [2024-11-18 19:21:01.378247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:42.879 [2024-11-18 19:21:01.378261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:42.879 [2024-11-18 19:21:01.378275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:42.879 [2024-11-18 19:21:01.378290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:42.879 [2024-11-18 19:21:01.378304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:42.879 [2024-11-18 19:21:01.378317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:42.879 [2024-11-18 19:21:01.378376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.378395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.378408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.378419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.378431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.879 [2024-11-18 19:21:01.378445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:42.879 [2024-11-18 19:21:01.378457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:42.879 [2024-11-18 19:21:01.378471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:42.879 [2024-11-18 19:21:01.378508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:43.446 19:21:01 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:43.446 19:21:01 -- target/shutdown.sh@138 -- # sleep 1 00:22:44.381 19:21:02 -- target/shutdown.sh@141 -- # kill -9 3508521 00:22:44.381 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3508521) - No such process 00:22:44.381 19:21:02 -- target/shutdown.sh@141 -- # true 00:22:44.381 19:21:02 -- target/shutdown.sh@143 -- # stoptarget 00:22:44.381 19:21:02 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:44.381 19:21:02 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:44.381 19:21:02 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:44.381 19:21:02 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:44.381 19:21:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:44.381 19:21:02 -- nvmf/common.sh@116 -- # sync 00:22:44.381 19:21:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:44.381 19:21:02 -- nvmf/common.sh@119 -- # set +e 00:22:44.381 19:21:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:44.381 19:21:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:44.381 rmmod nvme_tcp 00:22:44.381 rmmod nvme_fabrics 00:22:44.381 rmmod nvme_keyring 00:22:44.381 19:21:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:44.381 19:21:02 -- nvmf/common.sh@123 -- # set -e 00:22:44.381 19:21:02 -- nvmf/common.sh@124 -- # return 0 00:22:44.381 19:21:02 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:44.381 19:21:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:44.381 19:21:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:44.381 19:21:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:44.381 19:21:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:44.381 19:21:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:44.381 19:21:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.381 19:21:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.381 19:21:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:46.912 19:21:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:46.912 00:22:46.912 real 0m8.120s 00:22:46.912 user 0m21.208s 00:22:46.912 sys 0m1.587s 00:22:46.912 19:21:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:46.912 19:21:04 -- common/autotest_common.sh@10 -- # set +x 00:22:46.912 ************************************ 00:22:46.912 END TEST nvmf_shutdown_tc3 00:22:46.912 ************************************ 00:22:46.912 19:21:05 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:46.912 00:22:46.912 real 0m29.307s 00:22:46.912 user 1m24.335s 00:22:46.912 sys 0m6.578s 00:22:46.912 19:21:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:46.912 19:21:05 -- common/autotest_common.sh@10 -- # set +x 00:22:46.912 ************************************ 00:22:46.912 END TEST nvmf_shutdown 00:22:46.912 ************************************ 00:22:46.912 19:21:05 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:46.912 19:21:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:46.912 19:21:05 -- common/autotest_common.sh@10 -- # set +x 00:22:46.912 19:21:05 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:46.912 19:21:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:46.912 19:21:05 -- common/autotest_common.sh@10 -- # set +x 00:22:46.912 19:21:05 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:46.912 19:21:05 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:46.912 19:21:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:46.912 19:21:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:46.912 19:21:05 -- common/autotest_common.sh@10 -- # set +x 00:22:46.912 ************************************ 00:22:46.912 START TEST nvmf_multicontroller 00:22:46.912 ************************************ 00:22:46.912 19:21:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:46.912 * Looking for test storage... 00:22:46.912 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:46.912 19:21:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:46.912 19:21:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:46.912 19:21:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:46.912 19:21:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:46.912 19:21:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:46.912 19:21:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:46.912 19:21:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:46.912 19:21:05 -- scripts/common.sh@335 -- # IFS=.-: 00:22:46.912 19:21:05 -- scripts/common.sh@335 -- # read -ra ver1 00:22:46.912 19:21:05 -- scripts/common.sh@336 -- # IFS=.-: 00:22:46.912 19:21:05 -- scripts/common.sh@336 -- # read -ra ver2 00:22:46.912 19:21:05 -- scripts/common.sh@337 -- # local 'op=<' 00:22:46.912 19:21:05 -- scripts/common.sh@339 -- # ver1_l=2 00:22:46.912 19:21:05 -- scripts/common.sh@340 -- # ver2_l=1 00:22:46.912 19:21:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:46.912 19:21:05 -- scripts/common.sh@343 -- # case "$op" in 00:22:46.912 19:21:05 -- scripts/common.sh@344 -- # : 1 00:22:46.912 19:21:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:46.912 19:21:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:46.912 19:21:05 -- scripts/common.sh@364 -- # decimal 1 00:22:46.912 19:21:05 -- scripts/common.sh@352 -- # local d=1 00:22:46.912 19:21:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:46.912 19:21:05 -- scripts/common.sh@354 -- # echo 1 00:22:46.912 19:21:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:46.912 19:21:05 -- scripts/common.sh@365 -- # decimal 2 00:22:46.912 19:21:05 -- scripts/common.sh@352 -- # local d=2 00:22:46.912 19:21:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:46.912 19:21:05 -- scripts/common.sh@354 -- # echo 2 00:22:46.912 19:21:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:46.912 19:21:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:46.912 19:21:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:46.912 19:21:05 -- scripts/common.sh@367 -- # return 0 00:22:46.912 19:21:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:46.912 19:21:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:46.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.912 --rc genhtml_branch_coverage=1 00:22:46.912 --rc genhtml_function_coverage=1 00:22:46.912 --rc genhtml_legend=1 00:22:46.912 --rc geninfo_all_blocks=1 00:22:46.912 --rc geninfo_unexecuted_blocks=1 00:22:46.912 00:22:46.912 ' 00:22:46.912 19:21:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:46.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.912 --rc genhtml_branch_coverage=1 00:22:46.912 --rc genhtml_function_coverage=1 00:22:46.912 --rc genhtml_legend=1 00:22:46.912 --rc geninfo_all_blocks=1 00:22:46.912 --rc geninfo_unexecuted_blocks=1 00:22:46.912 00:22:46.912 ' 00:22:46.912 19:21:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:46.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.912 --rc genhtml_branch_coverage=1 00:22:46.912 --rc genhtml_function_coverage=1 00:22:46.912 --rc genhtml_legend=1 00:22:46.912 --rc geninfo_all_blocks=1 00:22:46.912 --rc geninfo_unexecuted_blocks=1 00:22:46.912 00:22:46.912 ' 00:22:46.912 19:21:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:46.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:46.913 --rc genhtml_branch_coverage=1 00:22:46.913 --rc genhtml_function_coverage=1 00:22:46.913 --rc genhtml_legend=1 00:22:46.913 --rc geninfo_all_blocks=1 00:22:46.913 --rc geninfo_unexecuted_blocks=1 00:22:46.913 00:22:46.913 ' 00:22:46.913 19:21:05 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:46.913 19:21:05 -- nvmf/common.sh@7 -- # uname -s 00:22:46.913 19:21:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:46.913 19:21:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:46.913 19:21:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:46.913 19:21:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:46.913 19:21:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:46.913 19:21:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:46.913 19:21:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:46.913 19:21:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:46.913 19:21:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:46.913 19:21:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:46.913 19:21:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.913 19:21:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:46.913 19:21:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:46.913 19:21:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:46.913 19:21:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:46.913 19:21:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:46.913 19:21:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:46.913 19:21:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:46.913 19:21:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:46.913 19:21:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.913 19:21:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.913 19:21:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.913 19:21:05 -- paths/export.sh@5 -- # export PATH 00:22:46.913 19:21:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:46.913 19:21:05 -- nvmf/common.sh@46 -- # : 0 00:22:46.913 19:21:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:46.913 19:21:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:46.913 19:21:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:46.913 19:21:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:46.913 19:21:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:46.913 19:21:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:46.913 19:21:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:46.913 19:21:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:46.913 19:21:05 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:46.913 19:21:05 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:46.913 19:21:05 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:46.913 19:21:05 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:46.913 19:21:05 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:46.913 19:21:05 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:46.913 19:21:05 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:46.913 19:21:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:46.913 19:21:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:46.913 19:21:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:46.913 19:21:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:46.913 19:21:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:46.913 19:21:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:46.913 19:21:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:46.913 19:21:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:46.913 19:21:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:46.913 19:21:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:46.913 19:21:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:46.913 19:21:05 -- common/autotest_common.sh@10 -- # set +x 00:22:48.814 19:21:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:48.814 19:21:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:48.814 19:21:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:48.814 19:21:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:48.814 19:21:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:48.814 19:21:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:48.814 19:21:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:48.814 19:21:07 -- nvmf/common.sh@294 -- # net_devs=() 00:22:48.814 19:21:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:48.814 19:21:07 -- nvmf/common.sh@295 -- # e810=() 00:22:48.814 19:21:07 -- nvmf/common.sh@295 -- # local -ga e810 00:22:48.814 19:21:07 -- nvmf/common.sh@296 -- # x722=() 00:22:48.814 19:21:07 -- nvmf/common.sh@296 -- # local -ga x722 00:22:48.814 19:21:07 -- nvmf/common.sh@297 -- # mlx=() 00:22:48.814 19:21:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:48.814 19:21:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:48.814 19:21:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:48.814 19:21:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:48.815 19:21:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:48.815 19:21:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:48.815 19:21:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:48.815 19:21:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:48.815 19:21:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:48.815 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:48.815 19:21:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:48.815 19:21:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:48.815 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:48.815 19:21:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:48.815 19:21:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:48.815 19:21:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.815 19:21:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:48.815 19:21:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.815 19:21:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:48.815 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:48.815 19:21:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.815 19:21:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:48.815 19:21:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:48.815 19:21:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:48.815 19:21:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:48.815 19:21:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:48.815 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:48.815 19:21:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:48.815 19:21:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:48.815 19:21:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:48.815 19:21:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:48.815 19:21:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:48.815 19:21:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:48.815 19:21:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:48.815 19:21:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:48.815 19:21:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:48.815 19:21:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:48.815 19:21:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:48.815 19:21:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:48.815 19:21:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:48.815 19:21:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:48.815 19:21:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:48.815 19:21:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:48.815 19:21:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:48.815 19:21:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:48.815 19:21:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:48.815 19:21:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:48.815 19:21:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:48.815 19:21:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:48.815 19:21:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:48.815 19:21:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:48.815 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:48.815 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.209 ms 00:22:48.815 00:22:48.815 --- 10.0.0.2 ping statistics --- 00:22:48.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.815 rtt min/avg/max/mdev = 0.209/0.209/0.209/0.000 ms 00:22:48.815 19:21:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:48.815 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:48.815 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:22:48.815 00:22:48.815 --- 10.0.0.1 ping statistics --- 00:22:48.815 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:48.815 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:22:48.815 19:21:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:48.815 19:21:07 -- nvmf/common.sh@410 -- # return 0 00:22:48.815 19:21:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:48.815 19:21:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:48.815 19:21:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:48.815 19:21:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:48.815 19:21:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:48.815 19:21:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:48.815 19:21:07 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:48.815 19:21:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:48.815 19:21:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:48.815 19:21:07 -- common/autotest_common.sh@10 -- # set +x 00:22:48.815 19:21:07 -- nvmf/common.sh@469 -- # nvmfpid=3511337 00:22:48.815 19:21:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:48.815 19:21:07 -- nvmf/common.sh@470 -- # waitforlisten 3511337 00:22:48.815 19:21:07 -- common/autotest_common.sh@829 -- # '[' -z 3511337 ']' 00:22:48.815 19:21:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:48.815 19:21:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:48.815 19:21:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:48.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:48.815 19:21:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:48.815 19:21:07 -- common/autotest_common.sh@10 -- # set +x 00:22:48.815 [2024-11-18 19:21:07.400908] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:48.815 [2024-11-18 19:21:07.400978] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:49.074 EAL: No free 2048 kB hugepages reported on node 1 00:22:49.074 [2024-11-18 19:21:07.465543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:49.074 [2024-11-18 19:21:07.575820] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:49.074 [2024-11-18 19:21:07.575966] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:49.074 [2024-11-18 19:21:07.575984] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:49.075 [2024-11-18 19:21:07.575996] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:49.075 [2024-11-18 19:21:07.577641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:49.075 [2024-11-18 19:21:07.577685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:49.075 [2024-11-18 19:21:07.577689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:50.008 19:21:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:50.008 19:21:08 -- common/autotest_common.sh@862 -- # return 0 00:22:50.008 19:21:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:50.008 19:21:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 19:21:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:50.008 19:21:08 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 [2024-11-18 19:21:08.435855] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 Malloc0 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 [2024-11-18 19:21:08.491424] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 [2024-11-18 19:21:08.499310] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 Malloc1 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:50.008 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.008 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.008 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.008 19:21:08 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:50.009 19:21:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.009 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:50.009 19:21:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.009 19:21:08 -- host/multicontroller.sh@44 -- # bdevperf_pid=3511801 00:22:50.009 19:21:08 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:50.009 19:21:08 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:50.009 19:21:08 -- host/multicontroller.sh@47 -- # waitforlisten 3511801 /var/tmp/bdevperf.sock 00:22:50.009 19:21:08 -- common/autotest_common.sh@829 -- # '[' -z 3511801 ']' 00:22:50.009 19:21:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:50.009 19:21:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:50.009 19:21:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:50.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:50.009 19:21:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:50.009 19:21:08 -- common/autotest_common.sh@10 -- # set +x 00:22:51.382 19:21:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:51.382 19:21:09 -- common/autotest_common.sh@862 -- # return 0 00:22:51.382 19:21:09 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:51.382 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.382 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.382 NVMe0n1 00:22:51.382 19:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.382 19:21:09 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:51.382 19:21:09 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:51.382 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.382 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.382 19:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.382 1 00:22:51.382 19:21:09 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:51.382 19:21:09 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.382 19:21:09 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:51.382 19:21:09 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.382 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.382 19:21:09 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.382 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.382 19:21:09 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:51.382 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.382 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.382 request: 00:22:51.382 { 00:22:51.382 "name": "NVMe0", 00:22:51.382 "trtype": "tcp", 00:22:51.382 "traddr": "10.0.0.2", 00:22:51.382 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:51.382 "hostaddr": "10.0.0.2", 00:22:51.382 "hostsvcid": "60000", 00:22:51.382 "adrfam": "ipv4", 00:22:51.382 "trsvcid": "4420", 00:22:51.382 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.382 "method": "bdev_nvme_attach_controller", 00:22:51.382 "req_id": 1 00:22:51.383 } 00:22:51.383 Got JSON-RPC error response 00:22:51.383 response: 00:22:51.383 { 00:22:51.383 "code": -114, 00:22:51.383 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:51.383 } 00:22:51.383 19:21:09 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # es=1 00:22:51.383 19:21:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.383 19:21:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.383 19:21:09 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:51.383 19:21:09 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.383 19:21:09 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:51.383 19:21:09 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:51.383 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.383 request: 00:22:51.383 { 00:22:51.383 "name": "NVMe0", 00:22:51.383 "trtype": "tcp", 00:22:51.383 "traddr": "10.0.0.2", 00:22:51.383 "hostaddr": "10.0.0.2", 00:22:51.383 "hostsvcid": "60000", 00:22:51.383 "adrfam": "ipv4", 00:22:51.383 "trsvcid": "4420", 00:22:51.383 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:51.383 "method": "bdev_nvme_attach_controller", 00:22:51.383 "req_id": 1 00:22:51.383 } 00:22:51.383 Got JSON-RPC error response 00:22:51.383 response: 00:22:51.383 { 00:22:51.383 "code": -114, 00:22:51.383 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:51.383 } 00:22:51.383 19:21:09 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # es=1 00:22:51.383 19:21:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.383 19:21:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.383 19:21:09 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.383 19:21:09 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.383 request: 00:22:51.383 { 00:22:51.383 "name": "NVMe0", 00:22:51.383 "trtype": "tcp", 00:22:51.383 "traddr": "10.0.0.2", 00:22:51.383 "hostaddr": "10.0.0.2", 00:22:51.383 "hostsvcid": "60000", 00:22:51.383 "adrfam": "ipv4", 00:22:51.383 "trsvcid": "4420", 00:22:51.383 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.383 "multipath": "disable", 00:22:51.383 "method": "bdev_nvme_attach_controller", 00:22:51.383 "req_id": 1 00:22:51.383 } 00:22:51.383 Got JSON-RPC error response 00:22:51.383 response: 00:22:51.383 { 00:22:51.383 "code": -114, 00:22:51.383 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:51.383 } 00:22:51.383 19:21:09 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # es=1 00:22:51.383 19:21:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.383 19:21:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.383 19:21:09 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:51.383 19:21:09 -- common/autotest_common.sh@650 -- # local es=0 00:22:51.383 19:21:09 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:51.383 19:21:09 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:51.383 19:21:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:51.383 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.383 request: 00:22:51.383 { 00:22:51.383 "name": "NVMe0", 00:22:51.383 "trtype": "tcp", 00:22:51.383 "traddr": "10.0.0.2", 00:22:51.383 "hostaddr": "10.0.0.2", 00:22:51.383 "hostsvcid": "60000", 00:22:51.383 "adrfam": "ipv4", 00:22:51.383 "trsvcid": "4420", 00:22:51.383 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:51.383 "multipath": "failover", 00:22:51.383 "method": "bdev_nvme_attach_controller", 00:22:51.383 "req_id": 1 00:22:51.383 } 00:22:51.383 Got JSON-RPC error response 00:22:51.383 response: 00:22:51.383 { 00:22:51.383 "code": -114, 00:22:51.383 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:51.383 } 00:22:51.383 19:21:09 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@653 -- # es=1 00:22:51.383 19:21:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:51.383 19:21:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:51.383 19:21:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:51.383 19:21:09 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:51.383 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.383 00:22:51.383 19:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.383 19:21:09 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:51.383 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.383 19:21:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.383 19:21:09 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:51.383 19:21:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.383 19:21:09 -- common/autotest_common.sh@10 -- # set +x 00:22:51.641 00:22:51.641 19:21:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.641 19:21:10 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:51.641 19:21:10 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:51.641 19:21:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.641 19:21:10 -- common/autotest_common.sh@10 -- # set +x 00:22:51.641 19:21:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.641 19:21:10 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:51.641 19:21:10 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:53.016 0 00:22:53.016 19:21:11 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:53.016 19:21:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.016 19:21:11 -- common/autotest_common.sh@10 -- # set +x 00:22:53.016 19:21:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.016 19:21:11 -- host/multicontroller.sh@100 -- # killprocess 3511801 00:22:53.016 19:21:11 -- common/autotest_common.sh@936 -- # '[' -z 3511801 ']' 00:22:53.016 19:21:11 -- common/autotest_common.sh@940 -- # kill -0 3511801 00:22:53.016 19:21:11 -- common/autotest_common.sh@941 -- # uname 00:22:53.016 19:21:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:53.016 19:21:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3511801 00:22:53.016 19:21:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:53.016 19:21:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:53.016 19:21:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3511801' 00:22:53.016 killing process with pid 3511801 00:22:53.016 19:21:11 -- common/autotest_common.sh@955 -- # kill 3511801 00:22:53.016 19:21:11 -- common/autotest_common.sh@960 -- # wait 3511801 00:22:53.016 19:21:11 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:53.016 19:21:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.016 19:21:11 -- common/autotest_common.sh@10 -- # set +x 00:22:53.274 19:21:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.274 19:21:11 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:53.274 19:21:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:53.274 19:21:11 -- common/autotest_common.sh@10 -- # set +x 00:22:53.274 19:21:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:53.274 19:21:11 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:53.274 19:21:11 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:53.274 19:21:11 -- common/autotest_common.sh@1607 -- # read -r file 00:22:53.274 19:21:11 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:53.274 19:21:11 -- common/autotest_common.sh@1606 -- # sort -u 00:22:53.274 19:21:11 -- common/autotest_common.sh@1608 -- # cat 00:22:53.274 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:53.274 [2024-11-18 19:21:08.596373] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:53.274 [2024-11-18 19:21:08.596459] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3511801 ] 00:22:53.274 EAL: No free 2048 kB hugepages reported on node 1 00:22:53.274 [2024-11-18 19:21:08.656975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:53.274 [2024-11-18 19:21:08.768978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:53.274 [2024-11-18 19:21:10.144469] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 00268cce-e0e0-4f2a-9ab6-cd52842cbbda already exists 00:22:53.274 [2024-11-18 19:21:10.144515] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:00268cce-e0e0-4f2a-9ab6-cd52842cbbda alias for bdev NVMe1n1 00:22:53.274 [2024-11-18 19:21:10.144548] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:53.274 Running I/O for 1 seconds... 00:22:53.274 00:22:53.274 Latency(us) 00:22:53.274 [2024-11-18T18:21:11.879Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:53.274 [2024-11-18T18:21:11.879Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:53.274 NVMe0n1 : 1.00 19712.43 77.00 0.00 0.00 6484.19 2536.49 13301.38 00:22:53.274 [2024-11-18T18:21:11.879Z] =================================================================================================================== 00:22:53.274 [2024-11-18T18:21:11.879Z] Total : 19712.43 77.00 0.00 0.00 6484.19 2536.49 13301.38 00:22:53.274 Received shutdown signal, test time was about 1.000000 seconds 00:22:53.274 00:22:53.274 Latency(us) 00:22:53.274 [2024-11-18T18:21:11.879Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:53.274 [2024-11-18T18:21:11.879Z] =================================================================================================================== 00:22:53.274 [2024-11-18T18:21:11.879Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:53.274 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:53.274 19:21:11 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:53.274 19:21:11 -- common/autotest_common.sh@1607 -- # read -r file 00:22:53.274 19:21:11 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:53.274 19:21:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:53.274 19:21:11 -- nvmf/common.sh@116 -- # sync 00:22:53.274 19:21:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:53.274 19:21:11 -- nvmf/common.sh@119 -- # set +e 00:22:53.274 19:21:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:53.274 19:21:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:53.274 rmmod nvme_tcp 00:22:53.274 rmmod nvme_fabrics 00:22:53.274 rmmod nvme_keyring 00:22:53.274 19:21:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:53.274 19:21:11 -- nvmf/common.sh@123 -- # set -e 00:22:53.274 19:21:11 -- nvmf/common.sh@124 -- # return 0 00:22:53.274 19:21:11 -- nvmf/common.sh@477 -- # '[' -n 3511337 ']' 00:22:53.274 19:21:11 -- nvmf/common.sh@478 -- # killprocess 3511337 00:22:53.274 19:21:11 -- common/autotest_common.sh@936 -- # '[' -z 3511337 ']' 00:22:53.274 19:21:11 -- common/autotest_common.sh@940 -- # kill -0 3511337 00:22:53.274 19:21:11 -- common/autotest_common.sh@941 -- # uname 00:22:53.274 19:21:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:53.274 19:21:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3511337 00:22:53.274 19:21:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:53.274 19:21:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:53.274 19:21:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3511337' 00:22:53.274 killing process with pid 3511337 00:22:53.274 19:21:11 -- common/autotest_common.sh@955 -- # kill 3511337 00:22:53.274 19:21:11 -- common/autotest_common.sh@960 -- # wait 3511337 00:22:53.533 19:21:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:53.533 19:21:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:53.533 19:21:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:53.533 19:21:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:53.533 19:21:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:53.533 19:21:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.533 19:21:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.533 19:21:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:56.062 19:21:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:56.062 00:22:56.062 real 0m9.045s 00:22:56.062 user 0m17.667s 00:22:56.062 sys 0m2.300s 00:22:56.062 19:21:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:56.062 19:21:14 -- common/autotest_common.sh@10 -- # set +x 00:22:56.062 ************************************ 00:22:56.062 END TEST nvmf_multicontroller 00:22:56.062 ************************************ 00:22:56.062 19:21:14 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:56.062 19:21:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:56.062 19:21:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:56.062 19:21:14 -- common/autotest_common.sh@10 -- # set +x 00:22:56.062 ************************************ 00:22:56.062 START TEST nvmf_aer 00:22:56.062 ************************************ 00:22:56.062 19:21:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:56.062 * Looking for test storage... 00:22:56.062 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:56.062 19:21:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:56.062 19:21:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:56.062 19:21:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:56.062 19:21:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:56.062 19:21:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:56.062 19:21:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:56.062 19:21:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:56.062 19:21:14 -- scripts/common.sh@335 -- # IFS=.-: 00:22:56.062 19:21:14 -- scripts/common.sh@335 -- # read -ra ver1 00:22:56.062 19:21:14 -- scripts/common.sh@336 -- # IFS=.-: 00:22:56.062 19:21:14 -- scripts/common.sh@336 -- # read -ra ver2 00:22:56.062 19:21:14 -- scripts/common.sh@337 -- # local 'op=<' 00:22:56.062 19:21:14 -- scripts/common.sh@339 -- # ver1_l=2 00:22:56.062 19:21:14 -- scripts/common.sh@340 -- # ver2_l=1 00:22:56.062 19:21:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:56.062 19:21:14 -- scripts/common.sh@343 -- # case "$op" in 00:22:56.062 19:21:14 -- scripts/common.sh@344 -- # : 1 00:22:56.062 19:21:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:56.062 19:21:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:56.062 19:21:14 -- scripts/common.sh@364 -- # decimal 1 00:22:56.062 19:21:14 -- scripts/common.sh@352 -- # local d=1 00:22:56.062 19:21:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:56.062 19:21:14 -- scripts/common.sh@354 -- # echo 1 00:22:56.062 19:21:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:56.062 19:21:14 -- scripts/common.sh@365 -- # decimal 2 00:22:56.062 19:21:14 -- scripts/common.sh@352 -- # local d=2 00:22:56.062 19:21:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:56.062 19:21:14 -- scripts/common.sh@354 -- # echo 2 00:22:56.062 19:21:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:56.062 19:21:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:56.062 19:21:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:56.062 19:21:14 -- scripts/common.sh@367 -- # return 0 00:22:56.062 19:21:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:56.062 19:21:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:56.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:56.062 --rc genhtml_branch_coverage=1 00:22:56.062 --rc genhtml_function_coverage=1 00:22:56.062 --rc genhtml_legend=1 00:22:56.062 --rc geninfo_all_blocks=1 00:22:56.062 --rc geninfo_unexecuted_blocks=1 00:22:56.062 00:22:56.062 ' 00:22:56.062 19:21:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:56.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:56.062 --rc genhtml_branch_coverage=1 00:22:56.062 --rc genhtml_function_coverage=1 00:22:56.062 --rc genhtml_legend=1 00:22:56.062 --rc geninfo_all_blocks=1 00:22:56.062 --rc geninfo_unexecuted_blocks=1 00:22:56.062 00:22:56.062 ' 00:22:56.062 19:21:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:56.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:56.062 --rc genhtml_branch_coverage=1 00:22:56.062 --rc genhtml_function_coverage=1 00:22:56.062 --rc genhtml_legend=1 00:22:56.062 --rc geninfo_all_blocks=1 00:22:56.062 --rc geninfo_unexecuted_blocks=1 00:22:56.062 00:22:56.062 ' 00:22:56.062 19:21:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:56.062 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:56.062 --rc genhtml_branch_coverage=1 00:22:56.062 --rc genhtml_function_coverage=1 00:22:56.062 --rc genhtml_legend=1 00:22:56.062 --rc geninfo_all_blocks=1 00:22:56.062 --rc geninfo_unexecuted_blocks=1 00:22:56.062 00:22:56.062 ' 00:22:56.062 19:21:14 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:56.062 19:21:14 -- nvmf/common.sh@7 -- # uname -s 00:22:56.062 19:21:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:56.062 19:21:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:56.062 19:21:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:56.062 19:21:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:56.062 19:21:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:56.062 19:21:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:56.062 19:21:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:56.062 19:21:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:56.062 19:21:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:56.062 19:21:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:56.062 19:21:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:56.062 19:21:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:56.062 19:21:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:56.062 19:21:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:56.062 19:21:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:56.062 19:21:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:56.062 19:21:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:56.062 19:21:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:56.062 19:21:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:56.062 19:21:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.062 19:21:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.062 19:21:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.062 19:21:14 -- paths/export.sh@5 -- # export PATH 00:22:56.063 19:21:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:56.063 19:21:14 -- nvmf/common.sh@46 -- # : 0 00:22:56.063 19:21:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:56.063 19:21:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:56.063 19:21:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:56.063 19:21:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:56.063 19:21:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:56.063 19:21:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:56.063 19:21:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:56.063 19:21:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:56.063 19:21:14 -- host/aer.sh@11 -- # nvmftestinit 00:22:56.063 19:21:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:56.063 19:21:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:56.063 19:21:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:56.063 19:21:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:56.063 19:21:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:56.063 19:21:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:56.063 19:21:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:56.063 19:21:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:56.063 19:21:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:56.063 19:21:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:56.063 19:21:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:56.063 19:21:14 -- common/autotest_common.sh@10 -- # set +x 00:22:57.964 19:21:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.964 19:21:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.964 19:21:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.964 19:21:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.964 19:21:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.964 19:21:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.964 19:21:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.964 19:21:16 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.964 19:21:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.964 19:21:16 -- nvmf/common.sh@295 -- # e810=() 00:22:57.964 19:21:16 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.964 19:21:16 -- nvmf/common.sh@296 -- # x722=() 00:22:57.964 19:21:16 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.964 19:21:16 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.964 19:21:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.964 19:21:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.964 19:21:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.964 19:21:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.964 19:21:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.964 19:21:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.964 19:21:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.964 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.964 19:21:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.964 19:21:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.964 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.964 19:21:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.964 19:21:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.964 19:21:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.964 19:21:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.964 19:21:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.964 19:21:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.964 19:21:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.964 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.964 19:21:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.964 19:21:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.965 19:21:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.965 19:21:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.965 19:21:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.965 19:21:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.965 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.965 19:21:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.965 19:21:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.965 19:21:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.965 19:21:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.965 19:21:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.965 19:21:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.965 19:21:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.965 19:21:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.965 19:21:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.965 19:21:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.965 19:21:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.965 19:21:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.965 19:21:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.965 19:21:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.965 19:21:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.965 19:21:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.965 19:21:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.965 19:21:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.965 19:21:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.965 19:21:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.965 19:21:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.965 19:21:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.965 19:21:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.965 19:21:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.965 19:21:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.965 19:21:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.965 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.965 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:22:57.965 00:22:57.965 --- 10.0.0.2 ping statistics --- 00:22:57.965 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.965 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:22:57.965 19:21:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.965 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.965 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:57.965 00:22:57.965 --- 10.0.0.1 ping statistics --- 00:22:57.965 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.965 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:57.965 19:21:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.965 19:21:16 -- nvmf/common.sh@410 -- # return 0 00:22:57.965 19:21:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.965 19:21:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.965 19:21:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.965 19:21:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.965 19:21:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.965 19:21:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.965 19:21:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.965 19:21:16 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:57.965 19:21:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.965 19:21:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:57.965 19:21:16 -- common/autotest_common.sh@10 -- # set +x 00:22:57.965 19:21:16 -- nvmf/common.sh@469 -- # nvmfpid=3514219 00:22:57.965 19:21:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:57.965 19:21:16 -- nvmf/common.sh@470 -- # waitforlisten 3514219 00:22:57.965 19:21:16 -- common/autotest_common.sh@829 -- # '[' -z 3514219 ']' 00:22:57.965 19:21:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.965 19:21:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:57.965 19:21:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.965 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.965 19:21:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:57.965 19:21:16 -- common/autotest_common.sh@10 -- # set +x 00:22:57.965 [2024-11-18 19:21:16.347156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:57.965 [2024-11-18 19:21:16.347225] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.965 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.965 [2024-11-18 19:21:16.417161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:57.965 [2024-11-18 19:21:16.534755] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:57.965 [2024-11-18 19:21:16.534912] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:57.965 [2024-11-18 19:21:16.534937] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:57.965 [2024-11-18 19:21:16.534950] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:57.965 [2024-11-18 19:21:16.535003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:57.965 [2024-11-18 19:21:16.535035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:57.965 [2024-11-18 19:21:16.535095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:57.965 [2024-11-18 19:21:16.535098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:58.991 19:21:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:58.991 19:21:17 -- common/autotest_common.sh@862 -- # return 0 00:22:58.991 19:21:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:58.991 19:21:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 19:21:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:58.991 19:21:17 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:58.991 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 [2024-11-18 19:21:17.394297] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:58.991 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.991 19:21:17 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:58.991 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 Malloc0 00:22:58.991 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.991 19:21:17 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:58.991 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.991 19:21:17 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:58.991 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.991 19:21:17 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:58.991 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 [2024-11-18 19:21:17.447726] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:58.991 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.991 19:21:17 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:58.991 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.991 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:58.991 [2024-11-18 19:21:17.455399] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:58.991 [ 00:22:58.991 { 00:22:58.991 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:58.991 "subtype": "Discovery", 00:22:58.991 "listen_addresses": [], 00:22:58.991 "allow_any_host": true, 00:22:58.991 "hosts": [] 00:22:58.991 }, 00:22:58.991 { 00:22:58.991 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.991 "subtype": "NVMe", 00:22:58.991 "listen_addresses": [ 00:22:58.991 { 00:22:58.991 "transport": "TCP", 00:22:58.991 "trtype": "TCP", 00:22:58.991 "adrfam": "IPv4", 00:22:58.991 "traddr": "10.0.0.2", 00:22:58.991 "trsvcid": "4420" 00:22:58.991 } 00:22:58.991 ], 00:22:58.991 "allow_any_host": true, 00:22:58.991 "hosts": [], 00:22:58.991 "serial_number": "SPDK00000000000001", 00:22:58.991 "model_number": "SPDK bdev Controller", 00:22:58.991 "max_namespaces": 2, 00:22:58.991 "min_cntlid": 1, 00:22:58.991 "max_cntlid": 65519, 00:22:58.991 "namespaces": [ 00:22:58.991 { 00:22:58.991 "nsid": 1, 00:22:58.991 "bdev_name": "Malloc0", 00:22:58.991 "name": "Malloc0", 00:22:58.991 "nguid": "8A198F65D660428DB03851F625641191", 00:22:58.991 "uuid": "8a198f65-d660-428d-b038-51f625641191" 00:22:58.991 } 00:22:58.991 ] 00:22:58.991 } 00:22:58.991 ] 00:22:58.991 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.991 19:21:17 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:58.991 19:21:17 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:58.991 19:21:17 -- host/aer.sh@33 -- # aerpid=3514376 00:22:58.991 19:21:17 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:58.991 19:21:17 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:58.991 19:21:17 -- common/autotest_common.sh@1254 -- # local i=0 00:22:58.991 19:21:17 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.991 19:21:17 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:58.991 19:21:17 -- common/autotest_common.sh@1257 -- # i=1 00:22:58.991 19:21:17 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:58.991 EAL: No free 2048 kB hugepages reported on node 1 00:22:58.991 19:21:17 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.991 19:21:17 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:58.991 19:21:17 -- common/autotest_common.sh@1257 -- # i=2 00:22:58.991 19:21:17 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:59.274 19:21:17 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:59.274 19:21:17 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:22:59.274 19:21:17 -- common/autotest_common.sh@1257 -- # i=3 00:22:59.274 19:21:17 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:59.274 19:21:17 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:59.274 19:21:17 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:59.274 19:21:17 -- common/autotest_common.sh@1265 -- # return 0 00:22:59.274 19:21:17 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:59.274 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.274 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:59.274 Malloc1 00:22:59.274 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.274 19:21:17 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:59.274 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.274 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:59.274 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.274 19:21:17 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:59.274 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.274 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:59.274 Asynchronous Event Request test 00:22:59.274 Attaching to 10.0.0.2 00:22:59.274 Attached to 10.0.0.2 00:22:59.274 Registering asynchronous event callbacks... 00:22:59.274 Starting namespace attribute notice tests for all controllers... 00:22:59.274 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:59.274 aer_cb - Changed Namespace 00:22:59.274 Cleaning up... 00:22:59.274 [ 00:22:59.274 { 00:22:59.274 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:59.274 "subtype": "Discovery", 00:22:59.274 "listen_addresses": [], 00:22:59.274 "allow_any_host": true, 00:22:59.274 "hosts": [] 00:22:59.274 }, 00:22:59.274 { 00:22:59.274 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:59.274 "subtype": "NVMe", 00:22:59.274 "listen_addresses": [ 00:22:59.274 { 00:22:59.274 "transport": "TCP", 00:22:59.274 "trtype": "TCP", 00:22:59.274 "adrfam": "IPv4", 00:22:59.274 "traddr": "10.0.0.2", 00:22:59.274 "trsvcid": "4420" 00:22:59.274 } 00:22:59.274 ], 00:22:59.274 "allow_any_host": true, 00:22:59.274 "hosts": [], 00:22:59.274 "serial_number": "SPDK00000000000001", 00:22:59.274 "model_number": "SPDK bdev Controller", 00:22:59.274 "max_namespaces": 2, 00:22:59.274 "min_cntlid": 1, 00:22:59.274 "max_cntlid": 65519, 00:22:59.274 "namespaces": [ 00:22:59.274 { 00:22:59.274 "nsid": 1, 00:22:59.274 "bdev_name": "Malloc0", 00:22:59.274 "name": "Malloc0", 00:22:59.274 "nguid": "8A198F65D660428DB03851F625641191", 00:22:59.274 "uuid": "8a198f65-d660-428d-b038-51f625641191" 00:22:59.274 }, 00:22:59.274 { 00:22:59.274 "nsid": 2, 00:22:59.274 "bdev_name": "Malloc1", 00:22:59.274 "name": "Malloc1", 00:22:59.274 "nguid": "F50D79AFC25A487E9FAFAC4CCD4672BA", 00:22:59.274 "uuid": "f50d79af-c25a-487e-9faf-ac4ccd4672ba" 00:22:59.274 } 00:22:59.274 ] 00:22:59.274 } 00:22:59.274 ] 00:22:59.274 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.274 19:21:17 -- host/aer.sh@43 -- # wait 3514376 00:22:59.274 19:21:17 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:59.274 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.274 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:59.533 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.533 19:21:17 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:59.533 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.533 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:59.533 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.533 19:21:17 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:59.533 19:21:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:59.533 19:21:17 -- common/autotest_common.sh@10 -- # set +x 00:22:59.533 19:21:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:59.533 19:21:17 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:59.533 19:21:17 -- host/aer.sh@51 -- # nvmftestfini 00:22:59.533 19:21:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:59.533 19:21:17 -- nvmf/common.sh@116 -- # sync 00:22:59.533 19:21:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:59.533 19:21:17 -- nvmf/common.sh@119 -- # set +e 00:22:59.533 19:21:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:59.533 19:21:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:59.533 rmmod nvme_tcp 00:22:59.533 rmmod nvme_fabrics 00:22:59.533 rmmod nvme_keyring 00:22:59.533 19:21:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:59.533 19:21:17 -- nvmf/common.sh@123 -- # set -e 00:22:59.533 19:21:17 -- nvmf/common.sh@124 -- # return 0 00:22:59.533 19:21:17 -- nvmf/common.sh@477 -- # '[' -n 3514219 ']' 00:22:59.533 19:21:17 -- nvmf/common.sh@478 -- # killprocess 3514219 00:22:59.533 19:21:17 -- common/autotest_common.sh@936 -- # '[' -z 3514219 ']' 00:22:59.533 19:21:17 -- common/autotest_common.sh@940 -- # kill -0 3514219 00:22:59.533 19:21:17 -- common/autotest_common.sh@941 -- # uname 00:22:59.533 19:21:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:59.533 19:21:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3514219 00:22:59.533 19:21:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:59.533 19:21:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:59.533 19:21:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3514219' 00:22:59.533 killing process with pid 3514219 00:22:59.533 19:21:17 -- common/autotest_common.sh@955 -- # kill 3514219 00:22:59.533 [2024-11-18 19:21:17.997698] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:59.533 19:21:17 -- common/autotest_common.sh@960 -- # wait 3514219 00:22:59.792 19:21:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:59.792 19:21:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:59.792 19:21:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:59.792 19:21:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:59.792 19:21:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:59.792 19:21:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:59.792 19:21:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:59.792 19:21:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.694 19:21:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:01.694 00:23:01.694 real 0m6.148s 00:23:01.694 user 0m7.637s 00:23:01.694 sys 0m1.896s 00:23:01.694 19:21:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:01.694 19:21:20 -- common/autotest_common.sh@10 -- # set +x 00:23:01.694 ************************************ 00:23:01.694 END TEST nvmf_aer 00:23:01.694 ************************************ 00:23:01.953 19:21:20 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:01.953 19:21:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:01.953 19:21:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:01.953 19:21:20 -- common/autotest_common.sh@10 -- # set +x 00:23:01.953 ************************************ 00:23:01.953 START TEST nvmf_async_init 00:23:01.953 ************************************ 00:23:01.953 19:21:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:01.953 * Looking for test storage... 00:23:01.953 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:01.953 19:21:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:01.953 19:21:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:01.953 19:21:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:01.953 19:21:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:01.953 19:21:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:01.953 19:21:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:01.953 19:21:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:01.953 19:21:20 -- scripts/common.sh@335 -- # IFS=.-: 00:23:01.953 19:21:20 -- scripts/common.sh@335 -- # read -ra ver1 00:23:01.953 19:21:20 -- scripts/common.sh@336 -- # IFS=.-: 00:23:01.953 19:21:20 -- scripts/common.sh@336 -- # read -ra ver2 00:23:01.953 19:21:20 -- scripts/common.sh@337 -- # local 'op=<' 00:23:01.953 19:21:20 -- scripts/common.sh@339 -- # ver1_l=2 00:23:01.953 19:21:20 -- scripts/common.sh@340 -- # ver2_l=1 00:23:01.953 19:21:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:01.953 19:21:20 -- scripts/common.sh@343 -- # case "$op" in 00:23:01.953 19:21:20 -- scripts/common.sh@344 -- # : 1 00:23:01.953 19:21:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:01.953 19:21:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:01.953 19:21:20 -- scripts/common.sh@364 -- # decimal 1 00:23:01.953 19:21:20 -- scripts/common.sh@352 -- # local d=1 00:23:01.953 19:21:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:01.953 19:21:20 -- scripts/common.sh@354 -- # echo 1 00:23:01.953 19:21:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:01.953 19:21:20 -- scripts/common.sh@365 -- # decimal 2 00:23:01.953 19:21:20 -- scripts/common.sh@352 -- # local d=2 00:23:01.953 19:21:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:01.953 19:21:20 -- scripts/common.sh@354 -- # echo 2 00:23:01.953 19:21:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:01.953 19:21:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:01.953 19:21:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:01.953 19:21:20 -- scripts/common.sh@367 -- # return 0 00:23:01.953 19:21:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:01.953 19:21:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:01.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.953 --rc genhtml_branch_coverage=1 00:23:01.953 --rc genhtml_function_coverage=1 00:23:01.953 --rc genhtml_legend=1 00:23:01.953 --rc geninfo_all_blocks=1 00:23:01.953 --rc geninfo_unexecuted_blocks=1 00:23:01.953 00:23:01.953 ' 00:23:01.953 19:21:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:01.953 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.953 --rc genhtml_branch_coverage=1 00:23:01.953 --rc genhtml_function_coverage=1 00:23:01.953 --rc genhtml_legend=1 00:23:01.953 --rc geninfo_all_blocks=1 00:23:01.953 --rc geninfo_unexecuted_blocks=1 00:23:01.953 00:23:01.953 ' 00:23:01.953 19:21:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:01.954 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.954 --rc genhtml_branch_coverage=1 00:23:01.954 --rc genhtml_function_coverage=1 00:23:01.954 --rc genhtml_legend=1 00:23:01.954 --rc geninfo_all_blocks=1 00:23:01.954 --rc geninfo_unexecuted_blocks=1 00:23:01.954 00:23:01.954 ' 00:23:01.954 19:21:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:01.954 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.954 --rc genhtml_branch_coverage=1 00:23:01.954 --rc genhtml_function_coverage=1 00:23:01.954 --rc genhtml_legend=1 00:23:01.954 --rc geninfo_all_blocks=1 00:23:01.954 --rc geninfo_unexecuted_blocks=1 00:23:01.954 00:23:01.954 ' 00:23:01.954 19:21:20 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:01.954 19:21:20 -- nvmf/common.sh@7 -- # uname -s 00:23:01.954 19:21:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:01.954 19:21:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:01.954 19:21:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:01.954 19:21:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:01.954 19:21:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:01.954 19:21:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:01.954 19:21:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:01.954 19:21:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:01.954 19:21:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:01.954 19:21:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:01.954 19:21:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:01.954 19:21:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:01.954 19:21:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:01.954 19:21:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:01.954 19:21:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:01.954 19:21:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:01.954 19:21:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:01.954 19:21:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:01.954 19:21:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:01.954 19:21:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.954 19:21:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.954 19:21:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.954 19:21:20 -- paths/export.sh@5 -- # export PATH 00:23:01.954 19:21:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.954 19:21:20 -- nvmf/common.sh@46 -- # : 0 00:23:01.954 19:21:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:01.954 19:21:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:01.954 19:21:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:01.954 19:21:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:01.954 19:21:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:01.954 19:21:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:01.954 19:21:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:01.954 19:21:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:01.954 19:21:20 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:01.954 19:21:20 -- host/async_init.sh@14 -- # null_block_size=512 00:23:01.954 19:21:20 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:01.954 19:21:20 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:01.954 19:21:20 -- host/async_init.sh@20 -- # uuidgen 00:23:01.954 19:21:20 -- host/async_init.sh@20 -- # tr -d - 00:23:01.954 19:21:20 -- host/async_init.sh@20 -- # nguid=241ec7fd328948e8a592f7f72df1f439 00:23:01.954 19:21:20 -- host/async_init.sh@22 -- # nvmftestinit 00:23:01.954 19:21:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:01.954 19:21:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:01.954 19:21:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:01.954 19:21:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:01.954 19:21:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:01.954 19:21:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:01.954 19:21:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:01.954 19:21:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.954 19:21:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:01.954 19:21:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:01.954 19:21:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:01.954 19:21:20 -- common/autotest_common.sh@10 -- # set +x 00:23:03.855 19:21:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:03.855 19:21:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:03.855 19:21:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:03.855 19:21:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:03.855 19:21:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:03.855 19:21:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:03.855 19:21:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:03.855 19:21:22 -- nvmf/common.sh@294 -- # net_devs=() 00:23:03.855 19:21:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:03.855 19:21:22 -- nvmf/common.sh@295 -- # e810=() 00:23:03.855 19:21:22 -- nvmf/common.sh@295 -- # local -ga e810 00:23:03.855 19:21:22 -- nvmf/common.sh@296 -- # x722=() 00:23:03.855 19:21:22 -- nvmf/common.sh@296 -- # local -ga x722 00:23:03.855 19:21:22 -- nvmf/common.sh@297 -- # mlx=() 00:23:03.855 19:21:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:03.855 19:21:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:03.855 19:21:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:03.855 19:21:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:03.856 19:21:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:03.856 19:21:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:03.856 19:21:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:03.856 19:21:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.856 19:21:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:03.856 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:03.856 19:21:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.856 19:21:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:03.856 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:03.856 19:21:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:03.856 19:21:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.856 19:21:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.856 19:21:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.856 19:21:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.856 19:21:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:03.856 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:03.856 19:21:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.856 19:21:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.856 19:21:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.856 19:21:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.856 19:21:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.856 19:21:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:03.856 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:03.856 19:21:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.856 19:21:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:03.856 19:21:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:03.856 19:21:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:03.856 19:21:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:03.856 19:21:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:03.856 19:21:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:03.856 19:21:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:03.856 19:21:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:03.856 19:21:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:03.856 19:21:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:03.856 19:21:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:03.856 19:21:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:03.856 19:21:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:03.856 19:21:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:04.115 19:21:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:04.115 19:21:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:04.115 19:21:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:04.115 19:21:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:04.115 19:21:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:04.115 19:21:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:04.115 19:21:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:04.115 19:21:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:04.115 19:21:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:04.115 19:21:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:04.115 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:04.115 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:23:04.115 00:23:04.115 --- 10.0.0.2 ping statistics --- 00:23:04.115 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:04.115 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:23:04.115 19:21:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:04.115 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:04.115 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:23:04.115 00:23:04.115 --- 10.0.0.1 ping statistics --- 00:23:04.115 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:04.115 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:23:04.115 19:21:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:04.115 19:21:22 -- nvmf/common.sh@410 -- # return 0 00:23:04.115 19:21:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:04.115 19:21:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:04.115 19:21:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:04.115 19:21:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:04.115 19:21:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:04.115 19:21:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:04.115 19:21:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:04.115 19:21:22 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:04.115 19:21:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:04.115 19:21:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:04.115 19:21:22 -- common/autotest_common.sh@10 -- # set +x 00:23:04.115 19:21:22 -- nvmf/common.sh@469 -- # nvmfpid=3516340 00:23:04.115 19:21:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:04.115 19:21:22 -- nvmf/common.sh@470 -- # waitforlisten 3516340 00:23:04.115 19:21:22 -- common/autotest_common.sh@829 -- # '[' -z 3516340 ']' 00:23:04.115 19:21:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:04.115 19:21:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:04.115 19:21:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:04.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:04.115 19:21:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:04.115 19:21:22 -- common/autotest_common.sh@10 -- # set +x 00:23:04.115 [2024-11-18 19:21:22.652265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:04.115 [2024-11-18 19:21:22.652342] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:04.115 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.375 [2024-11-18 19:21:22.726348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:04.375 [2024-11-18 19:21:22.842201] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:04.375 [2024-11-18 19:21:22.842355] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:04.375 [2024-11-18 19:21:22.842372] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:04.375 [2024-11-18 19:21:22.842385] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:04.375 [2024-11-18 19:21:22.842413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:05.311 19:21:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:05.311 19:21:23 -- common/autotest_common.sh@862 -- # return 0 00:23:05.311 19:21:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:05.311 19:21:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 19:21:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:05.311 19:21:23 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 [2024-11-18 19:21:23.646167] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:05.311 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.311 19:21:23 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 null0 00:23:05.311 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.311 19:21:23 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.311 19:21:23 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.311 19:21:23 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 241ec7fd328948e8a592f7f72df1f439 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.311 19:21:23 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.311 [2024-11-18 19:21:23.686375] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:05.311 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.311 19:21:23 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:05.311 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.311 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.570 nvme0n1 00:23:05.570 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.570 19:21:23 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:05.570 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.570 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.570 [ 00:23:05.570 { 00:23:05.570 "name": "nvme0n1", 00:23:05.570 "aliases": [ 00:23:05.570 "241ec7fd-3289-48e8-a592-f7f72df1f439" 00:23:05.570 ], 00:23:05.570 "product_name": "NVMe disk", 00:23:05.570 "block_size": 512, 00:23:05.570 "num_blocks": 2097152, 00:23:05.570 "uuid": "241ec7fd-3289-48e8-a592-f7f72df1f439", 00:23:05.570 "assigned_rate_limits": { 00:23:05.570 "rw_ios_per_sec": 0, 00:23:05.570 "rw_mbytes_per_sec": 0, 00:23:05.570 "r_mbytes_per_sec": 0, 00:23:05.570 "w_mbytes_per_sec": 0 00:23:05.570 }, 00:23:05.570 "claimed": false, 00:23:05.570 "zoned": false, 00:23:05.570 "supported_io_types": { 00:23:05.570 "read": true, 00:23:05.570 "write": true, 00:23:05.570 "unmap": false, 00:23:05.570 "write_zeroes": true, 00:23:05.570 "flush": true, 00:23:05.570 "reset": true, 00:23:05.570 "compare": true, 00:23:05.570 "compare_and_write": true, 00:23:05.570 "abort": true, 00:23:05.570 "nvme_admin": true, 00:23:05.570 "nvme_io": true 00:23:05.570 }, 00:23:05.570 "driver_specific": { 00:23:05.570 "nvme": [ 00:23:05.570 { 00:23:05.570 "trid": { 00:23:05.570 "trtype": "TCP", 00:23:05.570 "adrfam": "IPv4", 00:23:05.570 "traddr": "10.0.0.2", 00:23:05.570 "trsvcid": "4420", 00:23:05.570 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:05.570 }, 00:23:05.570 "ctrlr_data": { 00:23:05.570 "cntlid": 1, 00:23:05.570 "vendor_id": "0x8086", 00:23:05.570 "model_number": "SPDK bdev Controller", 00:23:05.570 "serial_number": "00000000000000000000", 00:23:05.570 "firmware_revision": "24.01.1", 00:23:05.570 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:05.570 "oacs": { 00:23:05.570 "security": 0, 00:23:05.570 "format": 0, 00:23:05.570 "firmware": 0, 00:23:05.570 "ns_manage": 0 00:23:05.570 }, 00:23:05.570 "multi_ctrlr": true, 00:23:05.570 "ana_reporting": false 00:23:05.570 }, 00:23:05.570 "vs": { 00:23:05.570 "nvme_version": "1.3" 00:23:05.570 }, 00:23:05.570 "ns_data": { 00:23:05.570 "id": 1, 00:23:05.570 "can_share": true 00:23:05.570 } 00:23:05.570 } 00:23:05.570 ], 00:23:05.570 "mp_policy": "active_passive" 00:23:05.570 } 00:23:05.570 } 00:23:05.570 ] 00:23:05.570 19:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.570 19:21:23 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:05.570 19:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.570 19:21:23 -- common/autotest_common.sh@10 -- # set +x 00:23:05.570 [2024-11-18 19:21:23.935095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:05.570 [2024-11-18 19:21:23.935192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7a0ba0 (9): Bad file descriptor 00:23:05.570 [2024-11-18 19:21:24.067775] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:05.570 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.570 19:21:24 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:05.570 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.570 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.570 [ 00:23:05.570 { 00:23:05.570 "name": "nvme0n1", 00:23:05.570 "aliases": [ 00:23:05.570 "241ec7fd-3289-48e8-a592-f7f72df1f439" 00:23:05.570 ], 00:23:05.570 "product_name": "NVMe disk", 00:23:05.570 "block_size": 512, 00:23:05.570 "num_blocks": 2097152, 00:23:05.570 "uuid": "241ec7fd-3289-48e8-a592-f7f72df1f439", 00:23:05.570 "assigned_rate_limits": { 00:23:05.570 "rw_ios_per_sec": 0, 00:23:05.570 "rw_mbytes_per_sec": 0, 00:23:05.570 "r_mbytes_per_sec": 0, 00:23:05.570 "w_mbytes_per_sec": 0 00:23:05.570 }, 00:23:05.570 "claimed": false, 00:23:05.570 "zoned": false, 00:23:05.570 "supported_io_types": { 00:23:05.570 "read": true, 00:23:05.570 "write": true, 00:23:05.570 "unmap": false, 00:23:05.570 "write_zeroes": true, 00:23:05.570 "flush": true, 00:23:05.570 "reset": true, 00:23:05.570 "compare": true, 00:23:05.570 "compare_and_write": true, 00:23:05.570 "abort": true, 00:23:05.570 "nvme_admin": true, 00:23:05.570 "nvme_io": true 00:23:05.570 }, 00:23:05.570 "driver_specific": { 00:23:05.570 "nvme": [ 00:23:05.570 { 00:23:05.570 "trid": { 00:23:05.571 "trtype": "TCP", 00:23:05.571 "adrfam": "IPv4", 00:23:05.571 "traddr": "10.0.0.2", 00:23:05.571 "trsvcid": "4420", 00:23:05.571 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:05.571 }, 00:23:05.571 "ctrlr_data": { 00:23:05.571 "cntlid": 2, 00:23:05.571 "vendor_id": "0x8086", 00:23:05.571 "model_number": "SPDK bdev Controller", 00:23:05.571 "serial_number": "00000000000000000000", 00:23:05.571 "firmware_revision": "24.01.1", 00:23:05.571 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:05.571 "oacs": { 00:23:05.571 "security": 0, 00:23:05.571 "format": 0, 00:23:05.571 "firmware": 0, 00:23:05.571 "ns_manage": 0 00:23:05.571 }, 00:23:05.571 "multi_ctrlr": true, 00:23:05.571 "ana_reporting": false 00:23:05.571 }, 00:23:05.571 "vs": { 00:23:05.571 "nvme_version": "1.3" 00:23:05.571 }, 00:23:05.571 "ns_data": { 00:23:05.571 "id": 1, 00:23:05.571 "can_share": true 00:23:05.571 } 00:23:05.571 } 00:23:05.571 ], 00:23:05.571 "mp_policy": "active_passive" 00:23:05.571 } 00:23:05.571 } 00:23:05.571 ] 00:23:05.571 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.571 19:21:24 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:05.571 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.571 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.571 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.571 19:21:24 -- host/async_init.sh@53 -- # mktemp 00:23:05.571 19:21:24 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.RC63vRBIOc 00:23:05.571 19:21:24 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:05.571 19:21:24 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.RC63vRBIOc 00:23:05.571 19:21:24 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:05.571 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.571 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.571 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.571 19:21:24 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:05.571 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.571 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.571 [2024-11-18 19:21:24.115736] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:05.571 [2024-11-18 19:21:24.115923] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:05.571 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.571 19:21:24 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.RC63vRBIOc 00:23:05.571 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.571 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.571 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.571 19:21:24 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.RC63vRBIOc 00:23:05.571 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.571 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.571 [2024-11-18 19:21:24.131748] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:05.829 nvme0n1 00:23:05.829 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.829 19:21:24 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:05.830 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.830 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.830 [ 00:23:05.830 { 00:23:05.830 "name": "nvme0n1", 00:23:05.830 "aliases": [ 00:23:05.830 "241ec7fd-3289-48e8-a592-f7f72df1f439" 00:23:05.830 ], 00:23:05.830 "product_name": "NVMe disk", 00:23:05.830 "block_size": 512, 00:23:05.830 "num_blocks": 2097152, 00:23:05.830 "uuid": "241ec7fd-3289-48e8-a592-f7f72df1f439", 00:23:05.830 "assigned_rate_limits": { 00:23:05.830 "rw_ios_per_sec": 0, 00:23:05.830 "rw_mbytes_per_sec": 0, 00:23:05.830 "r_mbytes_per_sec": 0, 00:23:05.830 "w_mbytes_per_sec": 0 00:23:05.830 }, 00:23:05.830 "claimed": false, 00:23:05.830 "zoned": false, 00:23:05.830 "supported_io_types": { 00:23:05.830 "read": true, 00:23:05.830 "write": true, 00:23:05.830 "unmap": false, 00:23:05.830 "write_zeroes": true, 00:23:05.830 "flush": true, 00:23:05.830 "reset": true, 00:23:05.830 "compare": true, 00:23:05.830 "compare_and_write": true, 00:23:05.830 "abort": true, 00:23:05.830 "nvme_admin": true, 00:23:05.830 "nvme_io": true 00:23:05.830 }, 00:23:05.830 "driver_specific": { 00:23:05.830 "nvme": [ 00:23:05.830 { 00:23:05.830 "trid": { 00:23:05.830 "trtype": "TCP", 00:23:05.830 "adrfam": "IPv4", 00:23:05.830 "traddr": "10.0.0.2", 00:23:05.830 "trsvcid": "4421", 00:23:05.830 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:05.830 }, 00:23:05.830 "ctrlr_data": { 00:23:05.830 "cntlid": 3, 00:23:05.830 "vendor_id": "0x8086", 00:23:05.830 "model_number": "SPDK bdev Controller", 00:23:05.830 "serial_number": "00000000000000000000", 00:23:05.830 "firmware_revision": "24.01.1", 00:23:05.830 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:05.830 "oacs": { 00:23:05.830 "security": 0, 00:23:05.830 "format": 0, 00:23:05.830 "firmware": 0, 00:23:05.830 "ns_manage": 0 00:23:05.830 }, 00:23:05.830 "multi_ctrlr": true, 00:23:05.830 "ana_reporting": false 00:23:05.830 }, 00:23:05.830 "vs": { 00:23:05.830 "nvme_version": "1.3" 00:23:05.830 }, 00:23:05.830 "ns_data": { 00:23:05.830 "id": 1, 00:23:05.830 "can_share": true 00:23:05.830 } 00:23:05.830 } 00:23:05.830 ], 00:23:05.830 "mp_policy": "active_passive" 00:23:05.830 } 00:23:05.830 } 00:23:05.830 ] 00:23:05.830 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.830 19:21:24 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:05.830 19:21:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.830 19:21:24 -- common/autotest_common.sh@10 -- # set +x 00:23:05.830 19:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.830 19:21:24 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.RC63vRBIOc 00:23:05.830 19:21:24 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:05.830 19:21:24 -- host/async_init.sh@78 -- # nvmftestfini 00:23:05.830 19:21:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:05.830 19:21:24 -- nvmf/common.sh@116 -- # sync 00:23:05.830 19:21:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:05.830 19:21:24 -- nvmf/common.sh@119 -- # set +e 00:23:05.830 19:21:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:05.830 19:21:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:05.830 rmmod nvme_tcp 00:23:05.830 rmmod nvme_fabrics 00:23:05.830 rmmod nvme_keyring 00:23:05.830 19:21:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:05.830 19:21:24 -- nvmf/common.sh@123 -- # set -e 00:23:05.830 19:21:24 -- nvmf/common.sh@124 -- # return 0 00:23:05.830 19:21:24 -- nvmf/common.sh@477 -- # '[' -n 3516340 ']' 00:23:05.830 19:21:24 -- nvmf/common.sh@478 -- # killprocess 3516340 00:23:05.830 19:21:24 -- common/autotest_common.sh@936 -- # '[' -z 3516340 ']' 00:23:05.830 19:21:24 -- common/autotest_common.sh@940 -- # kill -0 3516340 00:23:05.830 19:21:24 -- common/autotest_common.sh@941 -- # uname 00:23:05.830 19:21:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:05.830 19:21:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3516340 00:23:05.830 19:21:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:05.830 19:21:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:05.830 19:21:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3516340' 00:23:05.830 killing process with pid 3516340 00:23:05.830 19:21:24 -- common/autotest_common.sh@955 -- # kill 3516340 00:23:05.830 19:21:24 -- common/autotest_common.sh@960 -- # wait 3516340 00:23:06.088 19:21:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:06.088 19:21:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:06.088 19:21:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:06.088 19:21:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:06.088 19:21:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:06.088 19:21:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:06.088 19:21:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:06.088 19:21:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.619 19:21:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:08.619 00:23:08.619 real 0m6.303s 00:23:08.619 user 0m3.133s 00:23:08.619 sys 0m1.807s 00:23:08.619 19:21:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.619 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:08.619 ************************************ 00:23:08.619 END TEST nvmf_async_init 00:23:08.619 ************************************ 00:23:08.619 19:21:26 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:08.619 19:21:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:08.619 19:21:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:08.619 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:08.619 ************************************ 00:23:08.619 START TEST dma 00:23:08.619 ************************************ 00:23:08.619 19:21:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:08.619 * Looking for test storage... 00:23:08.619 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:08.619 19:21:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.619 19:21:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.619 19:21:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.619 19:21:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.619 19:21:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.619 19:21:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.619 19:21:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.619 19:21:26 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.619 19:21:26 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.619 19:21:26 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.619 19:21:26 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.619 19:21:26 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.619 19:21:26 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.619 19:21:26 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.619 19:21:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.619 19:21:26 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.619 19:21:26 -- scripts/common.sh@344 -- # : 1 00:23:08.619 19:21:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.619 19:21:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.619 19:21:26 -- scripts/common.sh@364 -- # decimal 1 00:23:08.619 19:21:26 -- scripts/common.sh@352 -- # local d=1 00:23:08.619 19:21:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.619 19:21:26 -- scripts/common.sh@354 -- # echo 1 00:23:08.619 19:21:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.619 19:21:26 -- scripts/common.sh@365 -- # decimal 2 00:23:08.619 19:21:26 -- scripts/common.sh@352 -- # local d=2 00:23:08.619 19:21:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.619 19:21:26 -- scripts/common.sh@354 -- # echo 2 00:23:08.619 19:21:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.619 19:21:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.619 19:21:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.619 19:21:26 -- scripts/common.sh@367 -- # return 0 00:23:08.619 19:21:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.619 19:21:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.619 --rc genhtml_branch_coverage=1 00:23:08.619 --rc genhtml_function_coverage=1 00:23:08.619 --rc genhtml_legend=1 00:23:08.619 --rc geninfo_all_blocks=1 00:23:08.619 --rc geninfo_unexecuted_blocks=1 00:23:08.619 00:23:08.619 ' 00:23:08.619 19:21:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.619 --rc genhtml_branch_coverage=1 00:23:08.619 --rc genhtml_function_coverage=1 00:23:08.619 --rc genhtml_legend=1 00:23:08.619 --rc geninfo_all_blocks=1 00:23:08.619 --rc geninfo_unexecuted_blocks=1 00:23:08.619 00:23:08.619 ' 00:23:08.619 19:21:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.619 --rc genhtml_branch_coverage=1 00:23:08.619 --rc genhtml_function_coverage=1 00:23:08.619 --rc genhtml_legend=1 00:23:08.619 --rc geninfo_all_blocks=1 00:23:08.619 --rc geninfo_unexecuted_blocks=1 00:23:08.619 00:23:08.619 ' 00:23:08.619 19:21:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.619 --rc genhtml_branch_coverage=1 00:23:08.619 --rc genhtml_function_coverage=1 00:23:08.619 --rc genhtml_legend=1 00:23:08.619 --rc geninfo_all_blocks=1 00:23:08.619 --rc geninfo_unexecuted_blocks=1 00:23:08.619 00:23:08.619 ' 00:23:08.619 19:21:26 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.619 19:21:26 -- nvmf/common.sh@7 -- # uname -s 00:23:08.619 19:21:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.619 19:21:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.619 19:21:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.619 19:21:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.619 19:21:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.619 19:21:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.619 19:21:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.619 19:21:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.619 19:21:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.619 19:21:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.619 19:21:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.619 19:21:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.619 19:21:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.619 19:21:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.619 19:21:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.619 19:21:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.620 19:21:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.620 19:21:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.620 19:21:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.620 19:21:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.620 19:21:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.620 19:21:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.620 19:21:26 -- paths/export.sh@5 -- # export PATH 00:23:08.620 19:21:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.620 19:21:26 -- nvmf/common.sh@46 -- # : 0 00:23:08.620 19:21:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.620 19:21:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.620 19:21:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.620 19:21:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.620 19:21:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.620 19:21:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.620 19:21:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.620 19:21:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.620 19:21:26 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:08.620 19:21:26 -- host/dma.sh@13 -- # exit 0 00:23:08.620 00:23:08.620 real 0m0.157s 00:23:08.620 user 0m0.112s 00:23:08.620 sys 0m0.054s 00:23:08.620 19:21:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:08.620 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:08.620 ************************************ 00:23:08.620 END TEST dma 00:23:08.620 ************************************ 00:23:08.620 19:21:26 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:08.620 19:21:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:08.620 19:21:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:08.620 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:08.620 ************************************ 00:23:08.620 START TEST nvmf_identify 00:23:08.620 ************************************ 00:23:08.620 19:21:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:08.620 * Looking for test storage... 00:23:08.620 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:08.620 19:21:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:08.620 19:21:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:08.620 19:21:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:08.620 19:21:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:08.620 19:21:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:08.620 19:21:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:08.620 19:21:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:08.620 19:21:26 -- scripts/common.sh@335 -- # IFS=.-: 00:23:08.620 19:21:26 -- scripts/common.sh@335 -- # read -ra ver1 00:23:08.620 19:21:26 -- scripts/common.sh@336 -- # IFS=.-: 00:23:08.620 19:21:26 -- scripts/common.sh@336 -- # read -ra ver2 00:23:08.620 19:21:26 -- scripts/common.sh@337 -- # local 'op=<' 00:23:08.620 19:21:26 -- scripts/common.sh@339 -- # ver1_l=2 00:23:08.620 19:21:26 -- scripts/common.sh@340 -- # ver2_l=1 00:23:08.620 19:21:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:08.620 19:21:26 -- scripts/common.sh@343 -- # case "$op" in 00:23:08.620 19:21:26 -- scripts/common.sh@344 -- # : 1 00:23:08.620 19:21:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:08.620 19:21:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:08.620 19:21:26 -- scripts/common.sh@364 -- # decimal 1 00:23:08.620 19:21:26 -- scripts/common.sh@352 -- # local d=1 00:23:08.620 19:21:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:08.620 19:21:26 -- scripts/common.sh@354 -- # echo 1 00:23:08.620 19:21:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:08.620 19:21:26 -- scripts/common.sh@365 -- # decimal 2 00:23:08.620 19:21:26 -- scripts/common.sh@352 -- # local d=2 00:23:08.620 19:21:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:08.620 19:21:26 -- scripts/common.sh@354 -- # echo 2 00:23:08.620 19:21:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:08.620 19:21:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:08.620 19:21:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:08.620 19:21:26 -- scripts/common.sh@367 -- # return 0 00:23:08.620 19:21:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:08.620 19:21:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:08.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.620 --rc genhtml_branch_coverage=1 00:23:08.620 --rc genhtml_function_coverage=1 00:23:08.620 --rc genhtml_legend=1 00:23:08.620 --rc geninfo_all_blocks=1 00:23:08.620 --rc geninfo_unexecuted_blocks=1 00:23:08.620 00:23:08.620 ' 00:23:08.620 19:21:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:08.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.620 --rc genhtml_branch_coverage=1 00:23:08.620 --rc genhtml_function_coverage=1 00:23:08.620 --rc genhtml_legend=1 00:23:08.620 --rc geninfo_all_blocks=1 00:23:08.620 --rc geninfo_unexecuted_blocks=1 00:23:08.620 00:23:08.620 ' 00:23:08.620 19:21:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:08.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.620 --rc genhtml_branch_coverage=1 00:23:08.620 --rc genhtml_function_coverage=1 00:23:08.620 --rc genhtml_legend=1 00:23:08.620 --rc geninfo_all_blocks=1 00:23:08.620 --rc geninfo_unexecuted_blocks=1 00:23:08.620 00:23:08.620 ' 00:23:08.620 19:21:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:08.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:08.620 --rc genhtml_branch_coverage=1 00:23:08.620 --rc genhtml_function_coverage=1 00:23:08.620 --rc genhtml_legend=1 00:23:08.620 --rc geninfo_all_blocks=1 00:23:08.620 --rc geninfo_unexecuted_blocks=1 00:23:08.620 00:23:08.620 ' 00:23:08.620 19:21:26 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:08.620 19:21:26 -- nvmf/common.sh@7 -- # uname -s 00:23:08.620 19:21:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:08.620 19:21:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:08.620 19:21:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:08.620 19:21:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:08.620 19:21:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:08.620 19:21:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:08.620 19:21:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:08.620 19:21:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:08.620 19:21:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:08.620 19:21:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:08.620 19:21:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.620 19:21:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:08.620 19:21:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:08.620 19:21:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:08.620 19:21:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:08.620 19:21:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:08.620 19:21:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:08.620 19:21:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:08.620 19:21:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:08.620 19:21:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.620 19:21:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.621 19:21:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.621 19:21:26 -- paths/export.sh@5 -- # export PATH 00:23:08.621 19:21:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:08.621 19:21:26 -- nvmf/common.sh@46 -- # : 0 00:23:08.621 19:21:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:08.621 19:21:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:08.621 19:21:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:08.621 19:21:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:08.621 19:21:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:08.621 19:21:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:08.621 19:21:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:08.621 19:21:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:08.621 19:21:26 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:08.621 19:21:26 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:08.621 19:21:26 -- host/identify.sh@14 -- # nvmftestinit 00:23:08.621 19:21:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:08.621 19:21:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:08.621 19:21:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:08.621 19:21:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:08.621 19:21:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:08.621 19:21:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.621 19:21:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.621 19:21:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:08.621 19:21:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:08.621 19:21:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:08.621 19:21:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:08.621 19:21:26 -- common/autotest_common.sh@10 -- # set +x 00:23:11.152 19:21:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:11.152 19:21:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:11.152 19:21:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:11.152 19:21:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:11.152 19:21:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:11.152 19:21:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:11.152 19:21:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:11.152 19:21:29 -- nvmf/common.sh@294 -- # net_devs=() 00:23:11.152 19:21:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:11.152 19:21:29 -- nvmf/common.sh@295 -- # e810=() 00:23:11.152 19:21:29 -- nvmf/common.sh@295 -- # local -ga e810 00:23:11.152 19:21:29 -- nvmf/common.sh@296 -- # x722=() 00:23:11.152 19:21:29 -- nvmf/common.sh@296 -- # local -ga x722 00:23:11.152 19:21:29 -- nvmf/common.sh@297 -- # mlx=() 00:23:11.152 19:21:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:11.152 19:21:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:11.152 19:21:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:11.152 19:21:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:11.152 19:21:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:11.152 19:21:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.152 19:21:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:11.152 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:11.152 19:21:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.152 19:21:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:11.152 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:11.152 19:21:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:11.152 19:21:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.152 19:21:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.152 19:21:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.152 19:21:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.152 19:21:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:11.152 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:11.152 19:21:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.152 19:21:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.152 19:21:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.152 19:21:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.152 19:21:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.152 19:21:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:11.152 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:11.152 19:21:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.152 19:21:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:11.152 19:21:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:11.152 19:21:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:11.152 19:21:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:11.152 19:21:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:11.152 19:21:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:11.152 19:21:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:11.152 19:21:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:11.152 19:21:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:11.152 19:21:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:11.152 19:21:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:11.152 19:21:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:11.152 19:21:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:11.152 19:21:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:11.152 19:21:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:11.153 19:21:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:11.153 19:21:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:11.153 19:21:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:11.153 19:21:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:11.153 19:21:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:11.153 19:21:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:11.153 19:21:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:11.153 19:21:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:11.153 19:21:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:11.153 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:11.153 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.361 ms 00:23:11.153 00:23:11.153 --- 10.0.0.2 ping statistics --- 00:23:11.153 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.153 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:23:11.153 19:21:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:11.153 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:11.153 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:23:11.153 00:23:11.153 --- 10.0.0.1 ping statistics --- 00:23:11.153 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.153 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:23:11.153 19:21:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:11.153 19:21:29 -- nvmf/common.sh@410 -- # return 0 00:23:11.153 19:21:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:11.153 19:21:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:11.153 19:21:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:11.153 19:21:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:11.153 19:21:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:11.153 19:21:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:11.153 19:21:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:11.153 19:21:29 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:11.153 19:21:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:11.153 19:21:29 -- common/autotest_common.sh@10 -- # set +x 00:23:11.153 19:21:29 -- host/identify.sh@19 -- # nvmfpid=3518625 00:23:11.153 19:21:29 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:11.153 19:21:29 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:11.153 19:21:29 -- host/identify.sh@23 -- # waitforlisten 3518625 00:23:11.153 19:21:29 -- common/autotest_common.sh@829 -- # '[' -z 3518625 ']' 00:23:11.153 19:21:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:11.153 19:21:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:11.153 19:21:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:11.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:11.153 19:21:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:11.153 19:21:29 -- common/autotest_common.sh@10 -- # set +x 00:23:11.153 [2024-11-18 19:21:29.344535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.153 [2024-11-18 19:21:29.344638] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:11.153 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.153 [2024-11-18 19:21:29.409130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:11.153 [2024-11-18 19:21:29.519775] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:11.153 [2024-11-18 19:21:29.519929] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:11.153 [2024-11-18 19:21:29.519957] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:11.153 [2024-11-18 19:21:29.519970] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:11.153 [2024-11-18 19:21:29.520040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:11.153 [2024-11-18 19:21:29.520101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:11.153 [2024-11-18 19:21:29.520167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:11.153 [2024-11-18 19:21:29.520170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:11.719 19:21:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:11.719 19:21:30 -- common/autotest_common.sh@862 -- # return 0 00:23:11.719 19:21:30 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:11.719 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.719 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.719 [2024-11-18 19:21:30.316211] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:11.979 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.979 19:21:30 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:11.979 19:21:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 19:21:30 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:11.979 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 Malloc0 00:23:11.979 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.979 19:21:30 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:11.979 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.979 19:21:30 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:11.979 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.979 19:21:30 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:11.979 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 [2024-11-18 19:21:30.398103] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:11.979 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.979 19:21:30 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:11.979 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.979 19:21:30 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:11.979 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.979 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:11.979 [2024-11-18 19:21:30.413801] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:11.979 [ 00:23:11.979 { 00:23:11.979 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:11.979 "subtype": "Discovery", 00:23:11.979 "listen_addresses": [ 00:23:11.979 { 00:23:11.979 "transport": "TCP", 00:23:11.979 "trtype": "TCP", 00:23:11.979 "adrfam": "IPv4", 00:23:11.979 "traddr": "10.0.0.2", 00:23:11.979 "trsvcid": "4420" 00:23:11.979 } 00:23:11.979 ], 00:23:11.979 "allow_any_host": true, 00:23:11.979 "hosts": [] 00:23:11.979 }, 00:23:11.979 { 00:23:11.979 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:11.979 "subtype": "NVMe", 00:23:11.979 "listen_addresses": [ 00:23:11.979 { 00:23:11.979 "transport": "TCP", 00:23:11.979 "trtype": "TCP", 00:23:11.979 "adrfam": "IPv4", 00:23:11.979 "traddr": "10.0.0.2", 00:23:11.979 "trsvcid": "4420" 00:23:11.979 } 00:23:11.979 ], 00:23:11.979 "allow_any_host": true, 00:23:11.979 "hosts": [], 00:23:11.979 "serial_number": "SPDK00000000000001", 00:23:11.980 "model_number": "SPDK bdev Controller", 00:23:11.980 "max_namespaces": 32, 00:23:11.980 "min_cntlid": 1, 00:23:11.980 "max_cntlid": 65519, 00:23:11.980 "namespaces": [ 00:23:11.980 { 00:23:11.980 "nsid": 1, 00:23:11.980 "bdev_name": "Malloc0", 00:23:11.980 "name": "Malloc0", 00:23:11.980 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:11.980 "eui64": "ABCDEF0123456789", 00:23:11.980 "uuid": "b4c5b1e8-e0e1-48f1-bc67-d326e8afdb2f" 00:23:11.980 } 00:23:11.980 ] 00:23:11.980 } 00:23:11.980 ] 00:23:11.980 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.980 19:21:30 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:11.980 [2024-11-18 19:21:30.440537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.980 [2024-11-18 19:21:30.440579] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3518787 ] 00:23:11.980 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.980 [2024-11-18 19:21:30.472112] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:11.980 [2024-11-18 19:21:30.472181] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:11.980 [2024-11-18 19:21:30.472191] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:11.980 [2024-11-18 19:21:30.472208] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:11.980 [2024-11-18 19:21:30.472222] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:11.980 [2024-11-18 19:21:30.475659] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:11.980 [2024-11-18 19:21:30.475727] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x13aae10 0 00:23:11.980 [2024-11-18 19:21:30.482621] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:11.980 [2024-11-18 19:21:30.482645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:11.980 [2024-11-18 19:21:30.482655] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:11.980 [2024-11-18 19:21:30.482661] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:11.980 [2024-11-18 19:21:30.482717] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.482736] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.482744] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.980 [2024-11-18 19:21:30.482765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:11.980 [2024-11-18 19:21:30.482793] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.980 [2024-11-18 19:21:30.493620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.980 [2024-11-18 19:21:30.493640] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.980 [2024-11-18 19:21:30.493648] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.493656] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.980 [2024-11-18 19:21:30.493680] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:11.980 [2024-11-18 19:21:30.493693] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:11.980 [2024-11-18 19:21:30.493703] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:11.980 [2024-11-18 19:21:30.493724] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.493733] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.493740] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.980 [2024-11-18 19:21:30.493751] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.980 [2024-11-18 19:21:30.493776] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.980 [2024-11-18 19:21:30.493911] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.980 [2024-11-18 19:21:30.493925] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.980 [2024-11-18 19:21:30.493932] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.493939] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.980 [2024-11-18 19:21:30.493950] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:11.980 [2024-11-18 19:21:30.493963] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:11.980 [2024-11-18 19:21:30.493975] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.493982] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.493989] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.980 [2024-11-18 19:21:30.494000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.980 [2024-11-18 19:21:30.494021] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.980 [2024-11-18 19:21:30.494108] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.980 [2024-11-18 19:21:30.494120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.980 [2024-11-18 19:21:30.494126] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.494133] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.980 [2024-11-18 19:21:30.494143] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:11.980 [2024-11-18 19:21:30.494158] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:11.980 [2024-11-18 19:21:30.494169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.494181] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.494188] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.980 [2024-11-18 19:21:30.494199] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.980 [2024-11-18 19:21:30.494220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.980 [2024-11-18 19:21:30.494301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.980 [2024-11-18 19:21:30.494315] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.980 [2024-11-18 19:21:30.494322] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.494328] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.980 [2024-11-18 19:21:30.494339] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:11.980 [2024-11-18 19:21:30.494356] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.494365] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.980 [2024-11-18 19:21:30.494371] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.980 [2024-11-18 19:21:30.494382] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.980 [2024-11-18 19:21:30.494402] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.980 [2024-11-18 19:21:30.494504] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.980 [2024-11-18 19:21:30.494519] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.980 [2024-11-18 19:21:30.494525] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.494532] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.981 [2024-11-18 19:21:30.494542] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:11.981 [2024-11-18 19:21:30.494551] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:11.981 [2024-11-18 19:21:30.494563] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:11.981 [2024-11-18 19:21:30.494674] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:11.981 [2024-11-18 19:21:30.494684] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:11.981 [2024-11-18 19:21:30.494701] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.494709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.494715] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.494726] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.981 [2024-11-18 19:21:30.494747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.981 [2024-11-18 19:21:30.494878] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.981 [2024-11-18 19:21:30.494892] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.981 [2024-11-18 19:21:30.494899] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.494906] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.981 [2024-11-18 19:21:30.494916] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:11.981 [2024-11-18 19:21:30.494936] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.494946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.494952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.494963] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.981 [2024-11-18 19:21:30.494983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.981 [2024-11-18 19:21:30.495080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.981 [2024-11-18 19:21:30.495094] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.981 [2024-11-18 19:21:30.495101] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495107] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.981 [2024-11-18 19:21:30.495117] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:11.981 [2024-11-18 19:21:30.495126] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:11.981 [2024-11-18 19:21:30.495139] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:11.981 [2024-11-18 19:21:30.495159] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:11.981 [2024-11-18 19:21:30.495176] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495184] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495191] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.495202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.981 [2024-11-18 19:21:30.495223] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.981 [2024-11-18 19:21:30.495344] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.981 [2024-11-18 19:21:30.495358] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.981 [2024-11-18 19:21:30.495365] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495372] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13aae10): datao=0, datal=4096, cccid=0 00:23:11.981 [2024-11-18 19:21:30.495380] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x142ab30) on tqpair(0x13aae10): expected_datao=0, payload_size=4096 00:23:11.981 [2024-11-18 19:21:30.495407] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495418] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495452] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.981 [2024-11-18 19:21:30.495464] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.981 [2024-11-18 19:21:30.495470] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495477] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.981 [2024-11-18 19:21:30.495491] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:11.981 [2024-11-18 19:21:30.495500] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:11.981 [2024-11-18 19:21:30.495508] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:11.981 [2024-11-18 19:21:30.495518] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:11.981 [2024-11-18 19:21:30.495530] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:11.981 [2024-11-18 19:21:30.495539] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:11.981 [2024-11-18 19:21:30.495558] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:11.981 [2024-11-18 19:21:30.495572] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495580] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495586] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.495597] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:11.981 [2024-11-18 19:21:30.495626] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.981 [2024-11-18 19:21:30.495717] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.981 [2024-11-18 19:21:30.495731] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.981 [2024-11-18 19:21:30.495737] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495744] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142ab30) on tqpair=0x13aae10 00:23:11.981 [2024-11-18 19:21:30.495760] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495767] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495773] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.495784] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.981 [2024-11-18 19:21:30.495794] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495800] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495807] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.495816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.981 [2024-11-18 19:21:30.495826] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495832] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495838] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.495847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.981 [2024-11-18 19:21:30.495857] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495864] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.981 [2024-11-18 19:21:30.495870] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:11.981 [2024-11-18 19:21:30.495879] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.981 [2024-11-18 19:21:30.495888] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:11.981 [2024-11-18 19:21:30.495907] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:11.981 [2024-11-18 19:21:30.495920] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.495927] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.495934] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13aae10) 00:23:11.982 [2024-11-18 19:21:30.495948] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.982 [2024-11-18 19:21:30.495972] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ab30, cid 0, qid 0 00:23:11.982 [2024-11-18 19:21:30.495983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142ac90, cid 1, qid 0 00:23:11.982 [2024-11-18 19:21:30.495991] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142adf0, cid 2, qid 0 00:23:11.982 [2024-11-18 19:21:30.495998] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:11.982 [2024-11-18 19:21:30.496006] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142b0b0, cid 4, qid 0 00:23:11.982 [2024-11-18 19:21:30.496135] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.982 [2024-11-18 19:21:30.496150] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.982 [2024-11-18 19:21:30.496156] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496163] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142b0b0) on tqpair=0x13aae10 00:23:11.982 [2024-11-18 19:21:30.496174] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:11.982 [2024-11-18 19:21:30.496183] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:11.982 [2024-11-18 19:21:30.496201] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496210] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496217] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13aae10) 00:23:11.982 [2024-11-18 19:21:30.496227] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.982 [2024-11-18 19:21:30.496248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142b0b0, cid 4, qid 0 00:23:11.982 [2024-11-18 19:21:30.496345] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.982 [2024-11-18 19:21:30.496360] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.982 [2024-11-18 19:21:30.496367] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496373] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13aae10): datao=0, datal=4096, cccid=4 00:23:11.982 [2024-11-18 19:21:30.496381] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x142b0b0) on tqpair(0x13aae10): expected_datao=0, payload_size=4096 00:23:11.982 [2024-11-18 19:21:30.496392] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496400] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496412] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.982 [2024-11-18 19:21:30.496422] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.982 [2024-11-18 19:21:30.496428] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496435] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142b0b0) on tqpair=0x13aae10 00:23:11.982 [2024-11-18 19:21:30.496455] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:11.982 [2024-11-18 19:21:30.496496] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496513] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13aae10) 00:23:11.982 [2024-11-18 19:21:30.496524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.982 [2024-11-18 19:21:30.496536] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496547] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496554] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x13aae10) 00:23:11.982 [2024-11-18 19:21:30.496563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:11.982 [2024-11-18 19:21:30.496590] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142b0b0, cid 4, qid 0 00:23:11.982 [2024-11-18 19:21:30.496602] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142b210, cid 5, qid 0 00:23:11.982 [2024-11-18 19:21:30.496736] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.982 [2024-11-18 19:21:30.496748] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.982 [2024-11-18 19:21:30.496755] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496762] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13aae10): datao=0, datal=1024, cccid=4 00:23:11.982 [2024-11-18 19:21:30.496769] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x142b0b0) on tqpair(0x13aae10): expected_datao=0, payload_size=1024 00:23:11.982 [2024-11-18 19:21:30.496779] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496787] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496796] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.982 [2024-11-18 19:21:30.496804] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.982 [2024-11-18 19:21:30.496811] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.496817] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142b210) on tqpair=0x13aae10 00:23:11.982 [2024-11-18 19:21:30.542622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.982 [2024-11-18 19:21:30.542641] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.982 [2024-11-18 19:21:30.542649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.542656] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142b0b0) on tqpair=0x13aae10 00:23:11.982 [2024-11-18 19:21:30.542675] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.542684] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.542691] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13aae10) 00:23:11.982 [2024-11-18 19:21:30.542702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.982 [2024-11-18 19:21:30.542748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142b0b0, cid 4, qid 0 00:23:11.982 [2024-11-18 19:21:30.542883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.982 [2024-11-18 19:21:30.542897] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.982 [2024-11-18 19:21:30.542904] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.542911] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13aae10): datao=0, datal=3072, cccid=4 00:23:11.982 [2024-11-18 19:21:30.542919] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x142b0b0) on tqpair(0x13aae10): expected_datao=0, payload_size=3072 00:23:11.982 [2024-11-18 19:21:30.542942] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.542951] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.543031] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:11.982 [2024-11-18 19:21:30.543043] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:11.982 [2024-11-18 19:21:30.543050] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.543056] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142b0b0) on tqpair=0x13aae10 00:23:11.982 [2024-11-18 19:21:30.543073] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.543086] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.543094] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x13aae10) 00:23:11.982 [2024-11-18 19:21:30.543105] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:11.982 [2024-11-18 19:21:30.543133] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142b0b0, cid 4, qid 0 00:23:11.982 [2024-11-18 19:21:30.543231] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:11.982 [2024-11-18 19:21:30.543245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:11.982 [2024-11-18 19:21:30.543252] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.543258] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x13aae10): datao=0, datal=8, cccid=4 00:23:11.982 [2024-11-18 19:21:30.543266] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x142b0b0) on tqpair(0x13aae10): expected_datao=0, payload_size=8 00:23:11.982 [2024-11-18 19:21:30.543276] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:11.982 [2024-11-18 19:21:30.543284] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.246 [2024-11-18 19:21:30.583703] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.246 [2024-11-18 19:21:30.583722] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.246 [2024-11-18 19:21:30.583730] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.246 [2024-11-18 19:21:30.583737] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142b0b0) on tqpair=0x13aae10 00:23:12.246 ===================================================== 00:23:12.246 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:12.246 ===================================================== 00:23:12.246 Controller Capabilities/Features 00:23:12.246 ================================ 00:23:12.246 Vendor ID: 0000 00:23:12.246 Subsystem Vendor ID: 0000 00:23:12.246 Serial Number: .................... 00:23:12.246 Model Number: ........................................ 00:23:12.246 Firmware Version: 24.01.1 00:23:12.246 Recommended Arb Burst: 0 00:23:12.246 IEEE OUI Identifier: 00 00 00 00:23:12.246 Multi-path I/O 00:23:12.246 May have multiple subsystem ports: No 00:23:12.246 May have multiple controllers: No 00:23:12.246 Associated with SR-IOV VF: No 00:23:12.246 Max Data Transfer Size: 131072 00:23:12.246 Max Number of Namespaces: 0 00:23:12.246 Max Number of I/O Queues: 1024 00:23:12.246 NVMe Specification Version (VS): 1.3 00:23:12.246 NVMe Specification Version (Identify): 1.3 00:23:12.246 Maximum Queue Entries: 128 00:23:12.246 Contiguous Queues Required: Yes 00:23:12.246 Arbitration Mechanisms Supported 00:23:12.246 Weighted Round Robin: Not Supported 00:23:12.246 Vendor Specific: Not Supported 00:23:12.246 Reset Timeout: 15000 ms 00:23:12.246 Doorbell Stride: 4 bytes 00:23:12.246 NVM Subsystem Reset: Not Supported 00:23:12.246 Command Sets Supported 00:23:12.246 NVM Command Set: Supported 00:23:12.246 Boot Partition: Not Supported 00:23:12.246 Memory Page Size Minimum: 4096 bytes 00:23:12.246 Memory Page Size Maximum: 4096 bytes 00:23:12.246 Persistent Memory Region: Not Supported 00:23:12.246 Optional Asynchronous Events Supported 00:23:12.246 Namespace Attribute Notices: Not Supported 00:23:12.246 Firmware Activation Notices: Not Supported 00:23:12.246 ANA Change Notices: Not Supported 00:23:12.246 PLE Aggregate Log Change Notices: Not Supported 00:23:12.246 LBA Status Info Alert Notices: Not Supported 00:23:12.246 EGE Aggregate Log Change Notices: Not Supported 00:23:12.246 Normal NVM Subsystem Shutdown event: Not Supported 00:23:12.246 Zone Descriptor Change Notices: Not Supported 00:23:12.246 Discovery Log Change Notices: Supported 00:23:12.246 Controller Attributes 00:23:12.246 128-bit Host Identifier: Not Supported 00:23:12.246 Non-Operational Permissive Mode: Not Supported 00:23:12.246 NVM Sets: Not Supported 00:23:12.246 Read Recovery Levels: Not Supported 00:23:12.246 Endurance Groups: Not Supported 00:23:12.246 Predictable Latency Mode: Not Supported 00:23:12.246 Traffic Based Keep ALive: Not Supported 00:23:12.246 Namespace Granularity: Not Supported 00:23:12.246 SQ Associations: Not Supported 00:23:12.246 UUID List: Not Supported 00:23:12.246 Multi-Domain Subsystem: Not Supported 00:23:12.246 Fixed Capacity Management: Not Supported 00:23:12.246 Variable Capacity Management: Not Supported 00:23:12.246 Delete Endurance Group: Not Supported 00:23:12.246 Delete NVM Set: Not Supported 00:23:12.246 Extended LBA Formats Supported: Not Supported 00:23:12.246 Flexible Data Placement Supported: Not Supported 00:23:12.246 00:23:12.246 Controller Memory Buffer Support 00:23:12.246 ================================ 00:23:12.246 Supported: No 00:23:12.246 00:23:12.246 Persistent Memory Region Support 00:23:12.246 ================================ 00:23:12.246 Supported: No 00:23:12.246 00:23:12.246 Admin Command Set Attributes 00:23:12.246 ============================ 00:23:12.246 Security Send/Receive: Not Supported 00:23:12.246 Format NVM: Not Supported 00:23:12.246 Firmware Activate/Download: Not Supported 00:23:12.246 Namespace Management: Not Supported 00:23:12.246 Device Self-Test: Not Supported 00:23:12.246 Directives: Not Supported 00:23:12.246 NVMe-MI: Not Supported 00:23:12.246 Virtualization Management: Not Supported 00:23:12.246 Doorbell Buffer Config: Not Supported 00:23:12.246 Get LBA Status Capability: Not Supported 00:23:12.246 Command & Feature Lockdown Capability: Not Supported 00:23:12.246 Abort Command Limit: 1 00:23:12.246 Async Event Request Limit: 4 00:23:12.246 Number of Firmware Slots: N/A 00:23:12.246 Firmware Slot 1 Read-Only: N/A 00:23:12.246 Firmware Activation Without Reset: N/A 00:23:12.246 Multiple Update Detection Support: N/A 00:23:12.246 Firmware Update Granularity: No Information Provided 00:23:12.246 Per-Namespace SMART Log: No 00:23:12.246 Asymmetric Namespace Access Log Page: Not Supported 00:23:12.246 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:12.246 Command Effects Log Page: Not Supported 00:23:12.246 Get Log Page Extended Data: Supported 00:23:12.246 Telemetry Log Pages: Not Supported 00:23:12.246 Persistent Event Log Pages: Not Supported 00:23:12.246 Supported Log Pages Log Page: May Support 00:23:12.246 Commands Supported & Effects Log Page: Not Supported 00:23:12.246 Feature Identifiers & Effects Log Page:May Support 00:23:12.246 NVMe-MI Commands & Effects Log Page: May Support 00:23:12.246 Data Area 4 for Telemetry Log: Not Supported 00:23:12.246 Error Log Page Entries Supported: 128 00:23:12.246 Keep Alive: Not Supported 00:23:12.246 00:23:12.246 NVM Command Set Attributes 00:23:12.246 ========================== 00:23:12.246 Submission Queue Entry Size 00:23:12.246 Max: 1 00:23:12.246 Min: 1 00:23:12.246 Completion Queue Entry Size 00:23:12.247 Max: 1 00:23:12.247 Min: 1 00:23:12.247 Number of Namespaces: 0 00:23:12.247 Compare Command: Not Supported 00:23:12.247 Write Uncorrectable Command: Not Supported 00:23:12.247 Dataset Management Command: Not Supported 00:23:12.247 Write Zeroes Command: Not Supported 00:23:12.247 Set Features Save Field: Not Supported 00:23:12.247 Reservations: Not Supported 00:23:12.247 Timestamp: Not Supported 00:23:12.247 Copy: Not Supported 00:23:12.247 Volatile Write Cache: Not Present 00:23:12.247 Atomic Write Unit (Normal): 1 00:23:12.247 Atomic Write Unit (PFail): 1 00:23:12.247 Atomic Compare & Write Unit: 1 00:23:12.247 Fused Compare & Write: Supported 00:23:12.247 Scatter-Gather List 00:23:12.247 SGL Command Set: Supported 00:23:12.247 SGL Keyed: Supported 00:23:12.247 SGL Bit Bucket Descriptor: Not Supported 00:23:12.247 SGL Metadata Pointer: Not Supported 00:23:12.247 Oversized SGL: Not Supported 00:23:12.247 SGL Metadata Address: Not Supported 00:23:12.247 SGL Offset: Supported 00:23:12.247 Transport SGL Data Block: Not Supported 00:23:12.247 Replay Protected Memory Block: Not Supported 00:23:12.247 00:23:12.247 Firmware Slot Information 00:23:12.247 ========================= 00:23:12.247 Active slot: 0 00:23:12.247 00:23:12.247 00:23:12.247 Error Log 00:23:12.247 ========= 00:23:12.247 00:23:12.247 Active Namespaces 00:23:12.247 ================= 00:23:12.247 Discovery Log Page 00:23:12.247 ================== 00:23:12.247 Generation Counter: 2 00:23:12.247 Number of Records: 2 00:23:12.247 Record Format: 0 00:23:12.247 00:23:12.247 Discovery Log Entry 0 00:23:12.247 ---------------------- 00:23:12.247 Transport Type: 3 (TCP) 00:23:12.247 Address Family: 1 (IPv4) 00:23:12.247 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:12.247 Entry Flags: 00:23:12.247 Duplicate Returned Information: 1 00:23:12.247 Explicit Persistent Connection Support for Discovery: 1 00:23:12.247 Transport Requirements: 00:23:12.247 Secure Channel: Not Required 00:23:12.247 Port ID: 0 (0x0000) 00:23:12.247 Controller ID: 65535 (0xffff) 00:23:12.247 Admin Max SQ Size: 128 00:23:12.247 Transport Service Identifier: 4420 00:23:12.247 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:12.247 Transport Address: 10.0.0.2 00:23:12.247 Discovery Log Entry 1 00:23:12.247 ---------------------- 00:23:12.247 Transport Type: 3 (TCP) 00:23:12.247 Address Family: 1 (IPv4) 00:23:12.247 Subsystem Type: 2 (NVM Subsystem) 00:23:12.247 Entry Flags: 00:23:12.247 Duplicate Returned Information: 0 00:23:12.247 Explicit Persistent Connection Support for Discovery: 0 00:23:12.247 Transport Requirements: 00:23:12.247 Secure Channel: Not Required 00:23:12.247 Port ID: 0 (0x0000) 00:23:12.247 Controller ID: 65535 (0xffff) 00:23:12.247 Admin Max SQ Size: 128 00:23:12.247 Transport Service Identifier: 4420 00:23:12.247 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:12.247 Transport Address: 10.0.0.2 [2024-11-18 19:21:30.583852] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:12.247 [2024-11-18 19:21:30.583879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.247 [2024-11-18 19:21:30.583892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.247 [2024-11-18 19:21:30.583901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.247 [2024-11-18 19:21:30.583911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.247 [2024-11-18 19:21:30.583924] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.583932] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.583939] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.247 [2024-11-18 19:21:30.583950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.247 [2024-11-18 19:21:30.583991] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.247 [2024-11-18 19:21:30.584126] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.247 [2024-11-18 19:21:30.584141] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.247 [2024-11-18 19:21:30.584148] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584155] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.247 [2024-11-18 19:21:30.584169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.247 [2024-11-18 19:21:30.584194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.247 [2024-11-18 19:21:30.584220] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.247 [2024-11-18 19:21:30.584373] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.247 [2024-11-18 19:21:30.584386] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.247 [2024-11-18 19:21:30.584393] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584399] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.247 [2024-11-18 19:21:30.584409] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:12.247 [2024-11-18 19:21:30.584417] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:12.247 [2024-11-18 19:21:30.584433] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584442] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584448] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.247 [2024-11-18 19:21:30.584459] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.247 [2024-11-18 19:21:30.584480] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.247 [2024-11-18 19:21:30.584565] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.247 [2024-11-18 19:21:30.584579] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.247 [2024-11-18 19:21:30.584585] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584592] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.247 [2024-11-18 19:21:30.584618] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584629] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584636] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.247 [2024-11-18 19:21:30.584646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.247 [2024-11-18 19:21:30.584668] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.247 [2024-11-18 19:21:30.584758] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.247 [2024-11-18 19:21:30.584770] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.247 [2024-11-18 19:21:30.584777] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584783] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.247 [2024-11-18 19:21:30.584801] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.247 [2024-11-18 19:21:30.584810] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.584816] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.584827] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.584847] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.584923] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.584935] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.584942] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.584948] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.584965] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.584974] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.584980] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.584995] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.585016] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.585093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.585105] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.585112] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585118] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.585135] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585144] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585150] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.585161] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.585182] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.585264] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.585278] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.585285] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585291] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.585309] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585318] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585324] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.585335] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.585356] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.585459] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.585471] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.585477] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585484] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.585500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585509] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585516] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.585527] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.585547] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.585625] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.585639] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.585646] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585652] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.585669] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585679] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585685] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.585696] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.585720] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.585798] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.585810] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.585817] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585823] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.585840] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585849] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585855] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.585866] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.585886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.585964] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.585979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.585986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.585993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.586010] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586020] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.586037] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.586058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.586165] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.586178] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.586185] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586191] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.586209] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.586237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.586257] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.586334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.248 [2024-11-18 19:21:30.586350] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.248 [2024-11-18 19:21:30.586358] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586365] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.248 [2024-11-18 19:21:30.586382] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586391] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.248 [2024-11-18 19:21:30.586397] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.248 [2024-11-18 19:21:30.586408] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.248 [2024-11-18 19:21:30.586428] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.248 [2024-11-18 19:21:30.586515] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.586530] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.586536] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.586543] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.249 [2024-11-18 19:21:30.586560] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.586569] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.586575] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.249 [2024-11-18 19:21:30.586586] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.249 [2024-11-18 19:21:30.590615] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.249 [2024-11-18 19:21:30.590637] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.590663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.590670] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.590677] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.249 [2024-11-18 19:21:30.590697] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.590707] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.590713] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x13aae10) 00:23:12.249 [2024-11-18 19:21:30.590724] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.249 [2024-11-18 19:21:30.590746] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x142af50, cid 3, qid 0 00:23:12.249 [2024-11-18 19:21:30.590883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.590896] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.590903] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.590909] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x142af50) on tqpair=0x13aae10 00:23:12.249 [2024-11-18 19:21:30.590924] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:23:12.249 00:23:12.249 19:21:30 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:12.249 [2024-11-18 19:21:30.625575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:12.249 [2024-11-18 19:21:30.625641] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3518820 ] 00:23:12.249 EAL: No free 2048 kB hugepages reported on node 1 00:23:12.249 [2024-11-18 19:21:30.661339] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:12.249 [2024-11-18 19:21:30.661391] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:12.249 [2024-11-18 19:21:30.661401] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:12.249 [2024-11-18 19:21:30.661416] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:12.249 [2024-11-18 19:21:30.661427] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:12.249 [2024-11-18 19:21:30.668644] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:12.249 [2024-11-18 19:21:30.668693] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xc87e10 0 00:23:12.249 [2024-11-18 19:21:30.668830] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:12.249 [2024-11-18 19:21:30.668847] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:12.249 [2024-11-18 19:21:30.668854] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:12.249 [2024-11-18 19:21:30.668860] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:12.249 [2024-11-18 19:21:30.668898] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.668910] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.668917] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.249 [2024-11-18 19:21:30.668930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:12.249 [2024-11-18 19:21:30.668955] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.249 [2024-11-18 19:21:30.675620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.675639] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.675647] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.675654] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.249 [2024-11-18 19:21:30.675673] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:12.249 [2024-11-18 19:21:30.675684] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:12.249 [2024-11-18 19:21:30.675694] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:12.249 [2024-11-18 19:21:30.675711] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.675719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.675726] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.249 [2024-11-18 19:21:30.675737] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.249 [2024-11-18 19:21:30.675761] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.249 [2024-11-18 19:21:30.675899] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.675912] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.675919] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.675925] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.249 [2024-11-18 19:21:30.675933] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:12.249 [2024-11-18 19:21:30.675946] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:12.249 [2024-11-18 19:21:30.675959] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.675966] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.675972] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.249 [2024-11-18 19:21:30.675983] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.249 [2024-11-18 19:21:30.676004] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.249 [2024-11-18 19:21:30.676086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.676105] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.676113] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.676120] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.249 [2024-11-18 19:21:30.676128] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:12.249 [2024-11-18 19:21:30.676142] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:12.249 [2024-11-18 19:21:30.676154] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.676162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.676168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.249 [2024-11-18 19:21:30.676178] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.249 [2024-11-18 19:21:30.676199] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.249 [2024-11-18 19:21:30.676295] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.249 [2024-11-18 19:21:30.676309] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.249 [2024-11-18 19:21:30.676316] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.676322] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.249 [2024-11-18 19:21:30.676331] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:12.249 [2024-11-18 19:21:30.676351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.249 [2024-11-18 19:21:30.676360] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676366] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.250 [2024-11-18 19:21:30.676377] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.250 [2024-11-18 19:21:30.676397] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.250 [2024-11-18 19:21:30.676478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.250 [2024-11-18 19:21:30.676492] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.250 [2024-11-18 19:21:30.676499] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676506] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.250 [2024-11-18 19:21:30.676513] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:12.250 [2024-11-18 19:21:30.676522] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:12.250 [2024-11-18 19:21:30.676535] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:12.250 [2024-11-18 19:21:30.676644] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:12.250 [2024-11-18 19:21:30.676653] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:12.250 [2024-11-18 19:21:30.676665] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676672] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676679] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.250 [2024-11-18 19:21:30.676689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.250 [2024-11-18 19:21:30.676715] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.250 [2024-11-18 19:21:30.676846] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.250 [2024-11-18 19:21:30.676858] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.250 [2024-11-18 19:21:30.676865] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676872] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.250 [2024-11-18 19:21:30.676880] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:12.250 [2024-11-18 19:21:30.676896] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676905] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.676911] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.250 [2024-11-18 19:21:30.676921] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.250 [2024-11-18 19:21:30.676942] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.250 [2024-11-18 19:21:30.677069] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.250 [2024-11-18 19:21:30.677083] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.250 [2024-11-18 19:21:30.677090] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.677096] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.250 [2024-11-18 19:21:30.677104] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:12.250 [2024-11-18 19:21:30.677112] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:12.250 [2024-11-18 19:21:30.677125] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:12.250 [2024-11-18 19:21:30.677139] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:12.250 [2024-11-18 19:21:30.677153] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.677160] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.677167] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.250 [2024-11-18 19:21:30.677177] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.250 [2024-11-18 19:21:30.677198] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.250 [2024-11-18 19:21:30.677377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.250 [2024-11-18 19:21:30.677392] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.250 [2024-11-18 19:21:30.677399] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.677405] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=4096, cccid=0 00:23:12.250 [2024-11-18 19:21:30.677412] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd07b30) on tqpair(0xc87e10): expected_datao=0, payload_size=4096 00:23:12.250 [2024-11-18 19:21:30.677430] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.677440] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.717742] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.250 [2024-11-18 19:21:30.717762] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.250 [2024-11-18 19:21:30.717770] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.717781] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.250 [2024-11-18 19:21:30.717793] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:12.250 [2024-11-18 19:21:30.717802] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:12.250 [2024-11-18 19:21:30.717809] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:12.250 [2024-11-18 19:21:30.717816] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:12.250 [2024-11-18 19:21:30.717824] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:12.250 [2024-11-18 19:21:30.717832] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:12.250 [2024-11-18 19:21:30.717850] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:12.250 [2024-11-18 19:21:30.717864] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.717871] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.717878] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.250 [2024-11-18 19:21:30.717890] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:12.250 [2024-11-18 19:21:30.717913] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.250 [2024-11-18 19:21:30.717994] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.250 [2024-11-18 19:21:30.718009] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.250 [2024-11-18 19:21:30.718016] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.718023] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07b30) on tqpair=0xc87e10 00:23:12.250 [2024-11-18 19:21:30.718033] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.718040] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.718047] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xc87e10) 00:23:12.250 [2024-11-18 19:21:30.718057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.250 [2024-11-18 19:21:30.718068] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.718074] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.250 [2024-11-18 19:21:30.718080] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.718089] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.251 [2024-11-18 19:21:30.718099] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718106] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.718120] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.251 [2024-11-18 19:21:30.718130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718137] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718143] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.718152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.251 [2024-11-18 19:21:30.718161] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718183] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718196] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718204] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718210] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.718220] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.251 [2024-11-18 19:21:30.718243] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07b30, cid 0, qid 0 00:23:12.251 [2024-11-18 19:21:30.718254] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07c90, cid 1, qid 0 00:23:12.251 [2024-11-18 19:21:30.718262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07df0, cid 2, qid 0 00:23:12.251 [2024-11-18 19:21:30.718270] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.251 [2024-11-18 19:21:30.718277] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.251 [2024-11-18 19:21:30.718417] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.251 [2024-11-18 19:21:30.718431] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.251 [2024-11-18 19:21:30.718438] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718445] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.251 [2024-11-18 19:21:30.718453] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:12.251 [2024-11-18 19:21:30.718461] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718475] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718492] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718504] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718511] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718517] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.718528] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:12.251 [2024-11-18 19:21:30.718549] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.251 [2024-11-18 19:21:30.718684] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.251 [2024-11-18 19:21:30.718699] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.251 [2024-11-18 19:21:30.718706] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718712] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.251 [2024-11-18 19:21:30.718778] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718797] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.718812] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718819] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.718825] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.718840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.251 [2024-11-18 19:21:30.718862] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.251 [2024-11-18 19:21:30.719006] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.251 [2024-11-18 19:21:30.719019] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.251 [2024-11-18 19:21:30.719026] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719032] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=4096, cccid=4 00:23:12.251 [2024-11-18 19:21:30.719039] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd080b0) on tqpair(0xc87e10): expected_datao=0, payload_size=4096 00:23:12.251 [2024-11-18 19:21:30.719051] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719058] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719070] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.251 [2024-11-18 19:21:30.719080] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.251 [2024-11-18 19:21:30.719086] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719093] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.251 [2024-11-18 19:21:30.719115] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:12.251 [2024-11-18 19:21:30.719137] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.719155] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:12.251 [2024-11-18 19:21:30.719169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.251 [2024-11-18 19:21:30.719193] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.251 [2024-11-18 19:21:30.719215] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.251 [2024-11-18 19:21:30.719324] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.251 [2024-11-18 19:21:30.719339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.251 [2024-11-18 19:21:30.719346] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719352] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=4096, cccid=4 00:23:12.251 [2024-11-18 19:21:30.719360] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd080b0) on tqpair(0xc87e10): expected_datao=0, payload_size=4096 00:23:12.251 [2024-11-18 19:21:30.719370] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.251 [2024-11-18 19:21:30.719378] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719390] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.719400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.719406] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719413] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.719438] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719458] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719476] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719491] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.719501] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.719522] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.252 [2024-11-18 19:21:30.719628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.252 [2024-11-18 19:21:30.719644] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.252 [2024-11-18 19:21:30.719650] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719657] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=4096, cccid=4 00:23:12.252 [2024-11-18 19:21:30.719664] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd080b0) on tqpair(0xc87e10): expected_datao=0, payload_size=4096 00:23:12.252 [2024-11-18 19:21:30.719675] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719683] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719695] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.719705] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.719711] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719718] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.719732] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719747] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719764] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719775] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719784] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719793] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:12.252 [2024-11-18 19:21:30.719801] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:12.252 [2024-11-18 19:21:30.719809] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:12.252 [2024-11-18 19:21:30.719828] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719836] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719843] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.719853] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.719864] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719871] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.719878] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.719887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:12.252 [2024-11-18 19:21:30.719912] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.252 [2024-11-18 19:21:30.719927] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd08210, cid 5, qid 0 00:23:12.252 [2024-11-18 19:21:30.720041] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.720054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.720061] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.720067] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.720077] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.720086] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.720093] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.720099] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd08210) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.720114] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.720123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.720129] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.720140] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.720160] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd08210, cid 5, qid 0 00:23:12.252 [2024-11-18 19:21:30.723619] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.723636] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.723644] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.723650] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd08210) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.723668] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.723677] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.723684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.723694] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.723716] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd08210, cid 5, qid 0 00:23:12.252 [2024-11-18 19:21:30.723843] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.723856] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.723862] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.723869] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd08210) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.723884] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.723893] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.723900] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.723910] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.723931] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd08210, cid 5, qid 0 00:23:12.252 [2024-11-18 19:21:30.724019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.252 [2024-11-18 19:21:30.724033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.252 [2024-11-18 19:21:30.724040] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724046] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd08210) on tqpair=0xc87e10 00:23:12.252 [2024-11-18 19:21:30.724072] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724083] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724089] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.724100] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.724112] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724119] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724125] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.724135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.724147] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724154] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724160] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xc87e10) 00:23:12.252 [2024-11-18 19:21:30.724169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.252 [2024-11-18 19:21:30.724182] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724189] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.252 [2024-11-18 19:21:30.724195] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xc87e10) 00:23:12.253 [2024-11-18 19:21:30.724204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.253 [2024-11-18 19:21:30.724226] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd08210, cid 5, qid 0 00:23:12.253 [2024-11-18 19:21:30.724238] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd080b0, cid 4, qid 0 00:23:12.253 [2024-11-18 19:21:30.724246] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd08370, cid 6, qid 0 00:23:12.253 [2024-11-18 19:21:30.724253] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd084d0, cid 7, qid 0 00:23:12.253 [2024-11-18 19:21:30.724446] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.253 [2024-11-18 19:21:30.724462] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.253 [2024-11-18 19:21:30.724469] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724475] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=8192, cccid=5 00:23:12.253 [2024-11-18 19:21:30.724482] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd08210) on tqpair(0xc87e10): expected_datao=0, payload_size=8192 00:23:12.253 [2024-11-18 19:21:30.724505] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724515] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.253 [2024-11-18 19:21:30.724533] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.253 [2024-11-18 19:21:30.724539] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724545] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=512, cccid=4 00:23:12.253 [2024-11-18 19:21:30.724553] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd080b0) on tqpair(0xc87e10): expected_datao=0, payload_size=512 00:23:12.253 [2024-11-18 19:21:30.724563] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724570] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724579] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.253 [2024-11-18 19:21:30.724592] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.253 [2024-11-18 19:21:30.724599] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724605] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=512, cccid=6 00:23:12.253 [2024-11-18 19:21:30.724625] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd08370) on tqpair(0xc87e10): expected_datao=0, payload_size=512 00:23:12.253 [2024-11-18 19:21:30.724636] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724643] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724652] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:12.253 [2024-11-18 19:21:30.724660] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:12.253 [2024-11-18 19:21:30.724667] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724673] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xc87e10): datao=0, datal=4096, cccid=7 00:23:12.253 [2024-11-18 19:21:30.724680] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xd084d0) on tqpair(0xc87e10): expected_datao=0, payload_size=4096 00:23:12.253 [2024-11-18 19:21:30.724691] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724698] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724710] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.253 [2024-11-18 19:21:30.724720] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.253 [2024-11-18 19:21:30.724726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd08210) on tqpair=0xc87e10 00:23:12.253 [2024-11-18 19:21:30.724762] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.253 [2024-11-18 19:21:30.724774] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.253 [2024-11-18 19:21:30.724781] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724787] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd080b0) on tqpair=0xc87e10 00:23:12.253 [2024-11-18 19:21:30.724802] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.253 [2024-11-18 19:21:30.724812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.253 [2024-11-18 19:21:30.724819] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724825] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd08370) on tqpair=0xc87e10 00:23:12.253 [2024-11-18 19:21:30.724836] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.253 [2024-11-18 19:21:30.724846] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.253 [2024-11-18 19:21:30.724852] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.253 [2024-11-18 19:21:30.724859] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd084d0) on tqpair=0xc87e10 00:23:12.253 ===================================================== 00:23:12.253 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:12.253 ===================================================== 00:23:12.253 Controller Capabilities/Features 00:23:12.253 ================================ 00:23:12.253 Vendor ID: 8086 00:23:12.253 Subsystem Vendor ID: 8086 00:23:12.253 Serial Number: SPDK00000000000001 00:23:12.253 Model Number: SPDK bdev Controller 00:23:12.253 Firmware Version: 24.01.1 00:23:12.253 Recommended Arb Burst: 6 00:23:12.253 IEEE OUI Identifier: e4 d2 5c 00:23:12.253 Multi-path I/O 00:23:12.253 May have multiple subsystem ports: Yes 00:23:12.253 May have multiple controllers: Yes 00:23:12.253 Associated with SR-IOV VF: No 00:23:12.253 Max Data Transfer Size: 131072 00:23:12.253 Max Number of Namespaces: 32 00:23:12.253 Max Number of I/O Queues: 127 00:23:12.253 NVMe Specification Version (VS): 1.3 00:23:12.253 NVMe Specification Version (Identify): 1.3 00:23:12.253 Maximum Queue Entries: 128 00:23:12.253 Contiguous Queues Required: Yes 00:23:12.253 Arbitration Mechanisms Supported 00:23:12.253 Weighted Round Robin: Not Supported 00:23:12.253 Vendor Specific: Not Supported 00:23:12.253 Reset Timeout: 15000 ms 00:23:12.253 Doorbell Stride: 4 bytes 00:23:12.253 NVM Subsystem Reset: Not Supported 00:23:12.253 Command Sets Supported 00:23:12.253 NVM Command Set: Supported 00:23:12.253 Boot Partition: Not Supported 00:23:12.253 Memory Page Size Minimum: 4096 bytes 00:23:12.253 Memory Page Size Maximum: 4096 bytes 00:23:12.253 Persistent Memory Region: Not Supported 00:23:12.253 Optional Asynchronous Events Supported 00:23:12.253 Namespace Attribute Notices: Supported 00:23:12.253 Firmware Activation Notices: Not Supported 00:23:12.253 ANA Change Notices: Not Supported 00:23:12.253 PLE Aggregate Log Change Notices: Not Supported 00:23:12.253 LBA Status Info Alert Notices: Not Supported 00:23:12.253 EGE Aggregate Log Change Notices: Not Supported 00:23:12.253 Normal NVM Subsystem Shutdown event: Not Supported 00:23:12.253 Zone Descriptor Change Notices: Not Supported 00:23:12.253 Discovery Log Change Notices: Not Supported 00:23:12.253 Controller Attributes 00:23:12.253 128-bit Host Identifier: Supported 00:23:12.253 Non-Operational Permissive Mode: Not Supported 00:23:12.253 NVM Sets: Not Supported 00:23:12.253 Read Recovery Levels: Not Supported 00:23:12.253 Endurance Groups: Not Supported 00:23:12.253 Predictable Latency Mode: Not Supported 00:23:12.253 Traffic Based Keep ALive: Not Supported 00:23:12.253 Namespace Granularity: Not Supported 00:23:12.253 SQ Associations: Not Supported 00:23:12.253 UUID List: Not Supported 00:23:12.253 Multi-Domain Subsystem: Not Supported 00:23:12.253 Fixed Capacity Management: Not Supported 00:23:12.253 Variable Capacity Management: Not Supported 00:23:12.253 Delete Endurance Group: Not Supported 00:23:12.253 Delete NVM Set: Not Supported 00:23:12.253 Extended LBA Formats Supported: Not Supported 00:23:12.253 Flexible Data Placement Supported: Not Supported 00:23:12.253 00:23:12.253 Controller Memory Buffer Support 00:23:12.253 ================================ 00:23:12.253 Supported: No 00:23:12.253 00:23:12.253 Persistent Memory Region Support 00:23:12.254 ================================ 00:23:12.254 Supported: No 00:23:12.254 00:23:12.254 Admin Command Set Attributes 00:23:12.254 ============================ 00:23:12.254 Security Send/Receive: Not Supported 00:23:12.254 Format NVM: Not Supported 00:23:12.254 Firmware Activate/Download: Not Supported 00:23:12.254 Namespace Management: Not Supported 00:23:12.254 Device Self-Test: Not Supported 00:23:12.254 Directives: Not Supported 00:23:12.254 NVMe-MI: Not Supported 00:23:12.254 Virtualization Management: Not Supported 00:23:12.254 Doorbell Buffer Config: Not Supported 00:23:12.254 Get LBA Status Capability: Not Supported 00:23:12.254 Command & Feature Lockdown Capability: Not Supported 00:23:12.254 Abort Command Limit: 4 00:23:12.254 Async Event Request Limit: 4 00:23:12.254 Number of Firmware Slots: N/A 00:23:12.254 Firmware Slot 1 Read-Only: N/A 00:23:12.254 Firmware Activation Without Reset: N/A 00:23:12.254 Multiple Update Detection Support: N/A 00:23:12.254 Firmware Update Granularity: No Information Provided 00:23:12.254 Per-Namespace SMART Log: No 00:23:12.254 Asymmetric Namespace Access Log Page: Not Supported 00:23:12.254 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:12.254 Command Effects Log Page: Supported 00:23:12.254 Get Log Page Extended Data: Supported 00:23:12.254 Telemetry Log Pages: Not Supported 00:23:12.254 Persistent Event Log Pages: Not Supported 00:23:12.254 Supported Log Pages Log Page: May Support 00:23:12.254 Commands Supported & Effects Log Page: Not Supported 00:23:12.254 Feature Identifiers & Effects Log Page:May Support 00:23:12.254 NVMe-MI Commands & Effects Log Page: May Support 00:23:12.254 Data Area 4 for Telemetry Log: Not Supported 00:23:12.254 Error Log Page Entries Supported: 128 00:23:12.254 Keep Alive: Supported 00:23:12.254 Keep Alive Granularity: 10000 ms 00:23:12.254 00:23:12.254 NVM Command Set Attributes 00:23:12.254 ========================== 00:23:12.254 Submission Queue Entry Size 00:23:12.254 Max: 64 00:23:12.254 Min: 64 00:23:12.254 Completion Queue Entry Size 00:23:12.254 Max: 16 00:23:12.254 Min: 16 00:23:12.254 Number of Namespaces: 32 00:23:12.254 Compare Command: Supported 00:23:12.254 Write Uncorrectable Command: Not Supported 00:23:12.254 Dataset Management Command: Supported 00:23:12.254 Write Zeroes Command: Supported 00:23:12.254 Set Features Save Field: Not Supported 00:23:12.254 Reservations: Supported 00:23:12.254 Timestamp: Not Supported 00:23:12.254 Copy: Supported 00:23:12.254 Volatile Write Cache: Present 00:23:12.254 Atomic Write Unit (Normal): 1 00:23:12.254 Atomic Write Unit (PFail): 1 00:23:12.254 Atomic Compare & Write Unit: 1 00:23:12.254 Fused Compare & Write: Supported 00:23:12.254 Scatter-Gather List 00:23:12.254 SGL Command Set: Supported 00:23:12.254 SGL Keyed: Supported 00:23:12.254 SGL Bit Bucket Descriptor: Not Supported 00:23:12.254 SGL Metadata Pointer: Not Supported 00:23:12.254 Oversized SGL: Not Supported 00:23:12.254 SGL Metadata Address: Not Supported 00:23:12.254 SGL Offset: Supported 00:23:12.254 Transport SGL Data Block: Not Supported 00:23:12.254 Replay Protected Memory Block: Not Supported 00:23:12.254 00:23:12.254 Firmware Slot Information 00:23:12.254 ========================= 00:23:12.254 Active slot: 1 00:23:12.254 Slot 1 Firmware Revision: 24.01.1 00:23:12.254 00:23:12.254 00:23:12.254 Commands Supported and Effects 00:23:12.254 ============================== 00:23:12.254 Admin Commands 00:23:12.254 -------------- 00:23:12.254 Get Log Page (02h): Supported 00:23:12.254 Identify (06h): Supported 00:23:12.254 Abort (08h): Supported 00:23:12.254 Set Features (09h): Supported 00:23:12.254 Get Features (0Ah): Supported 00:23:12.254 Asynchronous Event Request (0Ch): Supported 00:23:12.254 Keep Alive (18h): Supported 00:23:12.254 I/O Commands 00:23:12.254 ------------ 00:23:12.254 Flush (00h): Supported LBA-Change 00:23:12.254 Write (01h): Supported LBA-Change 00:23:12.254 Read (02h): Supported 00:23:12.254 Compare (05h): Supported 00:23:12.254 Write Zeroes (08h): Supported LBA-Change 00:23:12.254 Dataset Management (09h): Supported LBA-Change 00:23:12.254 Copy (19h): Supported LBA-Change 00:23:12.254 Unknown (79h): Supported LBA-Change 00:23:12.254 Unknown (7Ah): Supported 00:23:12.254 00:23:12.254 Error Log 00:23:12.254 ========= 00:23:12.254 00:23:12.254 Arbitration 00:23:12.254 =========== 00:23:12.254 Arbitration Burst: 1 00:23:12.254 00:23:12.254 Power Management 00:23:12.254 ================ 00:23:12.254 Number of Power States: 1 00:23:12.254 Current Power State: Power State #0 00:23:12.254 Power State #0: 00:23:12.254 Max Power: 0.00 W 00:23:12.254 Non-Operational State: Operational 00:23:12.254 Entry Latency: Not Reported 00:23:12.254 Exit Latency: Not Reported 00:23:12.254 Relative Read Throughput: 0 00:23:12.254 Relative Read Latency: 0 00:23:12.254 Relative Write Throughput: 0 00:23:12.254 Relative Write Latency: 0 00:23:12.254 Idle Power: Not Reported 00:23:12.254 Active Power: Not Reported 00:23:12.254 Non-Operational Permissive Mode: Not Supported 00:23:12.254 00:23:12.254 Health Information 00:23:12.254 ================== 00:23:12.254 Critical Warnings: 00:23:12.254 Available Spare Space: OK 00:23:12.254 Temperature: OK 00:23:12.254 Device Reliability: OK 00:23:12.254 Read Only: No 00:23:12.254 Volatile Memory Backup: OK 00:23:12.254 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:12.254 Temperature Threshold: [2024-11-18 19:21:30.724994] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725005] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725012] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xc87e10) 00:23:12.254 [2024-11-18 19:21:30.725022] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.254 [2024-11-18 19:21:30.725045] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd084d0, cid 7, qid 0 00:23:12.254 [2024-11-18 19:21:30.725175] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.254 [2024-11-18 19:21:30.725190] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.254 [2024-11-18 19:21:30.725197] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725204] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd084d0) on tqpair=0xc87e10 00:23:12.254 [2024-11-18 19:21:30.725247] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:12.254 [2024-11-18 19:21:30.725269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.254 [2024-11-18 19:21:30.725282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.254 [2024-11-18 19:21:30.725291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.254 [2024-11-18 19:21:30.725300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:12.254 [2024-11-18 19:21:30.725312] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725320] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725326] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.254 [2024-11-18 19:21:30.725336] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.254 [2024-11-18 19:21:30.725358] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.254 [2024-11-18 19:21:30.725474] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.254 [2024-11-18 19:21:30.725488] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.254 [2024-11-18 19:21:30.725495] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725501] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.254 [2024-11-18 19:21:30.725512] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725519] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.254 [2024-11-18 19:21:30.725526] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.725536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.725561] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.725668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.725682] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.725689] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.725695] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.725703] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:12.255 [2024-11-18 19:21:30.725711] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:12.255 [2024-11-18 19:21:30.725726] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.725735] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.725742] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.725752] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.725773] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.725867] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.725882] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.725888] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.725895] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.725915] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.725925] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.725931] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.725942] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.725963] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.726042] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.726054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.726060] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726067] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.726083] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726092] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726098] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.726108] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.726128] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.726201] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.726213] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.726219] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726226] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.726242] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726251] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726257] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.726267] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.726287] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.726364] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.726378] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.726385] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726392] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.726408] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726417] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726423] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.726434] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.726454] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.726532] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.726546] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.726552] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726559] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.726575] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726588] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726595] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.726614] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.726637] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.726723] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.726735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.726741] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726748] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.726764] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726773] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726779] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.726789] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.726810] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.726888] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.726902] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.726909] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726916] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.726932] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726941] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.726947] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.726958] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.726979] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.727054] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.727067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.727073] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.727080] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.727095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.727104] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.727110] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.255 [2024-11-18 19:21:30.727121] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.255 [2024-11-18 19:21:30.727141] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.255 [2024-11-18 19:21:30.727216] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.255 [2024-11-18 19:21:30.727228] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.255 [2024-11-18 19:21:30.727235] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.727241] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.255 [2024-11-18 19:21:30.727257] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.727266] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.255 [2024-11-18 19:21:30.727276] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.727287] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.727307] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.727385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.727399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.727406] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.727428] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727438] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727444] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.727454] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.727475] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.727556] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.727569] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.727576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727583] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.727598] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727613] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727620] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.727631] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.727652] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.727743] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.727757] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.727764] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727771] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.727787] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727796] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727802] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.727813] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.727833] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.727914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.727928] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.727934] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727941] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.727957] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727966] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.727973] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.727987] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.728009] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.728086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.728100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.728107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.728130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728139] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728145] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.728156] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.728176] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.728251] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.728265] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.728272] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728279] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.728295] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728310] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.728321] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.728341] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.728415] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.728429] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.728436] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728442] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.728459] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728468] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.728474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.728485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.728505] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.728582] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.728596] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.728603] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.732623] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.732645] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.732655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.732662] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xc87e10) 00:23:12.256 [2024-11-18 19:21:30.732672] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:12.256 [2024-11-18 19:21:30.732700] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xd07f50, cid 3, qid 0 00:23:12.256 [2024-11-18 19:21:30.732818] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:12.256 [2024-11-18 19:21:30.732832] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:12.256 [2024-11-18 19:21:30.732839] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:12.256 [2024-11-18 19:21:30.732846] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xd07f50) on tqpair=0xc87e10 00:23:12.256 [2024-11-18 19:21:30.732859] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 7 milliseconds 00:23:12.256 0 Kelvin (-273 Celsius) 00:23:12.256 Available Spare: 0% 00:23:12.256 Available Spare Threshold: 0% 00:23:12.256 Life Percentage Used: 0% 00:23:12.256 Data Units Read: 0 00:23:12.256 Data Units Written: 0 00:23:12.256 Host Read Commands: 0 00:23:12.256 Host Write Commands: 0 00:23:12.256 Controller Busy Time: 0 minutes 00:23:12.256 Power Cycles: 0 00:23:12.256 Power On Hours: 0 hours 00:23:12.256 Unsafe Shutdowns: 0 00:23:12.256 Unrecoverable Media Errors: 0 00:23:12.256 Lifetime Error Log Entries: 0 00:23:12.256 Warning Temperature Time: 0 minutes 00:23:12.256 Critical Temperature Time: 0 minutes 00:23:12.256 00:23:12.256 Number of Queues 00:23:12.256 ================ 00:23:12.256 Number of I/O Submission Queues: 127 00:23:12.256 Number of I/O Completion Queues: 127 00:23:12.256 00:23:12.256 Active Namespaces 00:23:12.256 ================= 00:23:12.256 Namespace ID:1 00:23:12.256 Error Recovery Timeout: Unlimited 00:23:12.256 Command Set Identifier: NVM (00h) 00:23:12.256 Deallocate: Supported 00:23:12.256 Deallocated/Unwritten Error: Not Supported 00:23:12.256 Deallocated Read Value: Unknown 00:23:12.256 Deallocate in Write Zeroes: Not Supported 00:23:12.256 Deallocated Guard Field: 0xFFFF 00:23:12.256 Flush: Supported 00:23:12.257 Reservation: Supported 00:23:12.257 Namespace Sharing Capabilities: Multiple Controllers 00:23:12.257 Size (in LBAs): 131072 (0GiB) 00:23:12.257 Capacity (in LBAs): 131072 (0GiB) 00:23:12.257 Utilization (in LBAs): 131072 (0GiB) 00:23:12.257 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:12.257 EUI64: ABCDEF0123456789 00:23:12.257 UUID: b4c5b1e8-e0e1-48f1-bc67-d326e8afdb2f 00:23:12.257 Thin Provisioning: Not Supported 00:23:12.257 Per-NS Atomic Units: Yes 00:23:12.257 Atomic Boundary Size (Normal): 0 00:23:12.257 Atomic Boundary Size (PFail): 0 00:23:12.257 Atomic Boundary Offset: 0 00:23:12.257 Maximum Single Source Range Length: 65535 00:23:12.257 Maximum Copy Length: 65535 00:23:12.257 Maximum Source Range Count: 1 00:23:12.257 NGUID/EUI64 Never Reused: No 00:23:12.257 Namespace Write Protected: No 00:23:12.257 Number of LBA Formats: 1 00:23:12.257 Current LBA Format: LBA Format #00 00:23:12.257 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:12.257 00:23:12.257 19:21:30 -- host/identify.sh@51 -- # sync 00:23:12.257 19:21:30 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.257 19:21:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.257 19:21:30 -- common/autotest_common.sh@10 -- # set +x 00:23:12.257 19:21:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.257 19:21:30 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:12.257 19:21:30 -- host/identify.sh@56 -- # nvmftestfini 00:23:12.257 19:21:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:12.257 19:21:30 -- nvmf/common.sh@116 -- # sync 00:23:12.257 19:21:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:12.257 19:21:30 -- nvmf/common.sh@119 -- # set +e 00:23:12.257 19:21:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:12.257 19:21:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:12.257 rmmod nvme_tcp 00:23:12.257 rmmod nvme_fabrics 00:23:12.257 rmmod nvme_keyring 00:23:12.257 19:21:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:12.257 19:21:30 -- nvmf/common.sh@123 -- # set -e 00:23:12.257 19:21:30 -- nvmf/common.sh@124 -- # return 0 00:23:12.257 19:21:30 -- nvmf/common.sh@477 -- # '[' -n 3518625 ']' 00:23:12.257 19:21:30 -- nvmf/common.sh@478 -- # killprocess 3518625 00:23:12.257 19:21:30 -- common/autotest_common.sh@936 -- # '[' -z 3518625 ']' 00:23:12.257 19:21:30 -- common/autotest_common.sh@940 -- # kill -0 3518625 00:23:12.257 19:21:30 -- common/autotest_common.sh@941 -- # uname 00:23:12.257 19:21:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:12.257 19:21:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3518625 00:23:12.515 19:21:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:12.515 19:21:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:12.515 19:21:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3518625' 00:23:12.515 killing process with pid 3518625 00:23:12.515 19:21:30 -- common/autotest_common.sh@955 -- # kill 3518625 00:23:12.515 [2024-11-18 19:21:30.860977] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:12.515 19:21:30 -- common/autotest_common.sh@960 -- # wait 3518625 00:23:12.773 19:21:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:12.773 19:21:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:12.773 19:21:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:12.773 19:21:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:12.773 19:21:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:12.773 19:21:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:12.773 19:21:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:12.773 19:21:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.672 19:21:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:14.672 00:23:14.672 real 0m6.364s 00:23:14.672 user 0m7.457s 00:23:14.672 sys 0m2.007s 00:23:14.672 19:21:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:14.672 19:21:33 -- common/autotest_common.sh@10 -- # set +x 00:23:14.672 ************************************ 00:23:14.672 END TEST nvmf_identify 00:23:14.672 ************************************ 00:23:14.672 19:21:33 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:14.672 19:21:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:14.672 19:21:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:14.672 19:21:33 -- common/autotest_common.sh@10 -- # set +x 00:23:14.672 ************************************ 00:23:14.672 START TEST nvmf_perf 00:23:14.672 ************************************ 00:23:14.672 19:21:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:14.931 * Looking for test storage... 00:23:14.931 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:14.931 19:21:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:14.931 19:21:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:14.931 19:21:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:14.931 19:21:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:14.931 19:21:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:14.931 19:21:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:14.931 19:21:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:14.931 19:21:33 -- scripts/common.sh@335 -- # IFS=.-: 00:23:14.931 19:21:33 -- scripts/common.sh@335 -- # read -ra ver1 00:23:14.931 19:21:33 -- scripts/common.sh@336 -- # IFS=.-: 00:23:14.931 19:21:33 -- scripts/common.sh@336 -- # read -ra ver2 00:23:14.931 19:21:33 -- scripts/common.sh@337 -- # local 'op=<' 00:23:14.931 19:21:33 -- scripts/common.sh@339 -- # ver1_l=2 00:23:14.931 19:21:33 -- scripts/common.sh@340 -- # ver2_l=1 00:23:14.931 19:21:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:14.931 19:21:33 -- scripts/common.sh@343 -- # case "$op" in 00:23:14.931 19:21:33 -- scripts/common.sh@344 -- # : 1 00:23:14.931 19:21:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:14.931 19:21:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:14.931 19:21:33 -- scripts/common.sh@364 -- # decimal 1 00:23:14.931 19:21:33 -- scripts/common.sh@352 -- # local d=1 00:23:14.931 19:21:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:14.931 19:21:33 -- scripts/common.sh@354 -- # echo 1 00:23:14.931 19:21:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:14.931 19:21:33 -- scripts/common.sh@365 -- # decimal 2 00:23:14.931 19:21:33 -- scripts/common.sh@352 -- # local d=2 00:23:14.931 19:21:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:14.931 19:21:33 -- scripts/common.sh@354 -- # echo 2 00:23:14.931 19:21:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:14.931 19:21:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:14.931 19:21:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:14.931 19:21:33 -- scripts/common.sh@367 -- # return 0 00:23:14.931 19:21:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:14.931 19:21:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:14.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.931 --rc genhtml_branch_coverage=1 00:23:14.931 --rc genhtml_function_coverage=1 00:23:14.931 --rc genhtml_legend=1 00:23:14.931 --rc geninfo_all_blocks=1 00:23:14.931 --rc geninfo_unexecuted_blocks=1 00:23:14.931 00:23:14.931 ' 00:23:14.931 19:21:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:14.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.931 --rc genhtml_branch_coverage=1 00:23:14.931 --rc genhtml_function_coverage=1 00:23:14.931 --rc genhtml_legend=1 00:23:14.931 --rc geninfo_all_blocks=1 00:23:14.931 --rc geninfo_unexecuted_blocks=1 00:23:14.931 00:23:14.931 ' 00:23:14.931 19:21:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:14.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.931 --rc genhtml_branch_coverage=1 00:23:14.931 --rc genhtml_function_coverage=1 00:23:14.931 --rc genhtml_legend=1 00:23:14.931 --rc geninfo_all_blocks=1 00:23:14.931 --rc geninfo_unexecuted_blocks=1 00:23:14.931 00:23:14.931 ' 00:23:14.931 19:21:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:14.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:14.931 --rc genhtml_branch_coverage=1 00:23:14.931 --rc genhtml_function_coverage=1 00:23:14.931 --rc genhtml_legend=1 00:23:14.931 --rc geninfo_all_blocks=1 00:23:14.931 --rc geninfo_unexecuted_blocks=1 00:23:14.931 00:23:14.931 ' 00:23:14.931 19:21:33 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:14.931 19:21:33 -- nvmf/common.sh@7 -- # uname -s 00:23:14.931 19:21:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:14.931 19:21:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:14.931 19:21:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:14.931 19:21:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:14.931 19:21:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:14.931 19:21:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:14.931 19:21:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:14.931 19:21:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:14.931 19:21:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:14.931 19:21:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:14.931 19:21:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.931 19:21:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:14.931 19:21:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:14.931 19:21:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:14.931 19:21:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:14.931 19:21:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:14.931 19:21:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:14.931 19:21:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:14.931 19:21:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:14.931 19:21:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.931 19:21:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.931 19:21:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.931 19:21:33 -- paths/export.sh@5 -- # export PATH 00:23:14.931 19:21:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:14.931 19:21:33 -- nvmf/common.sh@46 -- # : 0 00:23:14.931 19:21:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:14.931 19:21:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:14.931 19:21:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:14.931 19:21:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:14.931 19:21:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:14.931 19:21:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:14.931 19:21:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:14.931 19:21:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:14.931 19:21:33 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:14.931 19:21:33 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:14.931 19:21:33 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:14.931 19:21:33 -- host/perf.sh@17 -- # nvmftestinit 00:23:14.931 19:21:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:14.932 19:21:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:14.932 19:21:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:14.932 19:21:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:14.932 19:21:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:14.932 19:21:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:14.932 19:21:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:14.932 19:21:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:14.932 19:21:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:14.932 19:21:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:14.932 19:21:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:14.932 19:21:33 -- common/autotest_common.sh@10 -- # set +x 00:23:16.832 19:21:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:16.832 19:21:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:16.832 19:21:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:16.832 19:21:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:16.832 19:21:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:16.832 19:21:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:16.832 19:21:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:16.832 19:21:35 -- nvmf/common.sh@294 -- # net_devs=() 00:23:16.832 19:21:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:16.832 19:21:35 -- nvmf/common.sh@295 -- # e810=() 00:23:16.832 19:21:35 -- nvmf/common.sh@295 -- # local -ga e810 00:23:16.832 19:21:35 -- nvmf/common.sh@296 -- # x722=() 00:23:16.832 19:21:35 -- nvmf/common.sh@296 -- # local -ga x722 00:23:16.832 19:21:35 -- nvmf/common.sh@297 -- # mlx=() 00:23:16.832 19:21:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:16.832 19:21:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:16.832 19:21:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:16.832 19:21:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:16.832 19:21:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:16.832 19:21:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.832 19:21:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:16.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:16.832 19:21:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:16.832 19:21:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:16.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:16.832 19:21:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:16.832 19:21:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.832 19:21:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.832 19:21:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.832 19:21:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.832 19:21:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:16.832 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:16.832 19:21:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.832 19:21:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:16.832 19:21:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:16.832 19:21:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:16.832 19:21:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:16.832 19:21:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:16.832 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:16.832 19:21:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:16.832 19:21:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:16.832 19:21:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:16.832 19:21:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:16.832 19:21:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:16.832 19:21:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:16.832 19:21:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:16.832 19:21:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:16.832 19:21:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:16.832 19:21:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:16.832 19:21:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:16.832 19:21:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:16.832 19:21:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:16.832 19:21:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:16.832 19:21:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:16.832 19:21:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:16.832 19:21:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:16.832 19:21:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:17.091 19:21:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:17.091 19:21:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:17.091 19:21:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:17.091 19:21:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:17.091 19:21:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:17.091 19:21:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:17.091 19:21:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:17.091 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:17.091 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.353 ms 00:23:17.091 00:23:17.091 --- 10.0.0.2 ping statistics --- 00:23:17.091 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:17.091 rtt min/avg/max/mdev = 0.353/0.353/0.353/0.000 ms 00:23:17.091 19:21:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:17.091 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:17.091 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:23:17.091 00:23:17.091 --- 10.0.0.1 ping statistics --- 00:23:17.091 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:17.091 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:23:17.091 19:21:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:17.091 19:21:35 -- nvmf/common.sh@410 -- # return 0 00:23:17.091 19:21:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:17.091 19:21:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:17.091 19:21:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:17.091 19:21:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:17.091 19:21:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:17.091 19:21:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:17.091 19:21:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:17.091 19:21:35 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:17.091 19:21:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:17.091 19:21:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:17.091 19:21:35 -- common/autotest_common.sh@10 -- # set +x 00:23:17.091 19:21:35 -- nvmf/common.sh@469 -- # nvmfpid=3520861 00:23:17.091 19:21:35 -- nvmf/common.sh@470 -- # waitforlisten 3520861 00:23:17.091 19:21:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:17.091 19:21:35 -- common/autotest_common.sh@829 -- # '[' -z 3520861 ']' 00:23:17.091 19:21:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:17.091 19:21:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:17.091 19:21:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:17.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:17.091 19:21:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:17.091 19:21:35 -- common/autotest_common.sh@10 -- # set +x 00:23:17.091 [2024-11-18 19:21:35.586022] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:17.091 [2024-11-18 19:21:35.586101] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:17.091 EAL: No free 2048 kB hugepages reported on node 1 00:23:17.091 [2024-11-18 19:21:35.672462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:17.349 [2024-11-18 19:21:35.810025] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:17.349 [2024-11-18 19:21:35.810224] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:17.349 [2024-11-18 19:21:35.810253] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:17.349 [2024-11-18 19:21:35.810279] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:17.349 [2024-11-18 19:21:35.810345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:17.349 [2024-11-18 19:21:35.810409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:17.349 [2024-11-18 19:21:35.810476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:17.349 [2024-11-18 19:21:35.810485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:18.282 19:21:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:18.282 19:21:36 -- common/autotest_common.sh@862 -- # return 0 00:23:18.282 19:21:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:18.282 19:21:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:18.282 19:21:36 -- common/autotest_common.sh@10 -- # set +x 00:23:18.282 19:21:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:18.282 19:21:36 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:18.282 19:21:36 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:21.568 19:21:39 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:21.568 19:21:39 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:21.568 19:21:40 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:21.568 19:21:40 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:21.826 19:21:40 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:21.826 19:21:40 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:21.826 19:21:40 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:21.826 19:21:40 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:21.826 19:21:40 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:22.084 [2024-11-18 19:21:40.591789] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:22.084 19:21:40 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:22.342 19:21:40 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:22.342 19:21:40 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:22.600 19:21:41 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:22.600 19:21:41 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:22.858 19:21:41 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:23.115 [2024-11-18 19:21:41.599615] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:23.115 19:21:41 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:23.374 19:21:41 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:23.374 19:21:41 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:23.374 19:21:41 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:23.374 19:21:41 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:24.747 Initializing NVMe Controllers 00:23:24.747 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:24.747 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:24.747 Initialization complete. Launching workers. 00:23:24.747 ======================================================== 00:23:24.747 Latency(us) 00:23:24.747 Device Information : IOPS MiB/s Average min max 00:23:24.747 PCIE (0000:88:00.0) NSID 1 from core 0: 86845.09 339.24 368.00 32.43 7254.00 00:23:24.747 ======================================================== 00:23:24.747 Total : 86845.09 339.24 368.00 32.43 7254.00 00:23:24.747 00:23:24.747 19:21:43 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:24.747 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.120 Initializing NVMe Controllers 00:23:26.120 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:26.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:26.120 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:26.120 Initialization complete. Launching workers. 00:23:26.120 ======================================================== 00:23:26.120 Latency(us) 00:23:26.120 Device Information : IOPS MiB/s Average min max 00:23:26.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 80.72 0.32 12782.76 146.90 46061.17 00:23:26.120 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 51.82 0.20 19604.59 7953.92 55857.62 00:23:26.120 ======================================================== 00:23:26.120 Total : 132.54 0.52 15449.94 146.90 55857.62 00:23:26.120 00:23:26.120 19:21:44 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:26.120 EAL: No free 2048 kB hugepages reported on node 1 00:23:27.495 Initializing NVMe Controllers 00:23:27.495 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:27.495 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:27.495 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:27.495 Initialization complete. Launching workers. 00:23:27.495 ======================================================== 00:23:27.495 Latency(us) 00:23:27.495 Device Information : IOPS MiB/s Average min max 00:23:27.495 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8583.59 33.53 3728.10 558.50 10764.81 00:23:27.495 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3992.88 15.60 8070.07 4432.10 15567.90 00:23:27.495 ======================================================== 00:23:27.495 Total : 12576.47 49.13 5106.62 558.50 15567.90 00:23:27.495 00:23:27.495 19:21:45 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:27.495 19:21:45 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:27.495 19:21:45 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:27.495 EAL: No free 2048 kB hugepages reported on node 1 00:23:30.026 Initializing NVMe Controllers 00:23:30.026 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:30.026 Controller IO queue size 128, less than required. 00:23:30.026 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:30.026 Controller IO queue size 128, less than required. 00:23:30.026 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:30.026 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:30.026 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:30.026 Initialization complete. Launching workers. 00:23:30.026 ======================================================== 00:23:30.026 Latency(us) 00:23:30.026 Device Information : IOPS MiB/s Average min max 00:23:30.026 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1741.92 435.48 74407.49 47199.39 128924.61 00:23:30.026 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 594.97 148.74 224889.90 85824.48 350085.44 00:23:30.026 ======================================================== 00:23:30.026 Total : 2336.90 584.22 112720.30 47199.39 350085.44 00:23:30.026 00:23:30.026 19:21:48 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:30.026 EAL: No free 2048 kB hugepages reported on node 1 00:23:30.284 No valid NVMe controllers or AIO or URING devices found 00:23:30.284 Initializing NVMe Controllers 00:23:30.284 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:30.284 Controller IO queue size 128, less than required. 00:23:30.284 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:30.284 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:30.284 Controller IO queue size 128, less than required. 00:23:30.284 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:30.284 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:30.284 WARNING: Some requested NVMe devices were skipped 00:23:30.284 19:21:48 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:30.284 EAL: No free 2048 kB hugepages reported on node 1 00:23:33.565 Initializing NVMe Controllers 00:23:33.565 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:33.565 Controller IO queue size 128, less than required. 00:23:33.565 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:33.565 Controller IO queue size 128, less than required. 00:23:33.565 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:33.565 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:33.565 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:33.565 Initialization complete. Launching workers. 00:23:33.565 00:23:33.565 ==================== 00:23:33.565 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:33.565 TCP transport: 00:23:33.565 polls: 8576 00:23:33.566 idle_polls: 5445 00:23:33.566 sock_completions: 3131 00:23:33.566 nvme_completions: 5848 00:23:33.566 submitted_requests: 8935 00:23:33.566 queued_requests: 1 00:23:33.566 00:23:33.566 ==================== 00:23:33.566 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:33.566 TCP transport: 00:23:33.566 polls: 11842 00:23:33.566 idle_polls: 8559 00:23:33.566 sock_completions: 3283 00:23:33.566 nvme_completions: 6021 00:23:33.566 submitted_requests: 9157 00:23:33.566 queued_requests: 1 00:23:33.566 ======================================================== 00:23:33.566 Latency(us) 00:23:33.566 Device Information : IOPS MiB/s Average min max 00:23:33.566 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1522.93 380.73 86208.56 59369.72 149320.16 00:23:33.566 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1565.86 391.46 82415.39 40967.74 127809.45 00:23:33.566 ======================================================== 00:23:33.566 Total : 3088.78 772.20 84285.62 40967.74 149320.16 00:23:33.566 00:23:33.566 19:21:51 -- host/perf.sh@66 -- # sync 00:23:33.566 19:21:51 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:33.566 19:21:51 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:33.566 19:21:51 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:33.566 19:21:51 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:36.846 19:21:54 -- host/perf.sh@72 -- # ls_guid=c3948173-cc5d-470b-ac58-2314446dbab6 00:23:36.846 19:21:54 -- host/perf.sh@73 -- # get_lvs_free_mb c3948173-cc5d-470b-ac58-2314446dbab6 00:23:36.846 19:21:54 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c3948173-cc5d-470b-ac58-2314446dbab6 00:23:36.846 19:21:54 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:36.846 19:21:54 -- common/autotest_common.sh@1355 -- # local fc 00:23:36.846 19:21:54 -- common/autotest_common.sh@1356 -- # local cs 00:23:36.846 19:21:54 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:36.846 19:21:55 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:36.846 { 00:23:36.846 "uuid": "c3948173-cc5d-470b-ac58-2314446dbab6", 00:23:36.846 "name": "lvs_0", 00:23:36.846 "base_bdev": "Nvme0n1", 00:23:36.846 "total_data_clusters": 238234, 00:23:36.846 "free_clusters": 238234, 00:23:36.846 "block_size": 512, 00:23:36.846 "cluster_size": 4194304 00:23:36.846 } 00:23:36.846 ]' 00:23:36.846 19:21:55 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c3948173-cc5d-470b-ac58-2314446dbab6") .free_clusters' 00:23:36.846 19:21:55 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:36.846 19:21:55 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c3948173-cc5d-470b-ac58-2314446dbab6") .cluster_size' 00:23:36.846 19:21:55 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:36.846 19:21:55 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:36.846 19:21:55 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:36.846 952936 00:23:36.846 19:21:55 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:36.846 19:21:55 -- host/perf.sh@78 -- # free_mb=20480 00:23:36.846 19:21:55 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c3948173-cc5d-470b-ac58-2314446dbab6 lbd_0 20480 00:23:37.411 19:21:55 -- host/perf.sh@80 -- # lb_guid=b0ec4df6-cbef-4210-8aff-3f73973c81c1 00:23:37.411 19:21:55 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore b0ec4df6-cbef-4210-8aff-3f73973c81c1 lvs_n_0 00:23:38.403 19:21:56 -- host/perf.sh@83 -- # ls_nested_guid=339d3168-84e2-43f3-8229-efb8b2e8de5f 00:23:38.403 19:21:56 -- host/perf.sh@84 -- # get_lvs_free_mb 339d3168-84e2-43f3-8229-efb8b2e8de5f 00:23:38.403 19:21:56 -- common/autotest_common.sh@1353 -- # local lvs_uuid=339d3168-84e2-43f3-8229-efb8b2e8de5f 00:23:38.403 19:21:56 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:38.403 19:21:56 -- common/autotest_common.sh@1355 -- # local fc 00:23:38.403 19:21:56 -- common/autotest_common.sh@1356 -- # local cs 00:23:38.403 19:21:56 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:38.661 19:21:57 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:38.661 { 00:23:38.661 "uuid": "c3948173-cc5d-470b-ac58-2314446dbab6", 00:23:38.661 "name": "lvs_0", 00:23:38.661 "base_bdev": "Nvme0n1", 00:23:38.661 "total_data_clusters": 238234, 00:23:38.661 "free_clusters": 233114, 00:23:38.661 "block_size": 512, 00:23:38.661 "cluster_size": 4194304 00:23:38.661 }, 00:23:38.661 { 00:23:38.661 "uuid": "339d3168-84e2-43f3-8229-efb8b2e8de5f", 00:23:38.661 "name": "lvs_n_0", 00:23:38.661 "base_bdev": "b0ec4df6-cbef-4210-8aff-3f73973c81c1", 00:23:38.661 "total_data_clusters": 5114, 00:23:38.661 "free_clusters": 5114, 00:23:38.661 "block_size": 512, 00:23:38.661 "cluster_size": 4194304 00:23:38.661 } 00:23:38.661 ]' 00:23:38.661 19:21:57 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="339d3168-84e2-43f3-8229-efb8b2e8de5f") .free_clusters' 00:23:38.661 19:21:57 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:38.661 19:21:57 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="339d3168-84e2-43f3-8229-efb8b2e8de5f") .cluster_size' 00:23:38.661 19:21:57 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:38.661 19:21:57 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:38.661 19:21:57 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:38.661 20456 00:23:38.661 19:21:57 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:38.661 19:21:57 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 339d3168-84e2-43f3-8229-efb8b2e8de5f lbd_nest_0 20456 00:23:38.920 19:21:57 -- host/perf.sh@88 -- # lb_nested_guid=87b3dba2-c56b-4ca0-8144-1199b70d145e 00:23:38.920 19:21:57 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:39.177 19:21:57 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:39.177 19:21:57 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 87b3dba2-c56b-4ca0-8144-1199b70d145e 00:23:39.436 19:21:57 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:39.693 19:21:58 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:39.693 19:21:58 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:39.693 19:21:58 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:39.693 19:21:58 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:39.693 19:21:58 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.693 EAL: No free 2048 kB hugepages reported on node 1 00:23:51.916 Initializing NVMe Controllers 00:23:51.916 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:51.916 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:51.916 Initialization complete. Launching workers. 00:23:51.916 ======================================================== 00:23:51.916 Latency(us) 00:23:51.916 Device Information : IOPS MiB/s Average min max 00:23:51.916 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 45.70 0.02 21950.52 169.21 45791.80 00:23:51.916 ======================================================== 00:23:51.916 Total : 45.70 0.02 21950.52 169.21 45791.80 00:23:51.916 00:23:51.916 19:22:08 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:51.916 19:22:08 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:51.916 EAL: No free 2048 kB hugepages reported on node 1 00:24:01.880 Initializing NVMe Controllers 00:24:01.880 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:01.880 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:01.880 Initialization complete. Launching workers. 00:24:01.880 ======================================================== 00:24:01.880 Latency(us) 00:24:01.880 Device Information : IOPS MiB/s Average min max 00:24:01.880 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 82.69 10.34 12112.48 3098.68 47901.44 00:24:01.880 ======================================================== 00:24:01.880 Total : 82.69 10.34 12112.48 3098.68 47901.44 00:24:01.880 00:24:01.880 19:22:18 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:01.880 19:22:18 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:01.880 19:22:18 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:01.880 EAL: No free 2048 kB hugepages reported on node 1 00:24:11.846 Initializing NVMe Controllers 00:24:11.846 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:11.846 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:11.846 Initialization complete. Launching workers. 00:24:11.846 ======================================================== 00:24:11.846 Latency(us) 00:24:11.846 Device Information : IOPS MiB/s Average min max 00:24:11.846 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7866.90 3.84 4067.95 290.93 9371.57 00:24:11.846 ======================================================== 00:24:11.846 Total : 7866.90 3.84 4067.95 290.93 9371.57 00:24:11.846 00:24:11.846 19:22:29 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:11.846 19:22:29 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:11.846 EAL: No free 2048 kB hugepages reported on node 1 00:24:21.812 Initializing NVMe Controllers 00:24:21.812 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:21.812 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:21.812 Initialization complete. Launching workers. 00:24:21.812 ======================================================== 00:24:21.812 Latency(us) 00:24:21.812 Device Information : IOPS MiB/s Average min max 00:24:21.812 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3995.70 499.46 8008.36 776.06 17772.44 00:24:21.812 ======================================================== 00:24:21.812 Total : 3995.70 499.46 8008.36 776.06 17772.44 00:24:21.812 00:24:21.812 19:22:39 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:21.812 19:22:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:21.812 19:22:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:21.812 EAL: No free 2048 kB hugepages reported on node 1 00:24:31.781 Initializing NVMe Controllers 00:24:31.781 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:31.781 Controller IO queue size 128, less than required. 00:24:31.781 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:31.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:31.781 Initialization complete. Launching workers. 00:24:31.781 ======================================================== 00:24:31.781 Latency(us) 00:24:31.781 Device Information : IOPS MiB/s Average min max 00:24:31.781 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12069.30 5.89 10609.19 1901.02 29076.44 00:24:31.781 ======================================================== 00:24:31.781 Total : 12069.30 5.89 10609.19 1901.02 29076.44 00:24:31.781 00:24:31.781 19:22:49 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:31.781 19:22:49 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:31.781 EAL: No free 2048 kB hugepages reported on node 1 00:24:43.980 Initializing NVMe Controllers 00:24:43.980 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:43.980 Controller IO queue size 128, less than required. 00:24:43.980 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:43.980 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:43.980 Initialization complete. Launching workers. 00:24:43.980 ======================================================== 00:24:43.980 Latency(us) 00:24:43.980 Device Information : IOPS MiB/s Average min max 00:24:43.980 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1185.40 148.17 109011.63 16559.62 230350.27 00:24:43.980 ======================================================== 00:24:43.980 Total : 1185.40 148.17 109011.63 16559.62 230350.27 00:24:43.980 00:24:43.980 19:23:00 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:43.980 19:23:00 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 87b3dba2-c56b-4ca0-8144-1199b70d145e 00:24:43.980 19:23:01 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:43.980 19:23:01 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b0ec4df6-cbef-4210-8aff-3f73973c81c1 00:24:43.980 19:23:01 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:43.980 19:23:02 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:43.980 19:23:02 -- host/perf.sh@114 -- # nvmftestfini 00:24:43.980 19:23:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:43.980 19:23:02 -- nvmf/common.sh@116 -- # sync 00:24:43.980 19:23:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:43.980 19:23:02 -- nvmf/common.sh@119 -- # set +e 00:24:43.980 19:23:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:43.980 19:23:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:43.980 rmmod nvme_tcp 00:24:43.980 rmmod nvme_fabrics 00:24:43.980 rmmod nvme_keyring 00:24:43.980 19:23:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:43.980 19:23:02 -- nvmf/common.sh@123 -- # set -e 00:24:43.980 19:23:02 -- nvmf/common.sh@124 -- # return 0 00:24:43.980 19:23:02 -- nvmf/common.sh@477 -- # '[' -n 3520861 ']' 00:24:43.980 19:23:02 -- nvmf/common.sh@478 -- # killprocess 3520861 00:24:43.980 19:23:02 -- common/autotest_common.sh@936 -- # '[' -z 3520861 ']' 00:24:43.980 19:23:02 -- common/autotest_common.sh@940 -- # kill -0 3520861 00:24:43.980 19:23:02 -- common/autotest_common.sh@941 -- # uname 00:24:43.980 19:23:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:43.980 19:23:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3520861 00:24:43.980 19:23:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:43.980 19:23:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:43.980 19:23:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3520861' 00:24:43.980 killing process with pid 3520861 00:24:43.980 19:23:02 -- common/autotest_common.sh@955 -- # kill 3520861 00:24:43.980 19:23:02 -- common/autotest_common.sh@960 -- # wait 3520861 00:24:45.354 19:23:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:45.355 19:23:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:45.355 19:23:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:45.355 19:23:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:45.355 19:23:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:45.355 19:23:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:45.355 19:23:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:45.355 19:23:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.884 19:23:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:47.884 00:24:47.884 real 1m32.717s 00:24:47.884 user 5m41.755s 00:24:47.884 sys 0m16.037s 00:24:47.884 19:23:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:47.884 19:23:05 -- common/autotest_common.sh@10 -- # set +x 00:24:47.884 ************************************ 00:24:47.884 END TEST nvmf_perf 00:24:47.884 ************************************ 00:24:47.884 19:23:05 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:47.884 19:23:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:47.884 19:23:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:47.884 19:23:05 -- common/autotest_common.sh@10 -- # set +x 00:24:47.884 ************************************ 00:24:47.884 START TEST nvmf_fio_host 00:24:47.884 ************************************ 00:24:47.884 19:23:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:47.884 * Looking for test storage... 00:24:47.884 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:47.884 19:23:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:47.884 19:23:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:47.884 19:23:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:47.884 19:23:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:47.884 19:23:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:47.884 19:23:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:47.884 19:23:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:47.884 19:23:06 -- scripts/common.sh@335 -- # IFS=.-: 00:24:47.884 19:23:06 -- scripts/common.sh@335 -- # read -ra ver1 00:24:47.884 19:23:06 -- scripts/common.sh@336 -- # IFS=.-: 00:24:47.884 19:23:06 -- scripts/common.sh@336 -- # read -ra ver2 00:24:47.884 19:23:06 -- scripts/common.sh@337 -- # local 'op=<' 00:24:47.884 19:23:06 -- scripts/common.sh@339 -- # ver1_l=2 00:24:47.884 19:23:06 -- scripts/common.sh@340 -- # ver2_l=1 00:24:47.884 19:23:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:47.884 19:23:06 -- scripts/common.sh@343 -- # case "$op" in 00:24:47.884 19:23:06 -- scripts/common.sh@344 -- # : 1 00:24:47.884 19:23:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:47.884 19:23:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:47.884 19:23:06 -- scripts/common.sh@364 -- # decimal 1 00:24:47.884 19:23:06 -- scripts/common.sh@352 -- # local d=1 00:24:47.884 19:23:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:47.884 19:23:06 -- scripts/common.sh@354 -- # echo 1 00:24:47.885 19:23:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:47.885 19:23:06 -- scripts/common.sh@365 -- # decimal 2 00:24:47.885 19:23:06 -- scripts/common.sh@352 -- # local d=2 00:24:47.885 19:23:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:47.885 19:23:06 -- scripts/common.sh@354 -- # echo 2 00:24:47.885 19:23:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:47.885 19:23:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:47.885 19:23:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:47.885 19:23:06 -- scripts/common.sh@367 -- # return 0 00:24:47.885 19:23:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:47.885 19:23:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:47.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.885 --rc genhtml_branch_coverage=1 00:24:47.885 --rc genhtml_function_coverage=1 00:24:47.885 --rc genhtml_legend=1 00:24:47.885 --rc geninfo_all_blocks=1 00:24:47.885 --rc geninfo_unexecuted_blocks=1 00:24:47.885 00:24:47.885 ' 00:24:47.885 19:23:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:47.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.885 --rc genhtml_branch_coverage=1 00:24:47.885 --rc genhtml_function_coverage=1 00:24:47.885 --rc genhtml_legend=1 00:24:47.885 --rc geninfo_all_blocks=1 00:24:47.885 --rc geninfo_unexecuted_blocks=1 00:24:47.885 00:24:47.885 ' 00:24:47.885 19:23:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:47.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.885 --rc genhtml_branch_coverage=1 00:24:47.885 --rc genhtml_function_coverage=1 00:24:47.885 --rc genhtml_legend=1 00:24:47.885 --rc geninfo_all_blocks=1 00:24:47.885 --rc geninfo_unexecuted_blocks=1 00:24:47.885 00:24:47.885 ' 00:24:47.885 19:23:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:47.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:47.885 --rc genhtml_branch_coverage=1 00:24:47.885 --rc genhtml_function_coverage=1 00:24:47.885 --rc genhtml_legend=1 00:24:47.885 --rc geninfo_all_blocks=1 00:24:47.885 --rc geninfo_unexecuted_blocks=1 00:24:47.885 00:24:47.885 ' 00:24:47.885 19:23:06 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:47.885 19:23:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:47.885 19:23:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:47.885 19:23:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:47.885 19:23:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- paths/export.sh@5 -- # export PATH 00:24:47.885 19:23:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:47.885 19:23:06 -- nvmf/common.sh@7 -- # uname -s 00:24:47.885 19:23:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:47.885 19:23:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:47.885 19:23:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:47.885 19:23:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:47.885 19:23:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:47.885 19:23:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:47.885 19:23:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:47.885 19:23:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:47.885 19:23:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:47.885 19:23:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:47.885 19:23:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:47.885 19:23:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:47.885 19:23:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:47.885 19:23:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:47.885 19:23:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:47.885 19:23:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:47.885 19:23:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:47.885 19:23:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:47.885 19:23:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:47.885 19:23:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- paths/export.sh@5 -- # export PATH 00:24:47.885 19:23:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:47.885 19:23:06 -- nvmf/common.sh@46 -- # : 0 00:24:47.885 19:23:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:47.885 19:23:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:47.885 19:23:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:47.885 19:23:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:47.885 19:23:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:47.885 19:23:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:47.885 19:23:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:47.885 19:23:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:47.885 19:23:06 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:47.885 19:23:06 -- host/fio.sh@14 -- # nvmftestinit 00:24:47.885 19:23:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:47.885 19:23:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:47.885 19:23:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:47.885 19:23:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:47.885 19:23:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:47.885 19:23:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:47.885 19:23:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:47.885 19:23:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.885 19:23:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:47.885 19:23:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:47.885 19:23:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:47.885 19:23:06 -- common/autotest_common.sh@10 -- # set +x 00:24:49.786 19:23:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:49.786 19:23:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:49.786 19:23:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:49.786 19:23:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:49.786 19:23:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:49.786 19:23:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:49.786 19:23:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:49.786 19:23:08 -- nvmf/common.sh@294 -- # net_devs=() 00:24:49.786 19:23:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:49.786 19:23:08 -- nvmf/common.sh@295 -- # e810=() 00:24:49.786 19:23:08 -- nvmf/common.sh@295 -- # local -ga e810 00:24:49.786 19:23:08 -- nvmf/common.sh@296 -- # x722=() 00:24:49.786 19:23:08 -- nvmf/common.sh@296 -- # local -ga x722 00:24:49.786 19:23:08 -- nvmf/common.sh@297 -- # mlx=() 00:24:49.786 19:23:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:49.786 19:23:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:49.786 19:23:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:49.786 19:23:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:49.786 19:23:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:49.786 19:23:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:49.786 19:23:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:49.786 19:23:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:49.786 19:23:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.786 19:23:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:49.786 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:49.786 19:23:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.786 19:23:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.786 19:23:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.786 19:23:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:49.787 19:23:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:49.787 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:49.787 19:23:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:49.787 19:23:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.787 19:23:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.787 19:23:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.787 19:23:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.787 19:23:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:49.787 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:49.787 19:23:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.787 19:23:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:49.787 19:23:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:49.787 19:23:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:49.787 19:23:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:49.787 19:23:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:49.787 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:49.787 19:23:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:49.787 19:23:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:49.787 19:23:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:49.787 19:23:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:49.787 19:23:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:49.787 19:23:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:49.787 19:23:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:49.787 19:23:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:49.787 19:23:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:49.787 19:23:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:49.787 19:23:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:49.787 19:23:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:49.787 19:23:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:49.787 19:23:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:49.787 19:23:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:49.787 19:23:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:49.787 19:23:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:49.787 19:23:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:49.787 19:23:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:49.787 19:23:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:49.787 19:23:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:49.787 19:23:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:50.045 19:23:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:50.045 19:23:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:50.045 19:23:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:50.045 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:50.045 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:24:50.045 00:24:50.045 --- 10.0.0.2 ping statistics --- 00:24:50.045 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:50.045 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:24:50.045 19:23:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:50.045 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:50.045 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:24:50.045 00:24:50.045 --- 10.0.0.1 ping statistics --- 00:24:50.045 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:50.045 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:24:50.045 19:23:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:50.045 19:23:08 -- nvmf/common.sh@410 -- # return 0 00:24:50.045 19:23:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:50.045 19:23:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:50.045 19:23:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:50.045 19:23:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:50.045 19:23:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:50.045 19:23:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:50.045 19:23:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:50.045 19:23:08 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:50.045 19:23:08 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:50.045 19:23:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:50.045 19:23:08 -- common/autotest_common.sh@10 -- # set +x 00:24:50.045 19:23:08 -- host/fio.sh@24 -- # nvmfpid=3533458 00:24:50.045 19:23:08 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:50.045 19:23:08 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:50.045 19:23:08 -- host/fio.sh@28 -- # waitforlisten 3533458 00:24:50.045 19:23:08 -- common/autotest_common.sh@829 -- # '[' -z 3533458 ']' 00:24:50.045 19:23:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:50.045 19:23:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:50.045 19:23:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:50.045 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:50.045 19:23:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:50.045 19:23:08 -- common/autotest_common.sh@10 -- # set +x 00:24:50.045 [2024-11-18 19:23:08.558729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:50.045 [2024-11-18 19:23:08.558816] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:50.045 EAL: No free 2048 kB hugepages reported on node 1 00:24:50.045 [2024-11-18 19:23:08.627895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:50.303 [2024-11-18 19:23:08.743330] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:50.304 [2024-11-18 19:23:08.743499] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:50.304 [2024-11-18 19:23:08.743519] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:50.304 [2024-11-18 19:23:08.743534] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:50.304 [2024-11-18 19:23:08.743644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:50.304 [2024-11-18 19:23:08.743685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:50.304 [2024-11-18 19:23:08.743775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:50.304 [2024-11-18 19:23:08.743777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:51.236 19:23:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:51.236 19:23:09 -- common/autotest_common.sh@862 -- # return 0 00:24:51.236 19:23:09 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:51.236 [2024-11-18 19:23:09.742826] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:51.236 19:23:09 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:51.236 19:23:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:51.236 19:23:09 -- common/autotest_common.sh@10 -- # set +x 00:24:51.236 19:23:09 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:51.494 Malloc1 00:24:51.494 19:23:10 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:51.751 19:23:10 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:52.009 19:23:10 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:52.274 [2024-11-18 19:23:10.799877] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:52.274 19:23:10 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:52.622 19:23:11 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:52.622 19:23:11 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:52.622 19:23:11 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:52.622 19:23:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:52.622 19:23:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:52.622 19:23:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:52.622 19:23:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.622 19:23:11 -- common/autotest_common.sh@1330 -- # shift 00:24:52.622 19:23:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:52.622 19:23:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:52.622 19:23:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:52.622 19:23:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:52.622 19:23:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:52.622 19:23:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:52.622 19:23:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:52.622 19:23:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:52.892 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:52.892 fio-3.35 00:24:52.892 Starting 1 thread 00:24:52.892 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.422 00:24:55.422 test: (groupid=0, jobs=1): err= 0: pid=3533963: Mon Nov 18 19:23:13 2024 00:24:55.422 read: IOPS=9428, BW=36.8MiB/s (38.6MB/s)(73.9MiB/2006msec) 00:24:55.422 slat (nsec): min=1991, max=180276, avg=2556.80, stdev=2028.63 00:24:55.422 clat (usec): min=2424, max=13040, avg=7453.56, stdev=591.83 00:24:55.422 lat (usec): min=2452, max=13043, avg=7456.11, stdev=591.70 00:24:55.422 clat percentiles (usec): 00:24:55.422 | 1.00th=[ 6063], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:24:55.422 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:24:55.422 | 70.00th=[ 7767], 80.00th=[ 7898], 90.00th=[ 8160], 95.00th=[ 8356], 00:24:55.422 | 99.00th=[ 8717], 99.50th=[ 8848], 99.90th=[10814], 99.95th=[12256], 00:24:55.422 | 99.99th=[13042] 00:24:55.422 bw ( KiB/s): min=36680, max=38752, per=99.93%, avg=37690.00, stdev=848.94, samples=4 00:24:55.422 iops : min= 9170, max= 9688, avg=9422.50, stdev=212.23, samples=4 00:24:55.422 write: IOPS=9429, BW=36.8MiB/s (38.6MB/s)(73.9MiB/2006msec); 0 zone resets 00:24:55.422 slat (usec): min=2, max=145, avg= 2.64, stdev= 1.48 00:24:55.422 clat (usec): min=1615, max=11461, avg=6033.09, stdev=499.57 00:24:55.422 lat (usec): min=1626, max=11464, avg=6035.73, stdev=499.50 00:24:55.422 clat percentiles (usec): 00:24:55.422 | 1.00th=[ 4817], 5.00th=[ 5276], 10.00th=[ 5473], 20.00th=[ 5669], 00:24:55.422 | 30.00th=[ 5800], 40.00th=[ 5932], 50.00th=[ 6063], 60.00th=[ 6128], 00:24:55.422 | 70.00th=[ 6259], 80.00th=[ 6390], 90.00th=[ 6587], 95.00th=[ 6783], 00:24:55.422 | 99.00th=[ 7111], 99.50th=[ 7242], 99.90th=[ 9634], 99.95th=[10552], 00:24:55.422 | 99.99th=[11469] 00:24:55.422 bw ( KiB/s): min=37648, max=37760, per=99.99%, avg=37716.00, stdev=54.45, samples=4 00:24:55.422 iops : min= 9412, max= 9440, avg=9429.00, stdev=13.61, samples=4 00:24:55.422 lat (msec) : 2=0.03%, 4=0.11%, 10=99.75%, 20=0.11% 00:24:55.422 cpu : usr=64.14%, sys=33.87%, ctx=88, majf=0, minf=41 00:24:55.422 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:55.422 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:55.422 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:55.422 issued rwts: total=18914,18916,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:55.422 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:55.422 00:24:55.422 Run status group 0 (all jobs): 00:24:55.422 READ: bw=36.8MiB/s (38.6MB/s), 36.8MiB/s-36.8MiB/s (38.6MB/s-38.6MB/s), io=73.9MiB (77.5MB), run=2006-2006msec 00:24:55.422 WRITE: bw=36.8MiB/s (38.6MB/s), 36.8MiB/s-36.8MiB/s (38.6MB/s-38.6MB/s), io=73.9MiB (77.5MB), run=2006-2006msec 00:24:55.422 19:23:13 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:55.422 19:23:13 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:55.422 19:23:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:55.422 19:23:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:55.422 19:23:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:55.422 19:23:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:55.422 19:23:13 -- common/autotest_common.sh@1330 -- # shift 00:24:55.422 19:23:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:55.422 19:23:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:55.422 19:23:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:55.422 19:23:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:55.422 19:23:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:55.422 19:23:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:55.422 19:23:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:55.422 19:23:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:55.422 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:55.422 fio-3.35 00:24:55.422 Starting 1 thread 00:24:55.422 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.950 00:24:57.950 test: (groupid=0, jobs=1): err= 0: pid=3534305: Mon Nov 18 19:23:16 2024 00:24:57.950 read: IOPS=8437, BW=132MiB/s (138MB/s)(264MiB/2005msec) 00:24:57.950 slat (nsec): min=2715, max=92622, avg=3621.20, stdev=1727.70 00:24:57.950 clat (usec): min=1844, max=17744, avg=8696.80, stdev=2082.66 00:24:57.950 lat (usec): min=1847, max=17747, avg=8700.42, stdev=2082.71 00:24:57.950 clat percentiles (usec): 00:24:57.950 | 1.00th=[ 4555], 5.00th=[ 5473], 10.00th=[ 6259], 20.00th=[ 7046], 00:24:57.950 | 30.00th=[ 7635], 40.00th=[ 8094], 50.00th=[ 8586], 60.00th=[ 9110], 00:24:57.950 | 70.00th=[ 9503], 80.00th=[10028], 90.00th=[11338], 95.00th=[12649], 00:24:57.950 | 99.00th=[14615], 99.50th=[15533], 99.90th=[16450], 99.95th=[16450], 00:24:57.950 | 99.99th=[17433] 00:24:57.950 bw ( KiB/s): min=60256, max=80768, per=51.48%, avg=69496.00, stdev=8467.43, samples=4 00:24:57.950 iops : min= 3766, max= 5048, avg=4343.50, stdev=529.21, samples=4 00:24:57.950 write: IOPS=4960, BW=77.5MiB/s (81.3MB/s)(142MiB/1837msec); 0 zone resets 00:24:57.950 slat (usec): min=30, max=126, avg=33.32, stdev= 5.33 00:24:57.950 clat (usec): min=4072, max=23527, avg=11531.98, stdev=2417.22 00:24:57.951 lat (usec): min=4104, max=23560, avg=11565.31, stdev=2417.51 00:24:57.951 clat percentiles (usec): 00:24:57.951 | 1.00th=[ 7177], 5.00th=[ 8094], 10.00th=[ 8586], 20.00th=[ 9241], 00:24:57.951 | 30.00th=[ 9896], 40.00th=[10683], 50.00th=[11338], 60.00th=[12125], 00:24:57.951 | 70.00th=[12780], 80.00th=[13698], 90.00th=[14746], 95.00th=[15533], 00:24:57.951 | 99.00th=[17433], 99.50th=[19006], 99.90th=[22938], 99.95th=[23200], 00:24:57.951 | 99.99th=[23462] 00:24:57.951 bw ( KiB/s): min=61888, max=84000, per=91.29%, avg=72456.00, stdev=9064.70, samples=4 00:24:57.951 iops : min= 3868, max= 5250, avg=4528.50, stdev=566.54, samples=4 00:24:57.951 lat (msec) : 2=0.02%, 4=0.23%, 10=62.13%, 20=37.51%, 50=0.11% 00:24:57.951 cpu : usr=77.89%, sys=20.71%, ctx=48, majf=0, minf=69 00:24:57.951 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:57.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:57.951 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:57.951 issued rwts: total=16918,9113,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:57.951 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:57.951 00:24:57.951 Run status group 0 (all jobs): 00:24:57.951 READ: bw=132MiB/s (138MB/s), 132MiB/s-132MiB/s (138MB/s-138MB/s), io=264MiB (277MB), run=2005-2005msec 00:24:57.951 WRITE: bw=77.5MiB/s (81.3MB/s), 77.5MiB/s-77.5MiB/s (81.3MB/s-81.3MB/s), io=142MiB (149MB), run=1837-1837msec 00:24:57.951 19:23:16 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:58.208 19:23:16 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:58.208 19:23:16 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:58.208 19:23:16 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:58.208 19:23:16 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:58.208 19:23:16 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:58.208 19:23:16 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:58.208 19:23:16 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:58.208 19:23:16 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:58.208 19:23:16 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:58.208 19:23:16 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:58.208 19:23:16 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:01.490 Nvme0n1 00:25:01.490 19:23:19 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:04.019 19:23:22 -- host/fio.sh@53 -- # ls_guid=b9e7384a-478e-4ce9-ae29-9d8f147ee3cd 00:25:04.019 19:23:22 -- host/fio.sh@54 -- # get_lvs_free_mb b9e7384a-478e-4ce9-ae29-9d8f147ee3cd 00:25:04.019 19:23:22 -- common/autotest_common.sh@1353 -- # local lvs_uuid=b9e7384a-478e-4ce9-ae29-9d8f147ee3cd 00:25:04.019 19:23:22 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:04.019 19:23:22 -- common/autotest_common.sh@1355 -- # local fc 00:25:04.019 19:23:22 -- common/autotest_common.sh@1356 -- # local cs 00:25:04.019 19:23:22 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:04.585 19:23:22 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:04.585 { 00:25:04.585 "uuid": "b9e7384a-478e-4ce9-ae29-9d8f147ee3cd", 00:25:04.585 "name": "lvs_0", 00:25:04.585 "base_bdev": "Nvme0n1", 00:25:04.585 "total_data_clusters": 930, 00:25:04.585 "free_clusters": 930, 00:25:04.585 "block_size": 512, 00:25:04.585 "cluster_size": 1073741824 00:25:04.585 } 00:25:04.585 ]' 00:25:04.585 19:23:22 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="b9e7384a-478e-4ce9-ae29-9d8f147ee3cd") .free_clusters' 00:25:04.585 19:23:22 -- common/autotest_common.sh@1358 -- # fc=930 00:25:04.585 19:23:22 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="b9e7384a-478e-4ce9-ae29-9d8f147ee3cd") .cluster_size' 00:25:04.585 19:23:22 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:04.585 19:23:22 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:04.585 19:23:22 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:04.585 952320 00:25:04.585 19:23:22 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:04.844 47d8203f-6d93-42d3-8960-e6843304371d 00:25:04.844 19:23:23 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:05.102 19:23:23 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:05.360 19:23:23 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:05.618 19:23:24 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.618 19:23:24 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.618 19:23:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:05.618 19:23:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:05.618 19:23:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:05.618 19:23:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.618 19:23:24 -- common/autotest_common.sh@1330 -- # shift 00:25:05.618 19:23:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:05.618 19:23:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.618 19:23:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.618 19:23:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:05.618 19:23:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:05.618 19:23:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:05.618 19:23:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:05.618 19:23:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:05.876 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:05.876 fio-3.35 00:25:05.876 Starting 1 thread 00:25:05.876 EAL: No free 2048 kB hugepages reported on node 1 00:25:08.403 [2024-11-18 19:23:26.670040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf50a50 is same with the state(5) to be set 00:25:08.403 00:25:08.403 test: (groupid=0, jobs=1): err= 0: pid=3535623: Mon Nov 18 19:23:26 2024 00:25:08.403 read: IOPS=6437, BW=25.1MiB/s (26.4MB/s)(50.5MiB/2008msec) 00:25:08.403 slat (nsec): min=1964, max=166121, avg=2499.50, stdev=1972.19 00:25:08.403 clat (usec): min=883, max=170581, avg=10902.92, stdev=11259.27 00:25:08.403 lat (usec): min=886, max=170626, avg=10905.42, stdev=11259.55 00:25:08.403 clat percentiles (msec): 00:25:08.403 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:08.403 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:08.403 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:08.403 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:08.403 | 99.99th=[ 171] 00:25:08.403 bw ( KiB/s): min=18176, max=28448, per=99.92%, avg=25728.00, stdev=5037.05, samples=4 00:25:08.403 iops : min= 4544, max= 7112, avg=6432.00, stdev=1259.26, samples=4 00:25:08.403 write: IOPS=6441, BW=25.2MiB/s (26.4MB/s)(50.5MiB/2008msec); 0 zone resets 00:25:08.403 slat (nsec): min=2063, max=94216, avg=2613.91, stdev=1378.88 00:25:08.403 clat (usec): min=339, max=168958, avg=8851.68, stdev=10566.90 00:25:08.403 lat (usec): min=342, max=168964, avg=8854.29, stdev=10567.12 00:25:08.403 clat percentiles (msec): 00:25:08.403 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:08.403 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:08.403 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:08.403 | 99.00th=[ 11], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:25:08.403 | 99.99th=[ 169] 00:25:08.403 bw ( KiB/s): min=19112, max=28096, per=99.90%, avg=25738.00, stdev=4420.53, samples=4 00:25:08.403 iops : min= 4778, max= 7024, avg=6434.50, stdev=1105.13, samples=4 00:25:08.403 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:08.403 lat (msec) : 2=0.03%, 4=0.17%, 10=71.54%, 20=27.74%, 250=0.49% 00:25:08.403 cpu : usr=62.68%, sys=35.77%, ctx=118, majf=0, minf=41 00:25:08.403 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:08.403 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:08.403 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:08.403 issued rwts: total=12926,12934,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:08.403 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:08.403 00:25:08.403 Run status group 0 (all jobs): 00:25:08.403 READ: bw=25.1MiB/s (26.4MB/s), 25.1MiB/s-25.1MiB/s (26.4MB/s-26.4MB/s), io=50.5MiB (52.9MB), run=2008-2008msec 00:25:08.403 WRITE: bw=25.2MiB/s (26.4MB/s), 25.2MiB/s-25.2MiB/s (26.4MB/s-26.4MB/s), io=50.5MiB (53.0MB), run=2008-2008msec 00:25:08.403 19:23:26 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:08.403 19:23:26 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:09.777 19:23:28 -- host/fio.sh@64 -- # ls_nested_guid=cdad033d-3303-4f16-9c00-34e653aa8545 00:25:09.777 19:23:28 -- host/fio.sh@65 -- # get_lvs_free_mb cdad033d-3303-4f16-9c00-34e653aa8545 00:25:09.777 19:23:28 -- common/autotest_common.sh@1353 -- # local lvs_uuid=cdad033d-3303-4f16-9c00-34e653aa8545 00:25:09.777 19:23:28 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:09.777 19:23:28 -- common/autotest_common.sh@1355 -- # local fc 00:25:09.777 19:23:28 -- common/autotest_common.sh@1356 -- # local cs 00:25:09.777 19:23:28 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:10.036 19:23:28 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:10.036 { 00:25:10.036 "uuid": "b9e7384a-478e-4ce9-ae29-9d8f147ee3cd", 00:25:10.036 "name": "lvs_0", 00:25:10.036 "base_bdev": "Nvme0n1", 00:25:10.036 "total_data_clusters": 930, 00:25:10.036 "free_clusters": 0, 00:25:10.036 "block_size": 512, 00:25:10.036 "cluster_size": 1073741824 00:25:10.036 }, 00:25:10.036 { 00:25:10.036 "uuid": "cdad033d-3303-4f16-9c00-34e653aa8545", 00:25:10.036 "name": "lvs_n_0", 00:25:10.036 "base_bdev": "47d8203f-6d93-42d3-8960-e6843304371d", 00:25:10.036 "total_data_clusters": 237847, 00:25:10.036 "free_clusters": 237847, 00:25:10.036 "block_size": 512, 00:25:10.036 "cluster_size": 4194304 00:25:10.036 } 00:25:10.036 ]' 00:25:10.036 19:23:28 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="cdad033d-3303-4f16-9c00-34e653aa8545") .free_clusters' 00:25:10.036 19:23:28 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:10.036 19:23:28 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="cdad033d-3303-4f16-9c00-34e653aa8545") .cluster_size' 00:25:10.036 19:23:28 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:10.036 19:23:28 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:10.036 19:23:28 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:10.036 951388 00:25:10.036 19:23:28 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:10.601 e5e76a65-ad1f-40db-b243-169a618ed555 00:25:10.601 19:23:29 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:10.859 19:23:29 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:11.116 19:23:29 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:11.375 19:23:29 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:11.375 19:23:29 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:11.375 19:23:29 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:11.375 19:23:29 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:11.375 19:23:29 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:11.375 19:23:29 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:11.375 19:23:29 -- common/autotest_common.sh@1330 -- # shift 00:25:11.375 19:23:29 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:11.375 19:23:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:11.375 19:23:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:11.375 19:23:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:11.375 19:23:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:11.375 19:23:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:11.375 19:23:29 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:11.375 19:23:29 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:11.633 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:11.633 fio-3.35 00:25:11.633 Starting 1 thread 00:25:11.633 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.159 00:25:14.159 test: (groupid=0, jobs=1): err= 0: pid=3536380: Mon Nov 18 19:23:32 2024 00:25:14.159 read: IOPS=6127, BW=23.9MiB/s (25.1MB/s)(48.1MiB/2008msec) 00:25:14.159 slat (nsec): min=1874, max=132805, avg=2463.49, stdev=1908.65 00:25:14.159 clat (usec): min=4362, max=19869, avg=11510.75, stdev=1003.58 00:25:14.159 lat (usec): min=4367, max=19871, avg=11513.22, stdev=1003.49 00:25:14.159 clat percentiles (usec): 00:25:14.159 | 1.00th=[ 9110], 5.00th=[10028], 10.00th=[10290], 20.00th=[10683], 00:25:14.159 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:25:14.159 | 70.00th=[11994], 80.00th=[12256], 90.00th=[12649], 95.00th=[13042], 00:25:14.159 | 99.00th=[13698], 99.50th=[13960], 99.90th=[17433], 99.95th=[19006], 00:25:14.159 | 99.99th=[19006] 00:25:14.159 bw ( KiB/s): min=23184, max=24936, per=99.85%, avg=24474.00, stdev=860.92, samples=4 00:25:14.159 iops : min= 5796, max= 6234, avg=6118.50, stdev=215.23, samples=4 00:25:14.159 write: IOPS=6111, BW=23.9MiB/s (25.0MB/s)(47.9MiB/2008msec); 0 zone resets 00:25:14.159 slat (usec): min=2, max=102, avg= 2.55, stdev= 1.40 00:25:14.159 clat (usec): min=2069, max=15863, avg=9257.10, stdev=851.62 00:25:14.159 lat (usec): min=2075, max=15865, avg=9259.65, stdev=851.58 00:25:14.159 clat percentiles (usec): 00:25:14.159 | 1.00th=[ 7308], 5.00th=[ 7963], 10.00th=[ 8225], 20.00th=[ 8586], 00:25:14.159 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9503], 00:25:14.159 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:25:14.159 | 99.00th=[11076], 99.50th=[11469], 99.90th=[14615], 99.95th=[14746], 00:25:14.159 | 99.99th=[15795] 00:25:14.159 bw ( KiB/s): min=24216, max=24512, per=99.91%, avg=24422.00, stdev=140.61, samples=4 00:25:14.159 iops : min= 6054, max= 6128, avg=6105.50, stdev=35.15, samples=4 00:25:14.159 lat (msec) : 4=0.04%, 10=44.10%, 20=55.85% 00:25:14.159 cpu : usr=65.22%, sys=33.23%, ctx=111, majf=0, minf=41 00:25:14.159 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:14.159 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:14.159 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:14.159 issued rwts: total=12304,12271,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:14.159 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:14.159 00:25:14.159 Run status group 0 (all jobs): 00:25:14.159 READ: bw=23.9MiB/s (25.1MB/s), 23.9MiB/s-23.9MiB/s (25.1MB/s-25.1MB/s), io=48.1MiB (50.4MB), run=2008-2008msec 00:25:14.159 WRITE: bw=23.9MiB/s (25.0MB/s), 23.9MiB/s-23.9MiB/s (25.0MB/s-25.0MB/s), io=47.9MiB (50.3MB), run=2008-2008msec 00:25:14.159 19:23:32 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:14.159 19:23:32 -- host/fio.sh@74 -- # sync 00:25:14.159 19:23:32 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:18.341 19:23:36 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:18.341 19:23:36 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:21.620 19:23:39 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:21.620 19:23:40 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:23.518 19:23:41 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:23.518 19:23:41 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:23.518 19:23:41 -- host/fio.sh@86 -- # nvmftestfini 00:25:23.518 19:23:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:23.518 19:23:41 -- nvmf/common.sh@116 -- # sync 00:25:23.518 19:23:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:23.518 19:23:41 -- nvmf/common.sh@119 -- # set +e 00:25:23.518 19:23:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:23.518 19:23:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:23.518 rmmod nvme_tcp 00:25:23.518 rmmod nvme_fabrics 00:25:23.518 rmmod nvme_keyring 00:25:23.518 19:23:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:23.518 19:23:42 -- nvmf/common.sh@123 -- # set -e 00:25:23.518 19:23:42 -- nvmf/common.sh@124 -- # return 0 00:25:23.518 19:23:42 -- nvmf/common.sh@477 -- # '[' -n 3533458 ']' 00:25:23.518 19:23:42 -- nvmf/common.sh@478 -- # killprocess 3533458 00:25:23.518 19:23:42 -- common/autotest_common.sh@936 -- # '[' -z 3533458 ']' 00:25:23.518 19:23:42 -- common/autotest_common.sh@940 -- # kill -0 3533458 00:25:23.518 19:23:42 -- common/autotest_common.sh@941 -- # uname 00:25:23.519 19:23:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:23.519 19:23:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3533458 00:25:23.519 19:23:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:23.519 19:23:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:23.519 19:23:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3533458' 00:25:23.519 killing process with pid 3533458 00:25:23.519 19:23:42 -- common/autotest_common.sh@955 -- # kill 3533458 00:25:23.519 19:23:42 -- common/autotest_common.sh@960 -- # wait 3533458 00:25:23.777 19:23:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:23.777 19:23:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:23.777 19:23:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:23.777 19:23:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:23.777 19:23:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:23.777 19:23:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.777 19:23:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.777 19:23:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.305 19:23:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:26.305 00:25:26.305 real 0m38.388s 00:25:26.305 user 2m26.570s 00:25:26.305 sys 0m6.813s 00:25:26.305 19:23:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:26.305 19:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:26.305 ************************************ 00:25:26.305 END TEST nvmf_fio_host 00:25:26.305 ************************************ 00:25:26.305 19:23:44 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:26.305 19:23:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:26.305 19:23:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:26.305 19:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:26.305 ************************************ 00:25:26.305 START TEST nvmf_failover 00:25:26.305 ************************************ 00:25:26.305 19:23:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:26.305 * Looking for test storage... 00:25:26.305 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:26.305 19:23:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:26.305 19:23:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:26.305 19:23:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:26.305 19:23:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:26.305 19:23:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:26.305 19:23:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:26.305 19:23:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:26.305 19:23:44 -- scripts/common.sh@335 -- # IFS=.-: 00:25:26.305 19:23:44 -- scripts/common.sh@335 -- # read -ra ver1 00:25:26.305 19:23:44 -- scripts/common.sh@336 -- # IFS=.-: 00:25:26.305 19:23:44 -- scripts/common.sh@336 -- # read -ra ver2 00:25:26.305 19:23:44 -- scripts/common.sh@337 -- # local 'op=<' 00:25:26.305 19:23:44 -- scripts/common.sh@339 -- # ver1_l=2 00:25:26.305 19:23:44 -- scripts/common.sh@340 -- # ver2_l=1 00:25:26.305 19:23:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:26.305 19:23:44 -- scripts/common.sh@343 -- # case "$op" in 00:25:26.305 19:23:44 -- scripts/common.sh@344 -- # : 1 00:25:26.305 19:23:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:26.305 19:23:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:26.305 19:23:44 -- scripts/common.sh@364 -- # decimal 1 00:25:26.305 19:23:44 -- scripts/common.sh@352 -- # local d=1 00:25:26.305 19:23:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:26.305 19:23:44 -- scripts/common.sh@354 -- # echo 1 00:25:26.305 19:23:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:26.305 19:23:44 -- scripts/common.sh@365 -- # decimal 2 00:25:26.305 19:23:44 -- scripts/common.sh@352 -- # local d=2 00:25:26.305 19:23:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:26.305 19:23:44 -- scripts/common.sh@354 -- # echo 2 00:25:26.305 19:23:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:26.305 19:23:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:26.305 19:23:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:26.305 19:23:44 -- scripts/common.sh@367 -- # return 0 00:25:26.305 19:23:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:26.305 19:23:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:26.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.305 --rc genhtml_branch_coverage=1 00:25:26.305 --rc genhtml_function_coverage=1 00:25:26.305 --rc genhtml_legend=1 00:25:26.305 --rc geninfo_all_blocks=1 00:25:26.305 --rc geninfo_unexecuted_blocks=1 00:25:26.305 00:25:26.305 ' 00:25:26.305 19:23:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:26.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.305 --rc genhtml_branch_coverage=1 00:25:26.305 --rc genhtml_function_coverage=1 00:25:26.305 --rc genhtml_legend=1 00:25:26.305 --rc geninfo_all_blocks=1 00:25:26.305 --rc geninfo_unexecuted_blocks=1 00:25:26.305 00:25:26.305 ' 00:25:26.305 19:23:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:26.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.305 --rc genhtml_branch_coverage=1 00:25:26.305 --rc genhtml_function_coverage=1 00:25:26.305 --rc genhtml_legend=1 00:25:26.305 --rc geninfo_all_blocks=1 00:25:26.305 --rc geninfo_unexecuted_blocks=1 00:25:26.305 00:25:26.305 ' 00:25:26.305 19:23:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:26.305 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:26.305 --rc genhtml_branch_coverage=1 00:25:26.305 --rc genhtml_function_coverage=1 00:25:26.305 --rc genhtml_legend=1 00:25:26.305 --rc geninfo_all_blocks=1 00:25:26.305 --rc geninfo_unexecuted_blocks=1 00:25:26.305 00:25:26.305 ' 00:25:26.305 19:23:44 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:26.305 19:23:44 -- nvmf/common.sh@7 -- # uname -s 00:25:26.305 19:23:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:26.305 19:23:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:26.305 19:23:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:26.305 19:23:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:26.305 19:23:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:26.305 19:23:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:26.305 19:23:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:26.305 19:23:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:26.305 19:23:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:26.305 19:23:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:26.305 19:23:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:26.305 19:23:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:26.305 19:23:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:26.305 19:23:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:26.305 19:23:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:26.306 19:23:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:26.306 19:23:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:26.306 19:23:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:26.306 19:23:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:26.306 19:23:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.306 19:23:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.306 19:23:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.306 19:23:44 -- paths/export.sh@5 -- # export PATH 00:25:26.306 19:23:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:26.306 19:23:44 -- nvmf/common.sh@46 -- # : 0 00:25:26.306 19:23:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:26.306 19:23:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:26.306 19:23:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:26.306 19:23:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:26.306 19:23:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:26.306 19:23:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:26.306 19:23:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:26.306 19:23:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:26.306 19:23:44 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:26.306 19:23:44 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:26.306 19:23:44 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:26.306 19:23:44 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:26.306 19:23:44 -- host/failover.sh@18 -- # nvmftestinit 00:25:26.306 19:23:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:26.306 19:23:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:26.306 19:23:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:26.306 19:23:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:26.306 19:23:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:26.306 19:23:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.306 19:23:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.306 19:23:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:26.306 19:23:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:26.306 19:23:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:26.306 19:23:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:26.306 19:23:44 -- common/autotest_common.sh@10 -- # set +x 00:25:28.208 19:23:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:28.208 19:23:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:28.208 19:23:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:28.208 19:23:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:28.208 19:23:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:28.208 19:23:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:28.208 19:23:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:28.208 19:23:46 -- nvmf/common.sh@294 -- # net_devs=() 00:25:28.208 19:23:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:28.208 19:23:46 -- nvmf/common.sh@295 -- # e810=() 00:25:28.208 19:23:46 -- nvmf/common.sh@295 -- # local -ga e810 00:25:28.208 19:23:46 -- nvmf/common.sh@296 -- # x722=() 00:25:28.208 19:23:46 -- nvmf/common.sh@296 -- # local -ga x722 00:25:28.208 19:23:46 -- nvmf/common.sh@297 -- # mlx=() 00:25:28.208 19:23:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:28.208 19:23:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:28.208 19:23:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:28.208 19:23:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:28.208 19:23:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:28.208 19:23:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:28.208 19:23:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:28.208 19:23:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:28.208 19:23:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:28.208 19:23:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:28.208 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:28.208 19:23:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:28.208 19:23:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:28.209 19:23:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:28.209 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:28.209 19:23:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:28.209 19:23:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:28.209 19:23:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:28.209 19:23:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:28.209 19:23:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:28.209 19:23:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:28.209 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:28.209 19:23:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:28.209 19:23:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:28.209 19:23:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:28.209 19:23:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:28.209 19:23:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:28.209 19:23:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:28.209 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:28.209 19:23:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:28.209 19:23:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:28.209 19:23:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:28.209 19:23:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:28.209 19:23:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:28.209 19:23:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:28.209 19:23:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:28.209 19:23:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:28.209 19:23:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:28.209 19:23:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:28.209 19:23:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:28.209 19:23:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:28.209 19:23:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:28.209 19:23:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:28.209 19:23:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:28.209 19:23:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:28.209 19:23:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:28.209 19:23:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:28.209 19:23:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:28.209 19:23:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:28.209 19:23:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:28.209 19:23:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:28.209 19:23:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:28.209 19:23:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:28.209 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:28.209 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:25:28.209 00:25:28.209 --- 10.0.0.2 ping statistics --- 00:25:28.209 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:28.209 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:25:28.209 19:23:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:28.209 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:28.209 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:25:28.209 00:25:28.209 --- 10.0.0.1 ping statistics --- 00:25:28.209 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:28.209 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:25:28.209 19:23:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:28.209 19:23:46 -- nvmf/common.sh@410 -- # return 0 00:25:28.209 19:23:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:28.209 19:23:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:28.209 19:23:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:28.209 19:23:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:28.209 19:23:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:28.209 19:23:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:28.209 19:23:46 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:28.209 19:23:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:28.209 19:23:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:28.209 19:23:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.209 19:23:46 -- nvmf/common.sh@469 -- # nvmfpid=3539809 00:25:28.209 19:23:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:28.209 19:23:46 -- nvmf/common.sh@470 -- # waitforlisten 3539809 00:25:28.209 19:23:46 -- common/autotest_common.sh@829 -- # '[' -z 3539809 ']' 00:25:28.209 19:23:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:28.209 19:23:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:28.209 19:23:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:28.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:28.209 19:23:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:28.209 19:23:46 -- common/autotest_common.sh@10 -- # set +x 00:25:28.209 [2024-11-18 19:23:46.713715] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:28.209 [2024-11-18 19:23:46.713799] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:28.209 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.209 [2024-11-18 19:23:46.780016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:28.468 [2024-11-18 19:23:46.888693] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:28.468 [2024-11-18 19:23:46.888831] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:28.468 [2024-11-18 19:23:46.888848] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:28.468 [2024-11-18 19:23:46.888860] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:28.468 [2024-11-18 19:23:46.888953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:28.468 [2024-11-18 19:23:46.889020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:28.468 [2024-11-18 19:23:46.889023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:29.401 19:23:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:29.401 19:23:47 -- common/autotest_common.sh@862 -- # return 0 00:25:29.401 19:23:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:29.401 19:23:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:29.401 19:23:47 -- common/autotest_common.sh@10 -- # set +x 00:25:29.402 19:23:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:29.402 19:23:47 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:29.402 [2024-11-18 19:23:47.945560] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:29.402 19:23:47 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:29.660 Malloc0 00:25:29.660 19:23:48 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:29.918 19:23:48 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:30.176 19:23:48 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:30.436 [2024-11-18 19:23:48.974508] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:30.436 19:23:48 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:30.694 [2024-11-18 19:23:49.231325] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:30.694 19:23:49 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:30.953 [2024-11-18 19:23:49.480182] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:30.953 19:23:49 -- host/failover.sh@31 -- # bdevperf_pid=3540116 00:25:30.953 19:23:49 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:30.953 19:23:49 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:30.953 19:23:49 -- host/failover.sh@34 -- # waitforlisten 3540116 /var/tmp/bdevperf.sock 00:25:30.953 19:23:49 -- common/autotest_common.sh@829 -- # '[' -z 3540116 ']' 00:25:30.953 19:23:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:30.953 19:23:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:30.953 19:23:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:30.953 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:30.953 19:23:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:30.953 19:23:49 -- common/autotest_common.sh@10 -- # set +x 00:25:32.328 19:23:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:32.328 19:23:50 -- common/autotest_common.sh@862 -- # return 0 00:25:32.328 19:23:50 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:32.328 NVMe0n1 00:25:32.328 19:23:50 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:32.894 00:25:32.894 19:23:51 -- host/failover.sh@39 -- # run_test_pid=3540385 00:25:32.894 19:23:51 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:32.894 19:23:51 -- host/failover.sh@41 -- # sleep 1 00:25:33.890 19:23:52 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:33.890 [2024-11-18 19:23:52.448018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 [2024-11-18 19:23:52.448286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203dcb0 is same with the state(5) to be set 00:25:33.890 19:23:52 -- host/failover.sh@45 -- # sleep 3 00:25:37.172 19:23:55 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:37.430 00:25:37.430 19:23:55 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:37.690 [2024-11-18 19:23:56.138294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.138997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 [2024-11-18 19:23:56.139075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203f3a0 is same with the state(5) to be set 00:25:37.690 19:23:56 -- host/failover.sh@50 -- # sleep 3 00:25:40.979 19:23:59 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:40.979 [2024-11-18 19:23:59.436569] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:40.979 19:23:59 -- host/failover.sh@55 -- # sleep 1 00:25:41.919 19:24:00 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:42.179 [2024-11-18 19:24:00.722918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.722959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.722975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.722988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 [2024-11-18 19:24:00.723592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x203fa80 is same with the state(5) to be set 00:25:42.179 19:24:00 -- host/failover.sh@59 -- # wait 3540385 00:25:48.752 0 00:25:48.752 19:24:06 -- host/failover.sh@61 -- # killprocess 3540116 00:25:48.752 19:24:06 -- common/autotest_common.sh@936 -- # '[' -z 3540116 ']' 00:25:48.752 19:24:06 -- common/autotest_common.sh@940 -- # kill -0 3540116 00:25:48.752 19:24:06 -- common/autotest_common.sh@941 -- # uname 00:25:48.752 19:24:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:48.752 19:24:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3540116 00:25:48.752 19:24:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:48.752 19:24:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:48.752 19:24:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3540116' 00:25:48.752 killing process with pid 3540116 00:25:48.752 19:24:06 -- common/autotest_common.sh@955 -- # kill 3540116 00:25:48.752 19:24:06 -- common/autotest_common.sh@960 -- # wait 3540116 00:25:48.752 19:24:06 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:48.752 [2024-11-18 19:23:49.534819] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:48.752 [2024-11-18 19:23:49.534927] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3540116 ] 00:25:48.752 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.752 [2024-11-18 19:23:49.595127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:48.752 [2024-11-18 19:23:49.703956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:48.752 Running I/O for 15 seconds... 00:25:48.752 [2024-11-18 19:23:52.448582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.448949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.448988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:116608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:116640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:116656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:116664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:117176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.752 [2024-11-18 19:23:52.449221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.752 [2024-11-18 19:23:52.449263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.752 [2024-11-18 19:23:52.449276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:117200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:117216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:117224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:117232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:117248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:117264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:117272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:117280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:117288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:117304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:117312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:117320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:117328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:117336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.449811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:117344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:116672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:116680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:116688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.449980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.449993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:116744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:116752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:116792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:116800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.753 [2024-11-18 19:23:52.450322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.450349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:117360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.753 [2024-11-18 19:23:52.450378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.753 [2024-11-18 19:23:52.450393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:117368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.450406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:117376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.450434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:117384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.450463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:117392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.450499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:117400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:117424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:117432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:117440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:117448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.450729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:117456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.450758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:116968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:116976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:117016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.450983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.450998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:117464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:117472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:117480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:117488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:117496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:117504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:117512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:117528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:117576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:117592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.754 [2024-11-18 19:23:52.451498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.754 [2024-11-18 19:23:52.451556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.754 [2024-11-18 19:23:52.451571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:117616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.451585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:117632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.451676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:117648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.451735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:117664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.451794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:117680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:117688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.451882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.451956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:117712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.451984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.451999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:117736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.452076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:117760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.452180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:117768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.452225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:117776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.755 [2024-11-18 19:23:52.452255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:117112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.755 [2024-11-18 19:23:52.452540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca26a0 is same with the state(5) to be set 00:25:48.755 [2024-11-18 19:23:52.452572] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:48.755 [2024-11-18 19:23:52.452584] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:48.755 [2024-11-18 19:23:52.452618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117144 len:8 PRP1 0x0 PRP2 0x0 00:25:48.755 [2024-11-18 19:23:52.452633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452695] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ca26a0 was disconnected and freed. reset controller. 00:25:48.755 [2024-11-18 19:23:52.452721] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:48.755 [2024-11-18 19:23:52.452760] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.755 [2024-11-18 19:23:52.452779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.755 [2024-11-18 19:23:52.452809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452824] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.755 [2024-11-18 19:23:52.452837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452851] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.755 [2024-11-18 19:23:52.452865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.755 [2024-11-18 19:23:52.452889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:48.755 [2024-11-18 19:23:52.455296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:48.755 [2024-11-18 19:23:52.455334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c83870 (9): Bad file descriptor 00:25:48.755 [2024-11-18 19:23:52.486035] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:48.755 [2024-11-18 19:23:56.139223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:118320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.139978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.139993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:118584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.756 [2024-11-18 19:23:56.140123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.756 [2024-11-18 19:23:56.140250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.756 [2024-11-18 19:23:56.140265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:118112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:118608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:118616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:118632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:118640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:118672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:118696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:118720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.140922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:118728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.140979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.140994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:118744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:118768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:118816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:118824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:118832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:118840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:118848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:118856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.757 [2024-11-18 19:23:56.141442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.757 [2024-11-18 19:23:56.141456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.757 [2024-11-18 19:23:56.141470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:118888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.141528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:118896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.141557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:118920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.141926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.141954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.141983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:118936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.141996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:118952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:119016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:119024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:119032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.758 [2024-11-18 19:23:56.142575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.758 [2024-11-18 19:23:56.142633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.758 [2024-11-18 19:23:56.142649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.142663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:119056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.142703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:119064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.142733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:119072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.142764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.142793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:119088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.142823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.142856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:119104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.142888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:119112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.142933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.142962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.142977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.142990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.759 [2024-11-18 19:23:56.143024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:23:56.143242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c8fd10 is same with the state(5) to be set 00:25:48.759 [2024-11-18 19:23:56.143276] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:48.759 [2024-11-18 19:23:56.143288] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:48.759 [2024-11-18 19:23:56.143300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118576 len:8 PRP1 0x0 PRP2 0x0 00:25:48.759 [2024-11-18 19:23:56.143313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143390] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c8fd10 was disconnected and freed. reset controller. 00:25:48.759 [2024-11-18 19:23:56.143409] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:48.759 [2024-11-18 19:23:56.143445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:23:56.143474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:23:56.143512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:23:56.143540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143554] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:23:56.143568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:23:56.143583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:48.759 [2024-11-18 19:23:56.143643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c83870 (9): Bad file descriptor 00:25:48.759 [2024-11-18 19:23:56.145828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:48.759 [2024-11-18 19:23:56.221230] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:48.759 [2024-11-18 19:24:00.722538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:24:00.722612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.722633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:24:00.722648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.722672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:24:00.722686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.722700] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:48.759 [2024-11-18 19:24:00.722713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.722739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c83870 is same with the state(5) to be set 00:25:48.759 [2024-11-18 19:24:00.723747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:94368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.723773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.723801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:94376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.723818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.723835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:93616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.723850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.723866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:93624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.723880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.723900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:93632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.723914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.723945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:93672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.723959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.759 [2024-11-18 19:24:00.723973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:93680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.759 [2024-11-18 19:24:00.724002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:93688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:93696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:93704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:93712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:93728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:93744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:93752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:93768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:93776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:93784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:93792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:94392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:93816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:93824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:93832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:93856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:93864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:93888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:93896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:93904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:94432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:94440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:94448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:93920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:93928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:93936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:93944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:93952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:93960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:93968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:93976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.724977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:93984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.724992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.725021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:93992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.725035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.725050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:94008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.725063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.725079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:94080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.725092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.725107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:94088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.725120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.725138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:94128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.725152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.760 [2024-11-18 19:24:00.725167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:94136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.760 [2024-11-18 19:24:00.725181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:94144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:94456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:94464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:94472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:94480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:94488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:94496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:94504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:94512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:94520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:94528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:94536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:94544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:94552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:94560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:94568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:94576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:94584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:94592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:94600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:94608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:94616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:94624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.725944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:94632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.725974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.725989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:94640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.726002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:94648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.726037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:94656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.726066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:94664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.726094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:94672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.726123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:94680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.761 [2024-11-18 19:24:00.726150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:94152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.726182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:94184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.761 [2024-11-18 19:24:00.726210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.761 [2024-11-18 19:24:00.726225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:94208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:94240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:94280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:94320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:94328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:94336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:94688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:94696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:94704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:94712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:94720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:94728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:94736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:94744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:94752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:94760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:94768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:94776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:94784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:94792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:94800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:94808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:94816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:94824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.726952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:94832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.726982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.726998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:94840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.727013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:94848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.727043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:94856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.727072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:94864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:94872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:94880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.727159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:94888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:94896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:94904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:94912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.727276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:94920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:94928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.762 [2024-11-18 19:24:00.727338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:94936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:94944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.762 [2024-11-18 19:24:00.727411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:94952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.762 [2024-11-18 19:24:00.727425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:94960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.763 [2024-11-18 19:24:00.727454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:94968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:48.763 [2024-11-18 19:24:00.727483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:94976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:94344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:94352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:94360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:94384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:94400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:94408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:94416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:48.763 [2024-11-18 19:24:00.727748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ca6630 is same with the state(5) to be set 00:25:48.763 [2024-11-18 19:24:00.727781] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:48.763 [2024-11-18 19:24:00.727793] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:48.763 [2024-11-18 19:24:00.727805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:94424 len:8 PRP1 0x0 PRP2 0x0 00:25:48.763 [2024-11-18 19:24:00.727819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:48.763 [2024-11-18 19:24:00.727878] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ca6630 was disconnected and freed. reset controller. 00:25:48.763 [2024-11-18 19:24:00.727904] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:48.763 [2024-11-18 19:24:00.727921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:48.763 [2024-11-18 19:24:00.730099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:48.763 [2024-11-18 19:24:00.730139] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c83870 (9): Bad file descriptor 00:25:48.763 [2024-11-18 19:24:00.757302] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:48.763 00:25:48.763 Latency(us) 00:25:48.763 [2024-11-18T18:24:07.368Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.763 [2024-11-18T18:24:07.368Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:48.763 Verification LBA range: start 0x0 length 0x4000 00:25:48.763 NVMe0n1 : 15.01 12907.89 50.42 503.57 0.00 9527.23 734.25 15437.37 00:25:48.763 [2024-11-18T18:24:07.368Z] =================================================================================================================== 00:25:48.763 [2024-11-18T18:24:07.368Z] Total : 12907.89 50.42 503.57 0.00 9527.23 734.25 15437.37 00:25:48.763 Received shutdown signal, test time was about 15.000000 seconds 00:25:48.763 00:25:48.763 Latency(us) 00:25:48.763 [2024-11-18T18:24:07.368Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.763 [2024-11-18T18:24:07.368Z] =================================================================================================================== 00:25:48.763 [2024-11-18T18:24:07.368Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:48.763 19:24:06 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:48.763 19:24:06 -- host/failover.sh@65 -- # count=3 00:25:48.763 19:24:06 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:48.763 19:24:06 -- host/failover.sh@73 -- # bdevperf_pid=3542397 00:25:48.763 19:24:06 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:48.763 19:24:06 -- host/failover.sh@75 -- # waitforlisten 3542397 /var/tmp/bdevperf.sock 00:25:48.763 19:24:06 -- common/autotest_common.sh@829 -- # '[' -z 3542397 ']' 00:25:48.763 19:24:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:48.763 19:24:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:48.763 19:24:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:48.763 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:48.763 19:24:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:48.763 19:24:06 -- common/autotest_common.sh@10 -- # set +x 00:25:49.329 19:24:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:49.329 19:24:07 -- common/autotest_common.sh@862 -- # return 0 00:25:49.329 19:24:07 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:49.587 [2024-11-18 19:24:07.982725] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:49.587 19:24:08 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:49.845 [2024-11-18 19:24:08.231358] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:49.845 19:24:08 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:50.103 NVMe0n1 00:25:50.103 19:24:08 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:50.669 00:25:50.669 19:24:08 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:50.926 00:25:50.926 19:24:09 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:50.926 19:24:09 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:51.184 19:24:09 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:51.442 19:24:09 -- host/failover.sh@87 -- # sleep 3 00:25:54.724 19:24:12 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.724 19:24:12 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:54.724 19:24:13 -- host/failover.sh@90 -- # run_test_pid=3543606 00:25:54.724 19:24:13 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:54.724 19:24:13 -- host/failover.sh@92 -- # wait 3543606 00:25:55.660 0 00:25:55.660 19:24:14 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:55.660 [2024-11-18 19:24:06.730377] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:55.660 [2024-11-18 19:24:06.730474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3542397 ] 00:25:55.660 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.660 [2024-11-18 19:24:06.788769] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:55.660 [2024-11-18 19:24:06.892875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:55.660 [2024-11-18 19:24:09.799023] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:55.660 [2024-11-18 19:24:09.799118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.660 [2024-11-18 19:24:09.799143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.660 [2024-11-18 19:24:09.799160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.660 [2024-11-18 19:24:09.799189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.660 [2024-11-18 19:24:09.799205] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.660 [2024-11-18 19:24:09.799219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.660 [2024-11-18 19:24:09.799234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:55.660 [2024-11-18 19:24:09.799248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:55.660 [2024-11-18 19:24:09.799263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:55.660 [2024-11-18 19:24:09.799302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:55.660 [2024-11-18 19:24:09.799335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7bc870 (9): Bad file descriptor 00:25:55.660 [2024-11-18 19:24:09.890726] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:55.660 Running I/O for 1 seconds... 00:25:55.660 00:25:55.660 Latency(us) 00:25:55.660 [2024-11-18T18:24:14.265Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:55.660 [2024-11-18T18:24:14.265Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:55.660 Verification LBA range: start 0x0 length 0x4000 00:25:55.660 NVMe0n1 : 1.01 12836.52 50.14 0.00 0.00 9917.67 1498.83 15146.10 00:25:55.660 [2024-11-18T18:24:14.265Z] =================================================================================================================== 00:25:55.660 [2024-11-18T18:24:14.265Z] Total : 12836.52 50.14 0.00 0.00 9917.67 1498.83 15146.10 00:25:55.660 19:24:14 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:55.660 19:24:14 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:55.918 19:24:14 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:56.175 19:24:14 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:56.175 19:24:14 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:56.433 19:24:14 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:56.692 19:24:15 -- host/failover.sh@101 -- # sleep 3 00:25:59.973 19:24:18 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:59.973 19:24:18 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:59.973 19:24:18 -- host/failover.sh@108 -- # killprocess 3542397 00:25:59.973 19:24:18 -- common/autotest_common.sh@936 -- # '[' -z 3542397 ']' 00:25:59.973 19:24:18 -- common/autotest_common.sh@940 -- # kill -0 3542397 00:25:59.973 19:24:18 -- common/autotest_common.sh@941 -- # uname 00:25:59.973 19:24:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.973 19:24:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3542397 00:25:59.973 19:24:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:59.973 19:24:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:59.973 19:24:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3542397' 00:25:59.973 killing process with pid 3542397 00:25:59.973 19:24:18 -- common/autotest_common.sh@955 -- # kill 3542397 00:25:59.973 19:24:18 -- common/autotest_common.sh@960 -- # wait 3542397 00:26:00.230 19:24:18 -- host/failover.sh@110 -- # sync 00:26:00.231 19:24:18 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:00.489 19:24:19 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:00.489 19:24:19 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:00.489 19:24:19 -- host/failover.sh@116 -- # nvmftestfini 00:26:00.489 19:24:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:00.489 19:24:19 -- nvmf/common.sh@116 -- # sync 00:26:00.489 19:24:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:00.489 19:24:19 -- nvmf/common.sh@119 -- # set +e 00:26:00.489 19:24:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:00.489 19:24:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:00.489 rmmod nvme_tcp 00:26:00.754 rmmod nvme_fabrics 00:26:00.754 rmmod nvme_keyring 00:26:00.754 19:24:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:00.754 19:24:19 -- nvmf/common.sh@123 -- # set -e 00:26:00.754 19:24:19 -- nvmf/common.sh@124 -- # return 0 00:26:00.754 19:24:19 -- nvmf/common.sh@477 -- # '[' -n 3539809 ']' 00:26:00.754 19:24:19 -- nvmf/common.sh@478 -- # killprocess 3539809 00:26:00.754 19:24:19 -- common/autotest_common.sh@936 -- # '[' -z 3539809 ']' 00:26:00.754 19:24:19 -- common/autotest_common.sh@940 -- # kill -0 3539809 00:26:00.754 19:24:19 -- common/autotest_common.sh@941 -- # uname 00:26:00.754 19:24:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:00.754 19:24:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3539809 00:26:00.754 19:24:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:00.754 19:24:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:00.754 19:24:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3539809' 00:26:00.754 killing process with pid 3539809 00:26:00.754 19:24:19 -- common/autotest_common.sh@955 -- # kill 3539809 00:26:00.754 19:24:19 -- common/autotest_common.sh@960 -- # wait 3539809 00:26:01.012 19:24:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:01.012 19:24:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:01.012 19:24:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:01.012 19:24:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:01.012 19:24:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:01.012 19:24:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.012 19:24:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.012 19:24:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:02.915 19:24:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:02.915 00:26:02.915 real 0m37.104s 00:26:02.915 user 2m11.567s 00:26:02.915 sys 0m5.892s 00:26:02.915 19:24:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:02.915 19:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:02.915 ************************************ 00:26:02.915 END TEST nvmf_failover 00:26:02.915 ************************************ 00:26:03.175 19:24:21 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:03.175 19:24:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:03.175 19:24:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:03.175 19:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:03.175 ************************************ 00:26:03.175 START TEST nvmf_discovery 00:26:03.175 ************************************ 00:26:03.175 19:24:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:03.175 * Looking for test storage... 00:26:03.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:03.175 19:24:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:03.175 19:24:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:03.175 19:24:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:03.175 19:24:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:03.175 19:24:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:03.175 19:24:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:03.175 19:24:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:03.175 19:24:21 -- scripts/common.sh@335 -- # IFS=.-: 00:26:03.175 19:24:21 -- scripts/common.sh@335 -- # read -ra ver1 00:26:03.175 19:24:21 -- scripts/common.sh@336 -- # IFS=.-: 00:26:03.175 19:24:21 -- scripts/common.sh@336 -- # read -ra ver2 00:26:03.175 19:24:21 -- scripts/common.sh@337 -- # local 'op=<' 00:26:03.175 19:24:21 -- scripts/common.sh@339 -- # ver1_l=2 00:26:03.175 19:24:21 -- scripts/common.sh@340 -- # ver2_l=1 00:26:03.175 19:24:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:03.175 19:24:21 -- scripts/common.sh@343 -- # case "$op" in 00:26:03.175 19:24:21 -- scripts/common.sh@344 -- # : 1 00:26:03.175 19:24:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:03.175 19:24:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:03.175 19:24:21 -- scripts/common.sh@364 -- # decimal 1 00:26:03.175 19:24:21 -- scripts/common.sh@352 -- # local d=1 00:26:03.175 19:24:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:03.175 19:24:21 -- scripts/common.sh@354 -- # echo 1 00:26:03.175 19:24:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:03.175 19:24:21 -- scripts/common.sh@365 -- # decimal 2 00:26:03.175 19:24:21 -- scripts/common.sh@352 -- # local d=2 00:26:03.175 19:24:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:03.175 19:24:21 -- scripts/common.sh@354 -- # echo 2 00:26:03.175 19:24:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:03.175 19:24:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:03.175 19:24:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:03.175 19:24:21 -- scripts/common.sh@367 -- # return 0 00:26:03.175 19:24:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:03.175 19:24:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:03.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.175 --rc genhtml_branch_coverage=1 00:26:03.175 --rc genhtml_function_coverage=1 00:26:03.175 --rc genhtml_legend=1 00:26:03.175 --rc geninfo_all_blocks=1 00:26:03.175 --rc geninfo_unexecuted_blocks=1 00:26:03.175 00:26:03.175 ' 00:26:03.175 19:24:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:03.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.175 --rc genhtml_branch_coverage=1 00:26:03.175 --rc genhtml_function_coverage=1 00:26:03.175 --rc genhtml_legend=1 00:26:03.175 --rc geninfo_all_blocks=1 00:26:03.175 --rc geninfo_unexecuted_blocks=1 00:26:03.175 00:26:03.175 ' 00:26:03.175 19:24:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:03.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.175 --rc genhtml_branch_coverage=1 00:26:03.175 --rc genhtml_function_coverage=1 00:26:03.175 --rc genhtml_legend=1 00:26:03.175 --rc geninfo_all_blocks=1 00:26:03.175 --rc geninfo_unexecuted_blocks=1 00:26:03.175 00:26:03.175 ' 00:26:03.175 19:24:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:03.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.175 --rc genhtml_branch_coverage=1 00:26:03.175 --rc genhtml_function_coverage=1 00:26:03.175 --rc genhtml_legend=1 00:26:03.175 --rc geninfo_all_blocks=1 00:26:03.175 --rc geninfo_unexecuted_blocks=1 00:26:03.175 00:26:03.175 ' 00:26:03.175 19:24:21 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:03.175 19:24:21 -- nvmf/common.sh@7 -- # uname -s 00:26:03.175 19:24:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:03.175 19:24:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:03.175 19:24:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:03.175 19:24:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:03.175 19:24:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:03.175 19:24:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:03.175 19:24:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:03.175 19:24:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:03.175 19:24:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:03.175 19:24:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:03.175 19:24:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.175 19:24:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.175 19:24:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:03.175 19:24:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:03.175 19:24:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:03.175 19:24:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:03.175 19:24:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:03.175 19:24:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:03.175 19:24:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:03.175 19:24:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.175 19:24:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.175 19:24:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.175 19:24:21 -- paths/export.sh@5 -- # export PATH 00:26:03.175 19:24:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.175 19:24:21 -- nvmf/common.sh@46 -- # : 0 00:26:03.175 19:24:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:03.175 19:24:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:03.175 19:24:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:03.175 19:24:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:03.175 19:24:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:03.175 19:24:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:03.175 19:24:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:03.175 19:24:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:03.175 19:24:21 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:03.175 19:24:21 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:03.175 19:24:21 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:03.175 19:24:21 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:03.175 19:24:21 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:03.175 19:24:21 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:03.175 19:24:21 -- host/discovery.sh@25 -- # nvmftestinit 00:26:03.175 19:24:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:03.175 19:24:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:03.176 19:24:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:03.176 19:24:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:03.176 19:24:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:03.176 19:24:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:03.176 19:24:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:03.176 19:24:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.176 19:24:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:03.176 19:24:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:03.176 19:24:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:03.176 19:24:21 -- common/autotest_common.sh@10 -- # set +x 00:26:05.077 19:24:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:05.077 19:24:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:05.077 19:24:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:05.077 19:24:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:05.077 19:24:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:05.077 19:24:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:05.077 19:24:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:05.077 19:24:23 -- nvmf/common.sh@294 -- # net_devs=() 00:26:05.077 19:24:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:05.077 19:24:23 -- nvmf/common.sh@295 -- # e810=() 00:26:05.077 19:24:23 -- nvmf/common.sh@295 -- # local -ga e810 00:26:05.077 19:24:23 -- nvmf/common.sh@296 -- # x722=() 00:26:05.077 19:24:23 -- nvmf/common.sh@296 -- # local -ga x722 00:26:05.077 19:24:23 -- nvmf/common.sh@297 -- # mlx=() 00:26:05.077 19:24:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:05.077 19:24:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:05.077 19:24:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:05.077 19:24:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:05.077 19:24:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:05.077 19:24:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.077 19:24:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:05.077 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:05.077 19:24:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:05.077 19:24:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:05.077 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:05.077 19:24:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:05.077 19:24:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.077 19:24:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.077 19:24:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.077 19:24:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.077 19:24:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:05.077 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:05.077 19:24:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.077 19:24:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:05.077 19:24:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:05.077 19:24:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:05.077 19:24:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:05.077 19:24:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:05.077 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:05.077 19:24:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:05.077 19:24:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:05.077 19:24:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:05.077 19:24:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:05.077 19:24:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:05.077 19:24:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:05.077 19:24:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:05.077 19:24:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:05.077 19:24:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:05.077 19:24:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:05.077 19:24:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:05.077 19:24:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:05.077 19:24:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:05.077 19:24:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:05.077 19:24:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:05.077 19:24:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:05.077 19:24:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:05.077 19:24:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:05.336 19:24:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:05.336 19:24:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:05.336 19:24:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:05.336 19:24:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:05.336 19:24:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:05.336 19:24:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:05.336 19:24:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:05.336 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:05.336 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:26:05.336 00:26:05.336 --- 10.0.0.2 ping statistics --- 00:26:05.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.336 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:26:05.336 19:24:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:05.336 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:05.336 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:26:05.336 00:26:05.336 --- 10.0.0.1 ping statistics --- 00:26:05.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:05.336 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:26:05.336 19:24:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:05.336 19:24:23 -- nvmf/common.sh@410 -- # return 0 00:26:05.336 19:24:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:05.336 19:24:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:05.336 19:24:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:05.336 19:24:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:05.336 19:24:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:05.336 19:24:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:05.336 19:24:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:05.336 19:24:23 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:05.336 19:24:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:05.336 19:24:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:05.336 19:24:23 -- common/autotest_common.sh@10 -- # set +x 00:26:05.336 19:24:23 -- nvmf/common.sh@469 -- # nvmfpid=3546359 00:26:05.336 19:24:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:05.336 19:24:23 -- nvmf/common.sh@470 -- # waitforlisten 3546359 00:26:05.336 19:24:23 -- common/autotest_common.sh@829 -- # '[' -z 3546359 ']' 00:26:05.336 19:24:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:05.336 19:24:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:05.337 19:24:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:05.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:05.337 19:24:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:05.337 19:24:23 -- common/autotest_common.sh@10 -- # set +x 00:26:05.337 [2024-11-18 19:24:23.816906] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:05.337 [2024-11-18 19:24:23.817003] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:05.337 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.337 [2024-11-18 19:24:23.879215] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:05.595 [2024-11-18 19:24:23.994191] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:05.596 [2024-11-18 19:24:23.994352] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:05.596 [2024-11-18 19:24:23.994372] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:05.596 [2024-11-18 19:24:23.994387] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:05.596 [2024-11-18 19:24:23.994418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:06.531 19:24:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.531 19:24:24 -- common/autotest_common.sh@862 -- # return 0 00:26:06.531 19:24:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:06.531 19:24:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 19:24:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:06.531 19:24:24 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:06.531 19:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 [2024-11-18 19:24:24.840113] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:06.531 19:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.531 19:24:24 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:06.531 19:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 [2024-11-18 19:24:24.848301] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:06.531 19:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.531 19:24:24 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:06.531 19:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 null0 00:26:06.531 19:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.531 19:24:24 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:06.531 19:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 null1 00:26:06.531 19:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.531 19:24:24 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:06.531 19:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 19:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.531 19:24:24 -- host/discovery.sh@45 -- # hostpid=3546517 00:26:06.531 19:24:24 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:06.531 19:24:24 -- host/discovery.sh@46 -- # waitforlisten 3546517 /tmp/host.sock 00:26:06.531 19:24:24 -- common/autotest_common.sh@829 -- # '[' -z 3546517 ']' 00:26:06.531 19:24:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:06.531 19:24:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:06.531 19:24:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:06.531 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:06.531 19:24:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:06.531 19:24:24 -- common/autotest_common.sh@10 -- # set +x 00:26:06.531 [2024-11-18 19:24:24.914573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.531 [2024-11-18 19:24:24.914660] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3546517 ] 00:26:06.531 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.531 [2024-11-18 19:24:24.974286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:06.531 [2024-11-18 19:24:25.088058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:06.531 [2024-11-18 19:24:25.088224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:07.467 19:24:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:07.467 19:24:25 -- common/autotest_common.sh@862 -- # return 0 00:26:07.467 19:24:25 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:07.467 19:24:25 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:07.467 19:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.467 19:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:07.467 19:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.467 19:24:25 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:07.467 19:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.467 19:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:07.467 19:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.467 19:24:25 -- host/discovery.sh@72 -- # notify_id=0 00:26:07.467 19:24:25 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.467 19:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.467 19:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # sort 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # xargs 00:26:07.467 19:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.467 19:24:25 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:07.467 19:24:25 -- host/discovery.sh@79 -- # get_bdev_list 00:26:07.467 19:24:25 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.467 19:24:25 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.467 19:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.467 19:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:07.467 19:24:25 -- host/discovery.sh@55 -- # sort 00:26:07.467 19:24:25 -- host/discovery.sh@55 -- # xargs 00:26:07.467 19:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.467 19:24:25 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:07.467 19:24:25 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:07.467 19:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.467 19:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:07.467 19:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.467 19:24:25 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.467 19:24:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.467 19:24:25 -- common/autotest_common.sh@10 -- # set +x 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # sort 00:26:07.467 19:24:25 -- host/discovery.sh@59 -- # xargs 00:26:07.467 19:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.467 19:24:26 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:07.467 19:24:26 -- host/discovery.sh@83 -- # get_bdev_list 00:26:07.467 19:24:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.468 19:24:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.468 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.468 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.468 19:24:26 -- host/discovery.sh@55 -- # sort 00:26:07.468 19:24:26 -- host/discovery.sh@55 -- # xargs 00:26:07.468 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.468 19:24:26 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:07.468 19:24:26 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:07.468 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.468 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # sort 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # xargs 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:07.726 19:24:26 -- host/discovery.sh@87 -- # get_bdev_list 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # sort 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # xargs 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:07.726 19:24:26 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 [2024-11-18 19:24:26.159917] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # sort 00:26:07.726 19:24:26 -- host/discovery.sh@59 -- # xargs 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:07.726 19:24:26 -- host/discovery.sh@93 -- # get_bdev_list 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # sort 00:26:07.726 19:24:26 -- host/discovery.sh@55 -- # xargs 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:07.726 19:24:26 -- host/discovery.sh@94 -- # get_notification_count 00:26:07.726 19:24:26 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:07.726 19:24:26 -- host/discovery.sh@74 -- # jq '. | length' 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@74 -- # notification_count=0 00:26:07.726 19:24:26 -- host/discovery.sh@75 -- # notify_id=0 00:26:07.726 19:24:26 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:07.726 19:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.726 19:24:26 -- common/autotest_common.sh@10 -- # set +x 00:26:07.726 19:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.726 19:24:26 -- host/discovery.sh@100 -- # sleep 1 00:26:08.661 [2024-11-18 19:24:26.940751] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:08.661 [2024-11-18 19:24:26.940780] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:08.661 [2024-11-18 19:24:26.940809] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:08.661 [2024-11-18 19:24:27.027108] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:08.661 [2024-11-18 19:24:27.251219] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:08.661 [2024-11-18 19:24:27.251246] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:08.922 19:24:27 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:08.922 19:24:27 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:08.922 19:24:27 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:08.922 19:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.922 19:24:27 -- host/discovery.sh@59 -- # sort 00:26:08.922 19:24:27 -- common/autotest_common.sh@10 -- # set +x 00:26:08.922 19:24:27 -- host/discovery.sh@59 -- # xargs 00:26:08.922 19:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@102 -- # get_bdev_list 00:26:08.922 19:24:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.922 19:24:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:08.922 19:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.922 19:24:27 -- common/autotest_common.sh@10 -- # set +x 00:26:08.922 19:24:27 -- host/discovery.sh@55 -- # sort 00:26:08.922 19:24:27 -- host/discovery.sh@55 -- # xargs 00:26:08.922 19:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:08.922 19:24:27 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:08.922 19:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.922 19:24:27 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:08.922 19:24:27 -- common/autotest_common.sh@10 -- # set +x 00:26:08.922 19:24:27 -- host/discovery.sh@63 -- # sort -n 00:26:08.922 19:24:27 -- host/discovery.sh@63 -- # xargs 00:26:08.922 19:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@104 -- # get_notification_count 00:26:08.922 19:24:27 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:08.922 19:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.922 19:24:27 -- host/discovery.sh@74 -- # jq '. | length' 00:26:08.922 19:24:27 -- common/autotest_common.sh@10 -- # set +x 00:26:08.922 19:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@74 -- # notification_count=1 00:26:08.922 19:24:27 -- host/discovery.sh@75 -- # notify_id=1 00:26:08.922 19:24:27 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:08.922 19:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.922 19:24:27 -- common/autotest_common.sh@10 -- # set +x 00:26:08.922 19:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.922 19:24:27 -- host/discovery.sh@109 -- # sleep 1 00:26:09.857 19:24:28 -- host/discovery.sh@110 -- # get_bdev_list 00:26:09.857 19:24:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.857 19:24:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:09.857 19:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.857 19:24:28 -- common/autotest_common.sh@10 -- # set +x 00:26:09.857 19:24:28 -- host/discovery.sh@55 -- # sort 00:26:10.115 19:24:28 -- host/discovery.sh@55 -- # xargs 00:26:10.115 19:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.115 19:24:28 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:10.115 19:24:28 -- host/discovery.sh@111 -- # get_notification_count 00:26:10.115 19:24:28 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:10.115 19:24:28 -- host/discovery.sh@74 -- # jq '. | length' 00:26:10.115 19:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.115 19:24:28 -- common/autotest_common.sh@10 -- # set +x 00:26:10.115 19:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.115 19:24:28 -- host/discovery.sh@74 -- # notification_count=1 00:26:10.115 19:24:28 -- host/discovery.sh@75 -- # notify_id=2 00:26:10.115 19:24:28 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:10.115 19:24:28 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:10.115 19:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.115 19:24:28 -- common/autotest_common.sh@10 -- # set +x 00:26:10.115 [2024-11-18 19:24:28.535011] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:10.115 [2024-11-18 19:24:28.535753] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:10.115 [2024-11-18 19:24:28.535801] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:10.115 19:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.115 19:24:28 -- host/discovery.sh@117 -- # sleep 1 00:26:10.115 [2024-11-18 19:24:28.662225] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:10.373 [2024-11-18 19:24:28.965681] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:10.373 [2024-11-18 19:24:28.965702] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:10.373 [2024-11-18 19:24:28.965711] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:11.306 19:24:29 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:11.306 19:24:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.306 19:24:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.306 19:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.306 19:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:11.306 19:24:29 -- host/discovery.sh@59 -- # sort 00:26:11.306 19:24:29 -- host/discovery.sh@59 -- # xargs 00:26:11.306 19:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@119 -- # get_bdev_list 00:26:11.306 19:24:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.306 19:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.306 19:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:11.306 19:24:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.306 19:24:29 -- host/discovery.sh@55 -- # sort 00:26:11.306 19:24:29 -- host/discovery.sh@55 -- # xargs 00:26:11.306 19:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:11.306 19:24:29 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:11.306 19:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.306 19:24:29 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:11.306 19:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:11.306 19:24:29 -- host/discovery.sh@63 -- # sort -n 00:26:11.306 19:24:29 -- host/discovery.sh@63 -- # xargs 00:26:11.306 19:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@121 -- # get_notification_count 00:26:11.306 19:24:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:11.306 19:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.306 19:24:29 -- host/discovery.sh@74 -- # jq '. | length' 00:26:11.306 19:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:11.306 19:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@74 -- # notification_count=0 00:26:11.306 19:24:29 -- host/discovery.sh@75 -- # notify_id=2 00:26:11.306 19:24:29 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:11.306 19:24:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.306 19:24:29 -- common/autotest_common.sh@10 -- # set +x 00:26:11.306 [2024-11-18 19:24:29.714565] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:11.306 [2024-11-18 19:24:29.714618] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:11.306 19:24:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.306 19:24:29 -- host/discovery.sh@127 -- # sleep 1 00:26:11.306 [2024-11-18 19:24:29.724538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.306 [2024-11-18 19:24:29.724576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.306 [2024-11-18 19:24:29.724595] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.306 [2024-11-18 19:24:29.724619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.307 [2024-11-18 19:24:29.724662] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.307 [2024-11-18 19:24:29.724676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.307 [2024-11-18 19:24:29.724691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.307 [2024-11-18 19:24:29.724704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.307 [2024-11-18 19:24:29.724718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.734541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.744591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.307 [2024-11-18 19:24:29.744896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.745038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.745064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f5810 with addr=10.0.0.2, port=4420 00:26:11.307 [2024-11-18 19:24:29.745082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.745123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.745173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.307 [2024-11-18 19:24:29.745196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.307 [2024-11-18 19:24:29.745224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.307 [2024-11-18 19:24:29.745248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.307 [2024-11-18 19:24:29.754677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.307 [2024-11-18 19:24:29.754866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.754992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.755022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f5810 with addr=10.0.0.2, port=4420 00:26:11.307 [2024-11-18 19:24:29.755040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.755065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.755089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.307 [2024-11-18 19:24:29.755105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.307 [2024-11-18 19:24:29.755121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.307 [2024-11-18 19:24:29.755142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.307 [2024-11-18 19:24:29.764747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.307 [2024-11-18 19:24:29.764910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.765046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.765074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f5810 with addr=10.0.0.2, port=4420 00:26:11.307 [2024-11-18 19:24:29.765093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.765118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.765141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.307 [2024-11-18 19:24:29.765158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.307 [2024-11-18 19:24:29.765173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.307 [2024-11-18 19:24:29.765195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.307 [2024-11-18 19:24:29.774819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.307 [2024-11-18 19:24:29.774994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.775168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.775196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f5810 with addr=10.0.0.2, port=4420 00:26:11.307 [2024-11-18 19:24:29.775213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.775236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.775257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.307 [2024-11-18 19:24:29.775271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.307 [2024-11-18 19:24:29.775285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.307 [2024-11-18 19:24:29.775310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.307 [2024-11-18 19:24:29.784905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.307 [2024-11-18 19:24:29.785080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.785235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.785264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f5810 with addr=10.0.0.2, port=4420 00:26:11.307 [2024-11-18 19:24:29.785283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.785309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.785345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.307 [2024-11-18 19:24:29.785364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.307 [2024-11-18 19:24:29.785382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.307 [2024-11-18 19:24:29.785418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.307 [2024-11-18 19:24:29.794983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:11.307 [2024-11-18 19:24:29.795133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.795292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:11.307 [2024-11-18 19:24:29.795322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17f5810 with addr=10.0.0.2, port=4420 00:26:11.307 [2024-11-18 19:24:29.795341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x17f5810 is same with the state(5) to be set 00:26:11.307 [2024-11-18 19:24:29.795366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x17f5810 (9): Bad file descriptor 00:26:11.307 [2024-11-18 19:24:29.795390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:11.307 [2024-11-18 19:24:29.795405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:11.307 [2024-11-18 19:24:29.795421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:11.307 [2024-11-18 19:24:29.795457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:11.307 [2024-11-18 19:24:29.801440] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:11.307 [2024-11-18 19:24:29.801470] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:12.242 19:24:30 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:12.242 19:24:30 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:12.242 19:24:30 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:12.242 19:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.242 19:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:12.242 19:24:30 -- host/discovery.sh@59 -- # sort 00:26:12.242 19:24:30 -- host/discovery.sh@59 -- # xargs 00:26:12.242 19:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.242 19:24:30 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:12.242 19:24:30 -- host/discovery.sh@129 -- # get_bdev_list 00:26:12.242 19:24:30 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:12.242 19:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.242 19:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:12.242 19:24:30 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:12.242 19:24:30 -- host/discovery.sh@55 -- # sort 00:26:12.242 19:24:30 -- host/discovery.sh@55 -- # xargs 00:26:12.242 19:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.242 19:24:30 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:12.242 19:24:30 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:12.242 19:24:30 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:12.242 19:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.242 19:24:30 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:12.242 19:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:12.243 19:24:30 -- host/discovery.sh@63 -- # sort -n 00:26:12.243 19:24:30 -- host/discovery.sh@63 -- # xargs 00:26:12.243 19:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.243 19:24:30 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:12.243 19:24:30 -- host/discovery.sh@131 -- # get_notification_count 00:26:12.243 19:24:30 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:12.243 19:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.243 19:24:30 -- host/discovery.sh@74 -- # jq '. | length' 00:26:12.243 19:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:12.501 19:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.501 19:24:30 -- host/discovery.sh@74 -- # notification_count=0 00:26:12.501 19:24:30 -- host/discovery.sh@75 -- # notify_id=2 00:26:12.501 19:24:30 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:12.501 19:24:30 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:12.501 19:24:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:12.501 19:24:30 -- common/autotest_common.sh@10 -- # set +x 00:26:12.501 19:24:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:12.501 19:24:30 -- host/discovery.sh@135 -- # sleep 1 00:26:13.567 19:24:31 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:13.567 19:24:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:13.567 19:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.567 19:24:31 -- common/autotest_common.sh@10 -- # set +x 00:26:13.567 19:24:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:13.567 19:24:31 -- host/discovery.sh@59 -- # sort 00:26:13.567 19:24:31 -- host/discovery.sh@59 -- # xargs 00:26:13.567 19:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.567 19:24:31 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:13.567 19:24:31 -- host/discovery.sh@137 -- # get_bdev_list 00:26:13.567 19:24:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.567 19:24:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.567 19:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.567 19:24:31 -- host/discovery.sh@55 -- # sort 00:26:13.567 19:24:31 -- common/autotest_common.sh@10 -- # set +x 00:26:13.567 19:24:31 -- host/discovery.sh@55 -- # xargs 00:26:13.567 19:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.567 19:24:31 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:13.567 19:24:31 -- host/discovery.sh@138 -- # get_notification_count 00:26:13.567 19:24:31 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:13.567 19:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.567 19:24:31 -- common/autotest_common.sh@10 -- # set +x 00:26:13.567 19:24:31 -- host/discovery.sh@74 -- # jq '. | length' 00:26:13.567 19:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.567 19:24:32 -- host/discovery.sh@74 -- # notification_count=2 00:26:13.567 19:24:32 -- host/discovery.sh@75 -- # notify_id=4 00:26:13.567 19:24:32 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:13.567 19:24:32 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.567 19:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.567 19:24:32 -- common/autotest_common.sh@10 -- # set +x 00:26:14.496 [2024-11-18 19:24:33.024819] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:14.496 [2024-11-18 19:24:33.024854] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:14.496 [2024-11-18 19:24:33.024877] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:14.752 [2024-11-18 19:24:33.113198] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:15.009 [2024-11-18 19:24:33.421135] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:15.009 [2024-11-18 19:24:33.421176] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.009 19:24:33 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:15.009 19:24:33 -- common/autotest_common.sh@650 -- # local es=0 00:26:15.009 19:24:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:15.009 19:24:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:15.009 19:24:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:15.009 19:24:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:15.009 19:24:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:15.009 19:24:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:15.009 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.009 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:15.009 request: 00:26:15.009 { 00:26:15.009 "name": "nvme", 00:26:15.009 "trtype": "tcp", 00:26:15.009 "traddr": "10.0.0.2", 00:26:15.009 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:15.009 "adrfam": "ipv4", 00:26:15.009 "trsvcid": "8009", 00:26:15.009 "wait_for_attach": true, 00:26:15.009 "method": "bdev_nvme_start_discovery", 00:26:15.009 "req_id": 1 00:26:15.009 } 00:26:15.009 Got JSON-RPC error response 00:26:15.009 response: 00:26:15.009 { 00:26:15.009 "code": -17, 00:26:15.009 "message": "File exists" 00:26:15.009 } 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:15.009 19:24:33 -- common/autotest_common.sh@653 -- # es=1 00:26:15.009 19:24:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:15.009 19:24:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:15.009 19:24:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:15.009 19:24:33 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:15.009 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # sort 00:26:15.009 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # xargs 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.009 19:24:33 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:15.009 19:24:33 -- host/discovery.sh@147 -- # get_bdev_list 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.009 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # sort 00:26:15.009 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # xargs 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.009 19:24:33 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:15.009 19:24:33 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:15.009 19:24:33 -- common/autotest_common.sh@650 -- # local es=0 00:26:15.009 19:24:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:15.009 19:24:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:15.009 19:24:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:15.009 19:24:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:15.009 19:24:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:15.009 19:24:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:15.009 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.009 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:15.009 request: 00:26:15.009 { 00:26:15.009 "name": "nvme_second", 00:26:15.009 "trtype": "tcp", 00:26:15.009 "traddr": "10.0.0.2", 00:26:15.009 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:15.009 "adrfam": "ipv4", 00:26:15.009 "trsvcid": "8009", 00:26:15.009 "wait_for_attach": true, 00:26:15.009 "method": "bdev_nvme_start_discovery", 00:26:15.009 "req_id": 1 00:26:15.009 } 00:26:15.009 Got JSON-RPC error response 00:26:15.009 response: 00:26:15.009 { 00:26:15.009 "code": -17, 00:26:15.009 "message": "File exists" 00:26:15.009 } 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:15.009 19:24:33 -- common/autotest_common.sh@653 -- # es=1 00:26:15.009 19:24:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:15.009 19:24:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:15.009 19:24:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:15.009 19:24:33 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:15.009 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.009 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # sort 00:26:15.009 19:24:33 -- host/discovery.sh@67 -- # xargs 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.009 19:24:33 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:15.009 19:24:33 -- host/discovery.sh@153 -- # get_bdev_list 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.009 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.009 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # sort 00:26:15.009 19:24:33 -- host/discovery.sh@55 -- # xargs 00:26:15.009 19:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.267 19:24:33 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:15.267 19:24:33 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:15.267 19:24:33 -- common/autotest_common.sh@650 -- # local es=0 00:26:15.267 19:24:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:15.267 19:24:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:15.267 19:24:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:15.267 19:24:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:15.267 19:24:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:15.267 19:24:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:15.267 19:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.267 19:24:33 -- common/autotest_common.sh@10 -- # set +x 00:26:16.199 [2024-11-18 19:24:34.628521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:16.199 [2024-11-18 19:24:34.628644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:16.199 [2024-11-18 19:24:34.628689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18193d0 with addr=10.0.0.2, port=8010 00:26:16.199 [2024-11-18 19:24:34.628712] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:16.199 [2024-11-18 19:24:34.628728] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:16.199 [2024-11-18 19:24:34.628741] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:17.132 [2024-11-18 19:24:35.631026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:17.132 [2024-11-18 19:24:35.631160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:17.132 [2024-11-18 19:24:35.631192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x17e5d30 with addr=10.0.0.2, port=8010 00:26:17.132 [2024-11-18 19:24:35.631225] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:17.132 [2024-11-18 19:24:35.631242] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:17.132 [2024-11-18 19:24:35.631257] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:18.065 [2024-11-18 19:24:36.633203] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:18.065 request: 00:26:18.065 { 00:26:18.065 "name": "nvme_second", 00:26:18.065 "trtype": "tcp", 00:26:18.065 "traddr": "10.0.0.2", 00:26:18.065 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:18.065 "adrfam": "ipv4", 00:26:18.065 "trsvcid": "8010", 00:26:18.065 "attach_timeout_ms": 3000, 00:26:18.065 "method": "bdev_nvme_start_discovery", 00:26:18.065 "req_id": 1 00:26:18.065 } 00:26:18.065 Got JSON-RPC error response 00:26:18.065 response: 00:26:18.065 { 00:26:18.065 "code": -110, 00:26:18.065 "message": "Connection timed out" 00:26:18.065 } 00:26:18.065 19:24:36 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:18.065 19:24:36 -- common/autotest_common.sh@653 -- # es=1 00:26:18.065 19:24:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:18.065 19:24:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:18.065 19:24:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:18.065 19:24:36 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:18.065 19:24:36 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:18.065 19:24:36 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:18.065 19:24:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.065 19:24:36 -- host/discovery.sh@67 -- # sort 00:26:18.065 19:24:36 -- common/autotest_common.sh@10 -- # set +x 00:26:18.065 19:24:36 -- host/discovery.sh@67 -- # xargs 00:26:18.065 19:24:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.323 19:24:36 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:18.323 19:24:36 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:18.323 19:24:36 -- host/discovery.sh@162 -- # kill 3546517 00:26:18.323 19:24:36 -- host/discovery.sh@163 -- # nvmftestfini 00:26:18.323 19:24:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:18.323 19:24:36 -- nvmf/common.sh@116 -- # sync 00:26:18.323 19:24:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:18.323 19:24:36 -- nvmf/common.sh@119 -- # set +e 00:26:18.323 19:24:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:18.323 19:24:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:18.323 rmmod nvme_tcp 00:26:18.323 rmmod nvme_fabrics 00:26:18.323 rmmod nvme_keyring 00:26:18.323 19:24:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:18.323 19:24:36 -- nvmf/common.sh@123 -- # set -e 00:26:18.323 19:24:36 -- nvmf/common.sh@124 -- # return 0 00:26:18.323 19:24:36 -- nvmf/common.sh@477 -- # '[' -n 3546359 ']' 00:26:18.323 19:24:36 -- nvmf/common.sh@478 -- # killprocess 3546359 00:26:18.323 19:24:36 -- common/autotest_common.sh@936 -- # '[' -z 3546359 ']' 00:26:18.323 19:24:36 -- common/autotest_common.sh@940 -- # kill -0 3546359 00:26:18.323 19:24:36 -- common/autotest_common.sh@941 -- # uname 00:26:18.323 19:24:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:18.323 19:24:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3546359 00:26:18.323 19:24:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:18.323 19:24:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:18.323 19:24:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3546359' 00:26:18.323 killing process with pid 3546359 00:26:18.323 19:24:36 -- common/autotest_common.sh@955 -- # kill 3546359 00:26:18.323 19:24:36 -- common/autotest_common.sh@960 -- # wait 3546359 00:26:18.581 19:24:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:18.581 19:24:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:18.581 19:24:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:18.581 19:24:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:18.581 19:24:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:18.581 19:24:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:18.581 19:24:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:18.581 19:24:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:21.111 19:24:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:21.111 00:26:21.111 real 0m17.602s 00:26:21.111 user 0m27.377s 00:26:21.111 sys 0m2.851s 00:26:21.111 19:24:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:21.111 19:24:39 -- common/autotest_common.sh@10 -- # set +x 00:26:21.111 ************************************ 00:26:21.111 END TEST nvmf_discovery 00:26:21.111 ************************************ 00:26:21.111 19:24:39 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:21.111 19:24:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:21.111 19:24:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:21.111 19:24:39 -- common/autotest_common.sh@10 -- # set +x 00:26:21.111 ************************************ 00:26:21.111 START TEST nvmf_discovery_remove_ifc 00:26:21.111 ************************************ 00:26:21.111 19:24:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:21.111 * Looking for test storage... 00:26:21.111 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:21.111 19:24:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:21.111 19:24:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:21.111 19:24:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:21.111 19:24:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:21.111 19:24:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:21.111 19:24:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:21.111 19:24:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:21.111 19:24:39 -- scripts/common.sh@335 -- # IFS=.-: 00:26:21.111 19:24:39 -- scripts/common.sh@335 -- # read -ra ver1 00:26:21.111 19:24:39 -- scripts/common.sh@336 -- # IFS=.-: 00:26:21.111 19:24:39 -- scripts/common.sh@336 -- # read -ra ver2 00:26:21.111 19:24:39 -- scripts/common.sh@337 -- # local 'op=<' 00:26:21.111 19:24:39 -- scripts/common.sh@339 -- # ver1_l=2 00:26:21.111 19:24:39 -- scripts/common.sh@340 -- # ver2_l=1 00:26:21.111 19:24:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:21.111 19:24:39 -- scripts/common.sh@343 -- # case "$op" in 00:26:21.111 19:24:39 -- scripts/common.sh@344 -- # : 1 00:26:21.111 19:24:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:21.111 19:24:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:21.111 19:24:39 -- scripts/common.sh@364 -- # decimal 1 00:26:21.111 19:24:39 -- scripts/common.sh@352 -- # local d=1 00:26:21.111 19:24:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:21.111 19:24:39 -- scripts/common.sh@354 -- # echo 1 00:26:21.111 19:24:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:21.111 19:24:39 -- scripts/common.sh@365 -- # decimal 2 00:26:21.111 19:24:39 -- scripts/common.sh@352 -- # local d=2 00:26:21.111 19:24:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:21.111 19:24:39 -- scripts/common.sh@354 -- # echo 2 00:26:21.111 19:24:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:21.111 19:24:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:21.111 19:24:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:21.111 19:24:39 -- scripts/common.sh@367 -- # return 0 00:26:21.111 19:24:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:21.111 19:24:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:21.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:21.111 --rc genhtml_branch_coverage=1 00:26:21.111 --rc genhtml_function_coverage=1 00:26:21.111 --rc genhtml_legend=1 00:26:21.111 --rc geninfo_all_blocks=1 00:26:21.111 --rc geninfo_unexecuted_blocks=1 00:26:21.111 00:26:21.111 ' 00:26:21.111 19:24:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:21.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:21.111 --rc genhtml_branch_coverage=1 00:26:21.111 --rc genhtml_function_coverage=1 00:26:21.111 --rc genhtml_legend=1 00:26:21.111 --rc geninfo_all_blocks=1 00:26:21.111 --rc geninfo_unexecuted_blocks=1 00:26:21.111 00:26:21.111 ' 00:26:21.111 19:24:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:21.111 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:21.111 --rc genhtml_branch_coverage=1 00:26:21.111 --rc genhtml_function_coverage=1 00:26:21.111 --rc genhtml_legend=1 00:26:21.111 --rc geninfo_all_blocks=1 00:26:21.112 --rc geninfo_unexecuted_blocks=1 00:26:21.112 00:26:21.112 ' 00:26:21.112 19:24:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:21.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:21.112 --rc genhtml_branch_coverage=1 00:26:21.112 --rc genhtml_function_coverage=1 00:26:21.112 --rc genhtml_legend=1 00:26:21.112 --rc geninfo_all_blocks=1 00:26:21.112 --rc geninfo_unexecuted_blocks=1 00:26:21.112 00:26:21.112 ' 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:21.112 19:24:39 -- nvmf/common.sh@7 -- # uname -s 00:26:21.112 19:24:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:21.112 19:24:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:21.112 19:24:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:21.112 19:24:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:21.112 19:24:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:21.112 19:24:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:21.112 19:24:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:21.112 19:24:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:21.112 19:24:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:21.112 19:24:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:21.112 19:24:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:21.112 19:24:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:21.112 19:24:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:21.112 19:24:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:21.112 19:24:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:21.112 19:24:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:21.112 19:24:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:21.112 19:24:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:21.112 19:24:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:21.112 19:24:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:21.112 19:24:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:21.112 19:24:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:21.112 19:24:39 -- paths/export.sh@5 -- # export PATH 00:26:21.112 19:24:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:21.112 19:24:39 -- nvmf/common.sh@46 -- # : 0 00:26:21.112 19:24:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:21.112 19:24:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:21.112 19:24:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:21.112 19:24:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:21.112 19:24:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:21.112 19:24:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:21.112 19:24:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:21.112 19:24:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:21.112 19:24:39 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:21.112 19:24:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:21.112 19:24:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:21.112 19:24:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:21.112 19:24:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:21.112 19:24:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:21.112 19:24:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:21.112 19:24:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:21.112 19:24:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:21.112 19:24:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:21.112 19:24:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:21.112 19:24:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:21.112 19:24:39 -- common/autotest_common.sh@10 -- # set +x 00:26:23.015 19:24:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:23.015 19:24:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:23.015 19:24:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:23.015 19:24:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:23.015 19:24:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:23.015 19:24:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:23.015 19:24:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:23.015 19:24:41 -- nvmf/common.sh@294 -- # net_devs=() 00:26:23.015 19:24:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:23.015 19:24:41 -- nvmf/common.sh@295 -- # e810=() 00:26:23.015 19:24:41 -- nvmf/common.sh@295 -- # local -ga e810 00:26:23.015 19:24:41 -- nvmf/common.sh@296 -- # x722=() 00:26:23.015 19:24:41 -- nvmf/common.sh@296 -- # local -ga x722 00:26:23.015 19:24:41 -- nvmf/common.sh@297 -- # mlx=() 00:26:23.015 19:24:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:23.015 19:24:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:23.015 19:24:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:23.015 19:24:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:23.015 19:24:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:23.015 19:24:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:23.015 19:24:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:23.015 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:23.015 19:24:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:23.015 19:24:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:23.015 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:23.015 19:24:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:23.015 19:24:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:23.015 19:24:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:23.015 19:24:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:23.015 19:24:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:23.015 19:24:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:23.015 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:23.015 19:24:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:23.015 19:24:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:23.015 19:24:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:23.015 19:24:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:23.015 19:24:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:23.015 19:24:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:23.015 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:23.015 19:24:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:23.015 19:24:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:23.015 19:24:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:23.015 19:24:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:23.015 19:24:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:23.015 19:24:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:23.015 19:24:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:23.015 19:24:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:23.015 19:24:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:23.015 19:24:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:23.015 19:24:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:23.015 19:24:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:23.015 19:24:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:23.015 19:24:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:23.015 19:24:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:23.015 19:24:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:23.015 19:24:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:23.015 19:24:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:23.015 19:24:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:23.015 19:24:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:23.015 19:24:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:23.015 19:24:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:23.015 19:24:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:23.015 19:24:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:23.015 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:23.015 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:26:23.015 00:26:23.015 --- 10.0.0.2 ping statistics --- 00:26:23.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:23.015 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:26:23.015 19:24:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:23.015 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:23.015 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:26:23.015 00:26:23.015 --- 10.0.0.1 ping statistics --- 00:26:23.015 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:23.015 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:26:23.015 19:24:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:23.015 19:24:41 -- nvmf/common.sh@410 -- # return 0 00:26:23.015 19:24:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:23.015 19:24:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:23.015 19:24:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:23.015 19:24:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:23.015 19:24:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:23.015 19:24:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:23.015 19:24:41 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:23.015 19:24:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:23.015 19:24:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:23.015 19:24:41 -- common/autotest_common.sh@10 -- # set +x 00:26:23.015 19:24:41 -- nvmf/common.sh@469 -- # nvmfpid=3550007 00:26:23.015 19:24:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:23.015 19:24:41 -- nvmf/common.sh@470 -- # waitforlisten 3550007 00:26:23.015 19:24:41 -- common/autotest_common.sh@829 -- # '[' -z 3550007 ']' 00:26:23.015 19:24:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:23.015 19:24:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:23.015 19:24:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:23.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:23.015 19:24:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:23.015 19:24:41 -- common/autotest_common.sh@10 -- # set +x 00:26:23.015 [2024-11-18 19:24:41.577600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:23.016 [2024-11-18 19:24:41.577681] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:23.016 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.274 [2024-11-18 19:24:41.647743] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:23.274 [2024-11-18 19:24:41.765099] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:23.274 [2024-11-18 19:24:41.765250] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:23.274 [2024-11-18 19:24:41.765267] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:23.274 [2024-11-18 19:24:41.765279] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:23.274 [2024-11-18 19:24:41.765306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:24.207 19:24:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:24.207 19:24:42 -- common/autotest_common.sh@862 -- # return 0 00:26:24.207 19:24:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:24.207 19:24:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:24.207 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:26:24.207 19:24:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:24.207 19:24:42 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:24.207 19:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.207 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:26:24.207 [2024-11-18 19:24:42.673941] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:24.207 [2024-11-18 19:24:42.682124] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:24.207 null0 00:26:24.207 [2024-11-18 19:24:42.714094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:24.207 19:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.207 19:24:42 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3550162 00:26:24.207 19:24:42 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3550162 /tmp/host.sock 00:26:24.207 19:24:42 -- common/autotest_common.sh@829 -- # '[' -z 3550162 ']' 00:26:24.207 19:24:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:24.207 19:24:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:24.207 19:24:42 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:24.207 19:24:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:24.207 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:24.207 19:24:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:24.207 19:24:42 -- common/autotest_common.sh@10 -- # set +x 00:26:24.207 [2024-11-18 19:24:42.775879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:24.207 [2024-11-18 19:24:42.775982] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3550162 ] 00:26:24.207 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.465 [2024-11-18 19:24:42.837009] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:24.465 [2024-11-18 19:24:42.955338] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:24.465 [2024-11-18 19:24:42.955524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:24.465 19:24:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:24.465 19:24:43 -- common/autotest_common.sh@862 -- # return 0 00:26:24.465 19:24:43 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:24.465 19:24:43 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:24.465 19:24:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.465 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:26:24.465 19:24:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.465 19:24:43 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:24.465 19:24:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.465 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:26:24.723 19:24:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.723 19:24:43 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:24.723 19:24:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.723 19:24:43 -- common/autotest_common.sh@10 -- # set +x 00:26:25.658 [2024-11-18 19:24:44.172754] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:25.658 [2024-11-18 19:24:44.172798] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:25.658 [2024-11-18 19:24:44.172823] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:25.658 [2024-11-18 19:24:44.260101] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:25.916 [2024-11-18 19:24:44.322889] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:25.916 [2024-11-18 19:24:44.322941] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:25.916 [2024-11-18 19:24:44.322998] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:25.916 [2024-11-18 19:24:44.323023] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:25.916 [2024-11-18 19:24:44.323060] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:25.916 19:24:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.916 19:24:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.916 19:24:44 -- common/autotest_common.sh@10 -- # set +x 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.916 [2024-11-18 19:24:44.329693] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x5dbd40 was disconnected and freed. delete nvme_qpair. 00:26:25.916 19:24:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.916 19:24:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.916 19:24:44 -- common/autotest_common.sh@10 -- # set +x 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.916 19:24:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:25.916 19:24:44 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.292 19:24:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:27.292 19:24:45 -- common/autotest_common.sh@10 -- # set +x 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:27.292 19:24:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:27.292 19:24:45 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:28.227 19:24:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:28.227 19:24:46 -- common/autotest_common.sh@10 -- # set +x 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:28.227 19:24:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:28.227 19:24:46 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.161 19:24:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.161 19:24:47 -- common/autotest_common.sh@10 -- # set +x 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.161 19:24:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:29.161 19:24:47 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.094 19:24:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:30.094 19:24:48 -- common/autotest_common.sh@10 -- # set +x 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:30.094 19:24:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:30.094 19:24:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:31.479 19:24:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:31.479 19:24:49 -- common/autotest_common.sh@10 -- # set +x 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:31.479 19:24:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:31.479 19:24:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:31.479 [2024-11-18 19:24:49.763854] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:31.479 [2024-11-18 19:24:49.763937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.479 [2024-11-18 19:24:49.763975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.479 [2024-11-18 19:24:49.764008] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.479 [2024-11-18 19:24:49.764025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.479 [2024-11-18 19:24:49.764045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.479 [2024-11-18 19:24:49.764060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.479 [2024-11-18 19:24:49.764076] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.479 [2024-11-18 19:24:49.764092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.479 [2024-11-18 19:24:49.764108] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.479 [2024-11-18 19:24:49.764124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.479 [2024-11-18 19:24:49.764140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a2430 is same with the state(5) to be set 00:26:31.479 [2024-11-18 19:24:49.773870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a2430 (9): Bad file descriptor 00:26:31.479 [2024-11-18 19:24:49.783936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:32.413 19:24:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.413 19:24:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.413 19:24:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.413 19:24:50 -- common/autotest_common.sh@10 -- # set +x 00:26:32.413 19:24:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.413 19:24:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.413 19:24:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.413 [2024-11-18 19:24:50.815681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:33.348 [2024-11-18 19:24:51.839659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:33.348 [2024-11-18 19:24:51.839732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5a2430 with addr=10.0.0.2, port=4420 00:26:33.348 [2024-11-18 19:24:51.839767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a2430 is same with the state(5) to be set 00:26:33.348 [2024-11-18 19:24:51.839816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:33.348 [2024-11-18 19:24:51.839836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:33.348 [2024-11-18 19:24:51.839854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:33.348 [2024-11-18 19:24:51.839872] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:33.348 [2024-11-18 19:24:51.840337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a2430 (9): Bad file descriptor 00:26:33.348 [2024-11-18 19:24:51.840384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:33.348 [2024-11-18 19:24:51.840425] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:33.348 [2024-11-18 19:24:51.840469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.348 [2024-11-18 19:24:51.840497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.349 [2024-11-18 19:24:51.840520] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.349 [2024-11-18 19:24:51.840549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.349 [2024-11-18 19:24:51.840566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.349 [2024-11-18 19:24:51.840584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.349 [2024-11-18 19:24:51.840600] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.349 [2024-11-18 19:24:51.840640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.349 [2024-11-18 19:24:51.840658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:33.349 [2024-11-18 19:24:51.840689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:33.349 [2024-11-18 19:24:51.840703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:33.349 [2024-11-18 19:24:51.840813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5a2840 (9): Bad file descriptor 00:26:33.349 [2024-11-18 19:24:51.841849] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:33.349 [2024-11-18 19:24:51.841872] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:33.349 19:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.349 19:24:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:33.349 19:24:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.282 19:24:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.282 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.282 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.282 19:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.282 19:24:52 -- common/autotest_common.sh@10 -- # set +x 00:26:34.282 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.282 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.282 19:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.539 19:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.539 19:24:52 -- common/autotest_common.sh@10 -- # set +x 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.539 19:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:34.539 19:24:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.472 [2024-11-18 19:24:53.898753] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:35.472 [2024-11-18 19:24:53.898777] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:35.472 [2024-11-18 19:24:53.898802] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:35.472 19:24:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:35.472 19:24:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.472 19:24:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:35.472 19:24:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.472 19:24:53 -- common/autotest_common.sh@10 -- # set +x 00:26:35.472 19:24:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:35.472 19:24:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:35.472 19:24:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.472 [2024-11-18 19:24:53.985118] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:35.472 19:24:54 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:35.472 19:24:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.730 [2024-11-18 19:24:54.169336] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:35.730 [2024-11-18 19:24:54.169387] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:35.730 [2024-11-18 19:24:54.169423] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:35.730 [2024-11-18 19:24:54.169447] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:35.730 [2024-11-18 19:24:54.169461] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:35.730 [2024-11-18 19:24:54.176205] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x5b0ef0 was disconnected and freed. delete nvme_qpair. 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:36.663 19:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:36.663 19:24:55 -- common/autotest_common.sh@10 -- # set +x 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:36.663 19:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:36.663 19:24:55 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3550162 00:26:36.663 19:24:55 -- common/autotest_common.sh@936 -- # '[' -z 3550162 ']' 00:26:36.663 19:24:55 -- common/autotest_common.sh@940 -- # kill -0 3550162 00:26:36.663 19:24:55 -- common/autotest_common.sh@941 -- # uname 00:26:36.663 19:24:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.663 19:24:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3550162 00:26:36.663 19:24:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:36.663 19:24:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:36.663 19:24:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3550162' 00:26:36.663 killing process with pid 3550162 00:26:36.663 19:24:55 -- common/autotest_common.sh@955 -- # kill 3550162 00:26:36.663 19:24:55 -- common/autotest_common.sh@960 -- # wait 3550162 00:26:36.921 19:24:55 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:36.921 19:24:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:36.921 19:24:55 -- nvmf/common.sh@116 -- # sync 00:26:36.921 19:24:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:36.921 19:24:55 -- nvmf/common.sh@119 -- # set +e 00:26:36.921 19:24:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:36.921 19:24:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:36.921 rmmod nvme_tcp 00:26:36.921 rmmod nvme_fabrics 00:26:36.921 rmmod nvme_keyring 00:26:36.921 19:24:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:36.921 19:24:55 -- nvmf/common.sh@123 -- # set -e 00:26:36.921 19:24:55 -- nvmf/common.sh@124 -- # return 0 00:26:36.921 19:24:55 -- nvmf/common.sh@477 -- # '[' -n 3550007 ']' 00:26:36.921 19:24:55 -- nvmf/common.sh@478 -- # killprocess 3550007 00:26:36.921 19:24:55 -- common/autotest_common.sh@936 -- # '[' -z 3550007 ']' 00:26:36.921 19:24:55 -- common/autotest_common.sh@940 -- # kill -0 3550007 00:26:36.921 19:24:55 -- common/autotest_common.sh@941 -- # uname 00:26:36.921 19:24:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:36.921 19:24:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3550007 00:26:36.921 19:24:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:36.921 19:24:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:36.921 19:24:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3550007' 00:26:36.921 killing process with pid 3550007 00:26:36.921 19:24:55 -- common/autotest_common.sh@955 -- # kill 3550007 00:26:36.921 19:24:55 -- common/autotest_common.sh@960 -- # wait 3550007 00:26:37.179 19:24:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:37.179 19:24:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:37.179 19:24:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:37.179 19:24:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:37.179 19:24:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:37.179 19:24:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.179 19:24:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.179 19:24:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:39.708 19:24:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:39.708 00:26:39.708 real 0m18.615s 00:26:39.708 user 0m25.768s 00:26:39.708 sys 0m2.947s 00:26:39.708 19:24:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:39.708 19:24:57 -- common/autotest_common.sh@10 -- # set +x 00:26:39.708 ************************************ 00:26:39.708 END TEST nvmf_discovery_remove_ifc 00:26:39.708 ************************************ 00:26:39.708 19:24:57 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:39.708 19:24:57 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:39.708 19:24:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:39.708 19:24:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:39.708 19:24:57 -- common/autotest_common.sh@10 -- # set +x 00:26:39.708 ************************************ 00:26:39.708 START TEST nvmf_digest 00:26:39.708 ************************************ 00:26:39.708 19:24:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:39.708 * Looking for test storage... 00:26:39.708 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:39.708 19:24:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:39.708 19:24:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:39.708 19:24:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:39.708 19:24:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:39.708 19:24:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:39.708 19:24:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:39.708 19:24:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:39.708 19:24:57 -- scripts/common.sh@335 -- # IFS=.-: 00:26:39.708 19:24:57 -- scripts/common.sh@335 -- # read -ra ver1 00:26:39.708 19:24:57 -- scripts/common.sh@336 -- # IFS=.-: 00:26:39.708 19:24:57 -- scripts/common.sh@336 -- # read -ra ver2 00:26:39.708 19:24:57 -- scripts/common.sh@337 -- # local 'op=<' 00:26:39.708 19:24:57 -- scripts/common.sh@339 -- # ver1_l=2 00:26:39.708 19:24:57 -- scripts/common.sh@340 -- # ver2_l=1 00:26:39.708 19:24:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:39.708 19:24:57 -- scripts/common.sh@343 -- # case "$op" in 00:26:39.708 19:24:57 -- scripts/common.sh@344 -- # : 1 00:26:39.708 19:24:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:39.709 19:24:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:39.709 19:24:57 -- scripts/common.sh@364 -- # decimal 1 00:26:39.709 19:24:57 -- scripts/common.sh@352 -- # local d=1 00:26:39.709 19:24:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:39.709 19:24:57 -- scripts/common.sh@354 -- # echo 1 00:26:39.709 19:24:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:39.709 19:24:57 -- scripts/common.sh@365 -- # decimal 2 00:26:39.709 19:24:57 -- scripts/common.sh@352 -- # local d=2 00:26:39.709 19:24:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:39.709 19:24:57 -- scripts/common.sh@354 -- # echo 2 00:26:39.709 19:24:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:39.709 19:24:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:39.709 19:24:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:39.709 19:24:57 -- scripts/common.sh@367 -- # return 0 00:26:39.709 19:24:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:39.709 19:24:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:39.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.709 --rc genhtml_branch_coverage=1 00:26:39.709 --rc genhtml_function_coverage=1 00:26:39.709 --rc genhtml_legend=1 00:26:39.709 --rc geninfo_all_blocks=1 00:26:39.709 --rc geninfo_unexecuted_blocks=1 00:26:39.709 00:26:39.709 ' 00:26:39.709 19:24:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:39.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.709 --rc genhtml_branch_coverage=1 00:26:39.709 --rc genhtml_function_coverage=1 00:26:39.709 --rc genhtml_legend=1 00:26:39.709 --rc geninfo_all_blocks=1 00:26:39.709 --rc geninfo_unexecuted_blocks=1 00:26:39.709 00:26:39.709 ' 00:26:39.709 19:24:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:39.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.709 --rc genhtml_branch_coverage=1 00:26:39.709 --rc genhtml_function_coverage=1 00:26:39.709 --rc genhtml_legend=1 00:26:39.709 --rc geninfo_all_blocks=1 00:26:39.709 --rc geninfo_unexecuted_blocks=1 00:26:39.709 00:26:39.709 ' 00:26:39.709 19:24:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:39.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:39.709 --rc genhtml_branch_coverage=1 00:26:39.709 --rc genhtml_function_coverage=1 00:26:39.709 --rc genhtml_legend=1 00:26:39.709 --rc geninfo_all_blocks=1 00:26:39.709 --rc geninfo_unexecuted_blocks=1 00:26:39.709 00:26:39.709 ' 00:26:39.709 19:24:57 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:39.709 19:24:57 -- nvmf/common.sh@7 -- # uname -s 00:26:39.709 19:24:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:39.709 19:24:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:39.709 19:24:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:39.709 19:24:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:39.709 19:24:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:39.709 19:24:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:39.709 19:24:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:39.709 19:24:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:39.709 19:24:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:39.709 19:24:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:39.709 19:24:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:39.709 19:24:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:39.709 19:24:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:39.709 19:24:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:39.709 19:24:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:39.709 19:24:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:39.709 19:24:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:39.709 19:24:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:39.709 19:24:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:39.709 19:24:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.709 19:24:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.709 19:24:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.709 19:24:57 -- paths/export.sh@5 -- # export PATH 00:26:39.709 19:24:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:39.709 19:24:57 -- nvmf/common.sh@46 -- # : 0 00:26:39.709 19:24:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:39.709 19:24:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:39.709 19:24:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:39.709 19:24:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:39.709 19:24:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:39.709 19:24:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:39.709 19:24:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:39.709 19:24:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:39.709 19:24:57 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:39.709 19:24:57 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:39.709 19:24:57 -- host/digest.sh@16 -- # runtime=2 00:26:39.709 19:24:57 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:39.709 19:24:57 -- host/digest.sh@132 -- # nvmftestinit 00:26:39.709 19:24:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:39.709 19:24:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:39.709 19:24:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:39.709 19:24:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:39.709 19:24:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:39.709 19:24:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:39.709 19:24:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:39.709 19:24:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:39.709 19:24:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:39.709 19:24:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:39.709 19:24:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:39.709 19:24:57 -- common/autotest_common.sh@10 -- # set +x 00:26:41.611 19:24:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:41.611 19:24:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:41.611 19:24:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:41.611 19:24:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:41.611 19:24:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:41.611 19:24:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:41.611 19:24:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:41.611 19:24:59 -- nvmf/common.sh@294 -- # net_devs=() 00:26:41.611 19:24:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:41.611 19:24:59 -- nvmf/common.sh@295 -- # e810=() 00:26:41.611 19:24:59 -- nvmf/common.sh@295 -- # local -ga e810 00:26:41.611 19:24:59 -- nvmf/common.sh@296 -- # x722=() 00:26:41.611 19:24:59 -- nvmf/common.sh@296 -- # local -ga x722 00:26:41.611 19:24:59 -- nvmf/common.sh@297 -- # mlx=() 00:26:41.611 19:24:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:41.611 19:24:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:41.611 19:24:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:41.611 19:24:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:41.611 19:24:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:41.611 19:24:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:41.611 19:24:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:41.611 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:41.611 19:24:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:41.611 19:24:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:41.611 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:41.611 19:24:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:41.611 19:24:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:41.611 19:24:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:41.611 19:24:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:41.611 19:24:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:41.611 19:24:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:41.611 19:24:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:41.612 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:41.612 19:24:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:41.612 19:24:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:41.612 19:24:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:41.612 19:24:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:41.612 19:24:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:41.612 19:24:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:41.612 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:41.612 19:24:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:41.612 19:24:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:41.612 19:24:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:41.612 19:24:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:41.612 19:24:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:41.612 19:24:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:41.612 19:24:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:41.612 19:24:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:41.612 19:24:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:41.612 19:24:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:41.612 19:24:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:41.612 19:24:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:41.612 19:24:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:41.612 19:24:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:41.612 19:24:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:41.612 19:24:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:41.612 19:24:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:41.612 19:24:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:41.612 19:24:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:41.612 19:24:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:41.612 19:24:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:41.612 19:24:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:41.612 19:24:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:41.612 19:24:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:41.612 19:25:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:41.612 19:25:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:41.612 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:41.612 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:26:41.612 00:26:41.612 --- 10.0.0.2 ping statistics --- 00:26:41.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:41.612 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:26:41.612 19:25:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:41.612 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:41.612 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:26:41.612 00:26:41.612 --- 10.0.0.1 ping statistics --- 00:26:41.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:41.612 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:26:41.612 19:25:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:41.612 19:25:00 -- nvmf/common.sh@410 -- # return 0 00:26:41.612 19:25:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:41.612 19:25:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:41.612 19:25:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:41.612 19:25:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:41.612 19:25:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:41.612 19:25:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:41.612 19:25:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:41.612 19:25:00 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:41.612 19:25:00 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:41.612 19:25:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:41.612 19:25:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:41.612 19:25:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.612 ************************************ 00:26:41.612 START TEST nvmf_digest_clean 00:26:41.612 ************************************ 00:26:41.612 19:25:00 -- common/autotest_common.sh@1114 -- # run_digest 00:26:41.612 19:25:00 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:41.612 19:25:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:41.612 19:25:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:41.612 19:25:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.612 19:25:00 -- nvmf/common.sh@469 -- # nvmfpid=3553802 00:26:41.612 19:25:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:41.612 19:25:00 -- nvmf/common.sh@470 -- # waitforlisten 3553802 00:26:41.612 19:25:00 -- common/autotest_common.sh@829 -- # '[' -z 3553802 ']' 00:26:41.612 19:25:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:41.612 19:25:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:41.612 19:25:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:41.612 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:41.612 19:25:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:41.612 19:25:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.612 [2024-11-18 19:25:00.086918] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:41.612 [2024-11-18 19:25:00.087019] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:41.612 EAL: No free 2048 kB hugepages reported on node 1 00:26:41.612 [2024-11-18 19:25:00.151511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:41.870 [2024-11-18 19:25:00.259044] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:41.870 [2024-11-18 19:25:00.259189] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:41.870 [2024-11-18 19:25:00.259206] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:41.871 [2024-11-18 19:25:00.259218] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:41.871 [2024-11-18 19:25:00.259244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:41.871 19:25:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:41.871 19:25:00 -- common/autotest_common.sh@862 -- # return 0 00:26:41.871 19:25:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:41.871 19:25:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:41.871 19:25:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.871 19:25:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:41.871 19:25:00 -- host/digest.sh@120 -- # common_target_config 00:26:41.871 19:25:00 -- host/digest.sh@43 -- # rpc_cmd 00:26:41.871 19:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.871 19:25:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.871 null0 00:26:41.871 [2024-11-18 19:25:00.458030] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:42.129 [2024-11-18 19:25:00.482281] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:42.129 19:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.129 19:25:00 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:42.129 19:25:00 -- host/digest.sh@77 -- # local rw bs qd 00:26:42.129 19:25:00 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:42.129 19:25:00 -- host/digest.sh@80 -- # rw=randread 00:26:42.129 19:25:00 -- host/digest.sh@80 -- # bs=4096 00:26:42.129 19:25:00 -- host/digest.sh@80 -- # qd=128 00:26:42.129 19:25:00 -- host/digest.sh@82 -- # bperfpid=3553826 00:26:42.129 19:25:00 -- host/digest.sh@83 -- # waitforlisten 3553826 /var/tmp/bperf.sock 00:26:42.129 19:25:00 -- common/autotest_common.sh@829 -- # '[' -z 3553826 ']' 00:26:42.129 19:25:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:42.129 19:25:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:42.129 19:25:00 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:42.129 19:25:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:42.129 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:42.129 19:25:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:42.129 19:25:00 -- common/autotest_common.sh@10 -- # set +x 00:26:42.129 [2024-11-18 19:25:00.528485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:42.129 [2024-11-18 19:25:00.528569] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3553826 ] 00:26:42.129 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.129 [2024-11-18 19:25:00.588959] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:42.129 [2024-11-18 19:25:00.701351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:42.387 19:25:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:42.387 19:25:00 -- common/autotest_common.sh@862 -- # return 0 00:26:42.387 19:25:00 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:42.387 19:25:00 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:42.387 19:25:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:42.645 19:25:01 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.645 19:25:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:42.904 nvme0n1 00:26:43.162 19:25:01 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:43.162 19:25:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:43.162 Running I/O for 2 seconds... 00:26:45.063 00:26:45.063 Latency(us) 00:26:45.063 [2024-11-18T18:25:03.668Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:45.063 [2024-11-18T18:25:03.668Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:45.063 nvme0n1 : 2.01 15824.12 61.81 0.00 0.00 8081.23 3495.25 19612.25 00:26:45.063 [2024-11-18T18:25:03.668Z] =================================================================================================================== 00:26:45.063 [2024-11-18T18:25:03.668Z] Total : 15824.12 61.81 0.00 0.00 8081.23 3495.25 19612.25 00:26:45.063 0 00:26:45.063 19:25:03 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:45.321 19:25:03 -- host/digest.sh@92 -- # get_accel_stats 00:26:45.321 19:25:03 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:45.321 19:25:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:45.321 19:25:03 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:45.321 | select(.opcode=="crc32c") 00:26:45.321 | "\(.module_name) \(.executed)"' 00:26:45.321 19:25:03 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:45.321 19:25:03 -- host/digest.sh@93 -- # exp_module=software 00:26:45.321 19:25:03 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:45.321 19:25:03 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:45.321 19:25:03 -- host/digest.sh@97 -- # killprocess 3553826 00:26:45.321 19:25:03 -- common/autotest_common.sh@936 -- # '[' -z 3553826 ']' 00:26:45.321 19:25:03 -- common/autotest_common.sh@940 -- # kill -0 3553826 00:26:45.321 19:25:03 -- common/autotest_common.sh@941 -- # uname 00:26:45.321 19:25:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:45.321 19:25:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3553826 00:26:45.579 19:25:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:45.580 19:25:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:45.580 19:25:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3553826' 00:26:45.580 killing process with pid 3553826 00:26:45.580 19:25:03 -- common/autotest_common.sh@955 -- # kill 3553826 00:26:45.580 Received shutdown signal, test time was about 2.000000 seconds 00:26:45.580 00:26:45.580 Latency(us) 00:26:45.580 [2024-11-18T18:25:04.185Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:45.580 [2024-11-18T18:25:04.185Z] =================================================================================================================== 00:26:45.580 [2024-11-18T18:25:04.185Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:45.580 19:25:03 -- common/autotest_common.sh@960 -- # wait 3553826 00:26:45.838 19:25:04 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:45.838 19:25:04 -- host/digest.sh@77 -- # local rw bs qd 00:26:45.838 19:25:04 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:45.838 19:25:04 -- host/digest.sh@80 -- # rw=randread 00:26:45.838 19:25:04 -- host/digest.sh@80 -- # bs=131072 00:26:45.838 19:25:04 -- host/digest.sh@80 -- # qd=16 00:26:45.838 19:25:04 -- host/digest.sh@82 -- # bperfpid=3554252 00:26:45.838 19:25:04 -- host/digest.sh@83 -- # waitforlisten 3554252 /var/tmp/bperf.sock 00:26:45.838 19:25:04 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:45.838 19:25:04 -- common/autotest_common.sh@829 -- # '[' -z 3554252 ']' 00:26:45.838 19:25:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:45.838 19:25:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:45.838 19:25:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:45.838 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:45.838 19:25:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:45.838 19:25:04 -- common/autotest_common.sh@10 -- # set +x 00:26:45.838 [2024-11-18 19:25:04.256921] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:45.838 [2024-11-18 19:25:04.257011] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3554252 ] 00:26:45.838 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.838 Zero copy mechanism will not be used. 00:26:45.838 EAL: No free 2048 kB hugepages reported on node 1 00:26:45.838 [2024-11-18 19:25:04.317225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:45.838 [2024-11-18 19:25:04.428884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:46.096 19:25:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:46.097 19:25:04 -- common/autotest_common.sh@862 -- # return 0 00:26:46.097 19:25:04 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:46.097 19:25:04 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:46.097 19:25:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:46.355 19:25:04 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.355 19:25:04 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:46.921 nvme0n1 00:26:46.921 19:25:05 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:46.921 19:25:05 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:46.921 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:46.921 Zero copy mechanism will not be used. 00:26:46.921 Running I/O for 2 seconds... 00:26:48.931 00:26:48.931 Latency(us) 00:26:48.931 [2024-11-18T18:25:07.536Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:48.931 [2024-11-18T18:25:07.536Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:48.931 nvme0n1 : 2.00 6332.48 791.56 0.00 0.00 2522.26 752.45 7670.14 00:26:48.931 [2024-11-18T18:25:07.536Z] =================================================================================================================== 00:26:48.931 [2024-11-18T18:25:07.536Z] Total : 6332.48 791.56 0.00 0.00 2522.26 752.45 7670.14 00:26:48.931 0 00:26:48.931 19:25:07 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:48.931 19:25:07 -- host/digest.sh@92 -- # get_accel_stats 00:26:48.931 19:25:07 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:48.931 19:25:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:48.931 19:25:07 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:48.931 | select(.opcode=="crc32c") 00:26:48.931 | "\(.module_name) \(.executed)"' 00:26:49.189 19:25:07 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:49.189 19:25:07 -- host/digest.sh@93 -- # exp_module=software 00:26:49.189 19:25:07 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:49.189 19:25:07 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:49.189 19:25:07 -- host/digest.sh@97 -- # killprocess 3554252 00:26:49.189 19:25:07 -- common/autotest_common.sh@936 -- # '[' -z 3554252 ']' 00:26:49.189 19:25:07 -- common/autotest_common.sh@940 -- # kill -0 3554252 00:26:49.189 19:25:07 -- common/autotest_common.sh@941 -- # uname 00:26:49.189 19:25:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:49.189 19:25:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3554252 00:26:49.189 19:25:07 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:49.189 19:25:07 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:49.189 19:25:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3554252' 00:26:49.189 killing process with pid 3554252 00:26:49.189 19:25:07 -- common/autotest_common.sh@955 -- # kill 3554252 00:26:49.189 Received shutdown signal, test time was about 2.000000 seconds 00:26:49.189 00:26:49.189 Latency(us) 00:26:49.189 [2024-11-18T18:25:07.794Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.189 [2024-11-18T18:25:07.794Z] =================================================================================================================== 00:26:49.189 [2024-11-18T18:25:07.794Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:49.189 19:25:07 -- common/autotest_common.sh@960 -- # wait 3554252 00:26:49.447 19:25:07 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:49.447 19:25:07 -- host/digest.sh@77 -- # local rw bs qd 00:26:49.447 19:25:07 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:49.447 19:25:07 -- host/digest.sh@80 -- # rw=randwrite 00:26:49.447 19:25:07 -- host/digest.sh@80 -- # bs=4096 00:26:49.447 19:25:07 -- host/digest.sh@80 -- # qd=128 00:26:49.447 19:25:07 -- host/digest.sh@82 -- # bperfpid=3554797 00:26:49.447 19:25:07 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:49.447 19:25:07 -- host/digest.sh@83 -- # waitforlisten 3554797 /var/tmp/bperf.sock 00:26:49.447 19:25:07 -- common/autotest_common.sh@829 -- # '[' -z 3554797 ']' 00:26:49.447 19:25:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:49.447 19:25:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:49.447 19:25:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:49.447 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:49.447 19:25:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:49.447 19:25:07 -- common/autotest_common.sh@10 -- # set +x 00:26:49.447 [2024-11-18 19:25:07.970104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:49.447 [2024-11-18 19:25:07.970195] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3554797 ] 00:26:49.447 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.447 [2024-11-18 19:25:08.030821] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:49.705 [2024-11-18 19:25:08.142674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:49.705 19:25:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:49.705 19:25:08 -- common/autotest_common.sh@862 -- # return 0 00:26:49.705 19:25:08 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:49.705 19:25:08 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:49.705 19:25:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:49.963 19:25:08 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:49.963 19:25:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.530 nvme0n1 00:26:50.530 19:25:08 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:50.530 19:25:08 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:50.530 Running I/O for 2 seconds... 00:26:53.060 00:26:53.060 Latency(us) 00:26:53.060 [2024-11-18T18:25:11.665Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:53.060 [2024-11-18T18:25:11.665Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:53.060 nvme0n1 : 2.01 19050.14 74.41 0.00 0.00 6704.20 3810.80 10728.49 00:26:53.060 [2024-11-18T18:25:11.665Z] =================================================================================================================== 00:26:53.061 [2024-11-18T18:25:11.666Z] Total : 19050.14 74.41 0.00 0.00 6704.20 3810.80 10728.49 00:26:53.061 0 00:26:53.061 19:25:11 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:53.061 19:25:11 -- host/digest.sh@92 -- # get_accel_stats 00:26:53.061 19:25:11 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:53.061 19:25:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:53.061 19:25:11 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:53.061 | select(.opcode=="crc32c") 00:26:53.061 | "\(.module_name) \(.executed)"' 00:26:53.061 19:25:11 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:53.061 19:25:11 -- host/digest.sh@93 -- # exp_module=software 00:26:53.061 19:25:11 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:53.061 19:25:11 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:53.061 19:25:11 -- host/digest.sh@97 -- # killprocess 3554797 00:26:53.061 19:25:11 -- common/autotest_common.sh@936 -- # '[' -z 3554797 ']' 00:26:53.061 19:25:11 -- common/autotest_common.sh@940 -- # kill -0 3554797 00:26:53.061 19:25:11 -- common/autotest_common.sh@941 -- # uname 00:26:53.061 19:25:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:53.061 19:25:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3554797 00:26:53.061 19:25:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:53.061 19:25:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:53.061 19:25:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3554797' 00:26:53.061 killing process with pid 3554797 00:26:53.061 19:25:11 -- common/autotest_common.sh@955 -- # kill 3554797 00:26:53.061 Received shutdown signal, test time was about 2.000000 seconds 00:26:53.061 00:26:53.061 Latency(us) 00:26:53.061 [2024-11-18T18:25:11.666Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:53.061 [2024-11-18T18:25:11.666Z] =================================================================================================================== 00:26:53.061 [2024-11-18T18:25:11.666Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:53.061 19:25:11 -- common/autotest_common.sh@960 -- # wait 3554797 00:26:53.319 19:25:11 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:53.319 19:25:11 -- host/digest.sh@77 -- # local rw bs qd 00:26:53.319 19:25:11 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:53.319 19:25:11 -- host/digest.sh@80 -- # rw=randwrite 00:26:53.319 19:25:11 -- host/digest.sh@80 -- # bs=131072 00:26:53.319 19:25:11 -- host/digest.sh@80 -- # qd=16 00:26:53.319 19:25:11 -- host/digest.sh@82 -- # bperfpid=3555218 00:26:53.319 19:25:11 -- host/digest.sh@83 -- # waitforlisten 3555218 /var/tmp/bperf.sock 00:26:53.319 19:25:11 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:53.319 19:25:11 -- common/autotest_common.sh@829 -- # '[' -z 3555218 ']' 00:26:53.319 19:25:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:53.319 19:25:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:53.319 19:25:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:53.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:53.319 19:25:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:53.319 19:25:11 -- common/autotest_common.sh@10 -- # set +x 00:26:53.319 [2024-11-18 19:25:11.726593] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:53.319 [2024-11-18 19:25:11.726696] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3555218 ] 00:26:53.319 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:53.319 Zero copy mechanism will not be used. 00:26:53.319 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.319 [2024-11-18 19:25:11.791374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:53.319 [2024-11-18 19:25:11.904927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.577 19:25:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:53.577 19:25:11 -- common/autotest_common.sh@862 -- # return 0 00:26:53.577 19:25:11 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:53.577 19:25:11 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:53.577 19:25:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:53.836 19:25:12 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.836 19:25:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:54.403 nvme0n1 00:26:54.403 19:25:12 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:54.403 19:25:12 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:54.403 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:54.403 Zero copy mechanism will not be used. 00:26:54.403 Running I/O for 2 seconds... 00:26:56.933 00:26:56.933 Latency(us) 00:26:56.933 [2024-11-18T18:25:15.538Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.933 [2024-11-18T18:25:15.538Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:56.933 nvme0n1 : 2.00 7248.96 906.12 0.00 0.00 2200.57 1868.99 7961.41 00:26:56.933 [2024-11-18T18:25:15.538Z] =================================================================================================================== 00:26:56.933 [2024-11-18T18:25:15.538Z] Total : 7248.96 906.12 0.00 0.00 2200.57 1868.99 7961.41 00:26:56.933 0 00:26:56.933 19:25:14 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:56.933 19:25:14 -- host/digest.sh@92 -- # get_accel_stats 00:26:56.933 19:25:14 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:56.933 19:25:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:56.933 19:25:14 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:56.933 | select(.opcode=="crc32c") 00:26:56.933 | "\(.module_name) \(.executed)"' 00:26:56.933 19:25:15 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:56.933 19:25:15 -- host/digest.sh@93 -- # exp_module=software 00:26:56.933 19:25:15 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:56.933 19:25:15 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:56.933 19:25:15 -- host/digest.sh@97 -- # killprocess 3555218 00:26:56.933 19:25:15 -- common/autotest_common.sh@936 -- # '[' -z 3555218 ']' 00:26:56.933 19:25:15 -- common/autotest_common.sh@940 -- # kill -0 3555218 00:26:56.933 19:25:15 -- common/autotest_common.sh@941 -- # uname 00:26:56.933 19:25:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.933 19:25:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3555218 00:26:56.933 19:25:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:56.933 19:25:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:56.933 19:25:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3555218' 00:26:56.933 killing process with pid 3555218 00:26:56.933 19:25:15 -- common/autotest_common.sh@955 -- # kill 3555218 00:26:56.933 Received shutdown signal, test time was about 2.000000 seconds 00:26:56.933 00:26:56.933 Latency(us) 00:26:56.933 [2024-11-18T18:25:15.538Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.933 [2024-11-18T18:25:15.538Z] =================================================================================================================== 00:26:56.933 [2024-11-18T18:25:15.538Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:56.933 19:25:15 -- common/autotest_common.sh@960 -- # wait 3555218 00:26:56.933 19:25:15 -- host/digest.sh@126 -- # killprocess 3553802 00:26:56.933 19:25:15 -- common/autotest_common.sh@936 -- # '[' -z 3553802 ']' 00:26:56.933 19:25:15 -- common/autotest_common.sh@940 -- # kill -0 3553802 00:26:56.933 19:25:15 -- common/autotest_common.sh@941 -- # uname 00:26:56.933 19:25:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.933 19:25:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3553802 00:26:56.933 19:25:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:56.933 19:25:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:56.933 19:25:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3553802' 00:26:56.933 killing process with pid 3553802 00:26:56.933 19:25:15 -- common/autotest_common.sh@955 -- # kill 3553802 00:26:56.933 19:25:15 -- common/autotest_common.sh@960 -- # wait 3553802 00:26:57.500 00:26:57.500 real 0m15.769s 00:26:57.500 user 0m31.275s 00:26:57.500 sys 0m4.359s 00:26:57.500 19:25:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:57.500 19:25:15 -- common/autotest_common.sh@10 -- # set +x 00:26:57.500 ************************************ 00:26:57.500 END TEST nvmf_digest_clean 00:26:57.500 ************************************ 00:26:57.500 19:25:15 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:57.500 19:25:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:57.500 19:25:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:57.500 19:25:15 -- common/autotest_common.sh@10 -- # set +x 00:26:57.500 ************************************ 00:26:57.500 START TEST nvmf_digest_error 00:26:57.500 ************************************ 00:26:57.500 19:25:15 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:57.500 19:25:15 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:57.500 19:25:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:57.500 19:25:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:57.500 19:25:15 -- common/autotest_common.sh@10 -- # set +x 00:26:57.500 19:25:15 -- nvmf/common.sh@469 -- # nvmfpid=3555790 00:26:57.500 19:25:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:57.500 19:25:15 -- nvmf/common.sh@470 -- # waitforlisten 3555790 00:26:57.500 19:25:15 -- common/autotest_common.sh@829 -- # '[' -z 3555790 ']' 00:26:57.500 19:25:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:57.500 19:25:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.500 19:25:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:57.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:57.500 19:25:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.500 19:25:15 -- common/autotest_common.sh@10 -- # set +x 00:26:57.500 [2024-11-18 19:25:15.877894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.500 [2024-11-18 19:25:15.877993] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:57.500 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.500 [2024-11-18 19:25:15.943604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.500 [2024-11-18 19:25:16.055000] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:57.500 [2024-11-18 19:25:16.055165] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:57.500 [2024-11-18 19:25:16.055185] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:57.500 [2024-11-18 19:25:16.055201] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:57.500 [2024-11-18 19:25:16.055241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.500 19:25:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.500 19:25:16 -- common/autotest_common.sh@862 -- # return 0 00:26:57.500 19:25:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:57.500 19:25:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:57.500 19:25:16 -- common/autotest_common.sh@10 -- # set +x 00:26:57.759 19:25:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:57.759 19:25:16 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:57.759 19:25:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.759 19:25:16 -- common/autotest_common.sh@10 -- # set +x 00:26:57.759 [2024-11-18 19:25:16.115825] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:57.759 19:25:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.759 19:25:16 -- host/digest.sh@104 -- # common_target_config 00:26:57.759 19:25:16 -- host/digest.sh@43 -- # rpc_cmd 00:26:57.759 19:25:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.759 19:25:16 -- common/autotest_common.sh@10 -- # set +x 00:26:57.759 null0 00:26:57.759 [2024-11-18 19:25:16.237361] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:57.759 [2024-11-18 19:25:16.261605] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:57.759 19:25:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.759 19:25:16 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:57.759 19:25:16 -- host/digest.sh@54 -- # local rw bs qd 00:26:57.759 19:25:16 -- host/digest.sh@56 -- # rw=randread 00:26:57.759 19:25:16 -- host/digest.sh@56 -- # bs=4096 00:26:57.759 19:25:16 -- host/digest.sh@56 -- # qd=128 00:26:57.759 19:25:16 -- host/digest.sh@58 -- # bperfpid=3555809 00:26:57.759 19:25:16 -- host/digest.sh@60 -- # waitforlisten 3555809 /var/tmp/bperf.sock 00:26:57.759 19:25:16 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:57.759 19:25:16 -- common/autotest_common.sh@829 -- # '[' -z 3555809 ']' 00:26:57.759 19:25:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:57.759 19:25:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.759 19:25:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:57.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:57.759 19:25:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.759 19:25:16 -- common/autotest_common.sh@10 -- # set +x 00:26:57.759 [2024-11-18 19:25:16.306296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.759 [2024-11-18 19:25:16.306359] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3555809 ] 00:26:57.759 EAL: No free 2048 kB hugepages reported on node 1 00:26:58.017 [2024-11-18 19:25:16.363667] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:58.017 [2024-11-18 19:25:16.476112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:58.951 19:25:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:58.951 19:25:17 -- common/autotest_common.sh@862 -- # return 0 00:26:58.951 19:25:17 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:58.951 19:25:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:58.951 19:25:17 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:58.951 19:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:58.951 19:25:17 -- common/autotest_common.sh@10 -- # set +x 00:26:58.951 19:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:58.951 19:25:17 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.951 19:25:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:59.208 nvme0n1 00:26:59.467 19:25:17 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:59.467 19:25:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:59.467 19:25:17 -- common/autotest_common.sh@10 -- # set +x 00:26:59.467 19:25:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:59.467 19:25:17 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:59.467 19:25:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:59.467 Running I/O for 2 seconds... 00:26:59.467 [2024-11-18 19:25:17.956142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:17.956194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7422 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:17.956217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:17.967693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:17.967724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:17.967740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:17.985100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:17.985137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14731 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:17.985156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:18.002483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:18.002522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:18876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:18.002543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:18.020052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:18.020088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:7201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:18.020107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:18.037441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:18.037477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:24223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:18.037496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:18.053162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:18.053196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:18511 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:18.053215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.467 [2024-11-18 19:25:18.065258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.467 [2024-11-18 19:25:18.065293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:2805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.467 [2024-11-18 19:25:18.065313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.078975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.079012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:12279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.079033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.093781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.093811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.093828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.110696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.110725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:17457 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.110741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.127840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.127872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:11527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.127890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.145520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.145555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:23873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.145581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.158504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.158539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:14406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.158557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.169492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.169527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:21895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.169546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.182575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.182617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:15330 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.182639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.199780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.199809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:13166 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.199824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.216753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.216783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:7190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.216798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.233585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.233628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:7771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.233662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.250547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.250581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:22188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.250601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.262224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.262258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6814 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.262278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.278313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.278348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:15991 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.278367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.294995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.295030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:15459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.725 [2024-11-18 19:25:18.295049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.725 [2024-11-18 19:25:18.311965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.725 [2024-11-18 19:25:18.312014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:439 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.726 [2024-11-18 19:25:18.312033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.336560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.336597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:6559 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.336629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.347407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.347442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:19349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.347460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.363496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.363530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:18183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.363550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.379908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.379957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:6280 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.379976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.397997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.398031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:24563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.398050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.414819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.414846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:14797 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.414872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.431697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.431726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:20830 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.431743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.442826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.442854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:3025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.442870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.459040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.459089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:16327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.459109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.476313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.476348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.476370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.491374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.491408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:9263 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.491428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.506707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.506738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:9079 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.506756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.519235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.519268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.519288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.535020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.535053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8677 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.535073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.551920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.551960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:11251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.984 [2024-11-18 19:25:18.551980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.984 [2024-11-18 19:25:18.568820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.984 [2024-11-18 19:25:18.568848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:4236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.985 [2024-11-18 19:25:18.568867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.985 [2024-11-18 19:25:18.586004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:26:59.985 [2024-11-18 19:25:18.586053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8738 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.985 [2024-11-18 19:25:18.586078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.603064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.603100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12652 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.603120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.627152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.627186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.627206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.643789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.643817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:4948 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.643835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.654903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.654934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:10358 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.654967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.670900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.670946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21849 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.670965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.688363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.688398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.688417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.706315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.706349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:14660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.706367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.717226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.717260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:11241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.717278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.732746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.732774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.732796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.749772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.749801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.749818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.766695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.766725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:20221 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.766742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.243 [2024-11-18 19:25:18.783800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.243 [2024-11-18 19:25:18.783827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10779 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.243 [2024-11-18 19:25:18.783846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.244 [2024-11-18 19:25:18.801099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.244 [2024-11-18 19:25:18.801133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.244 [2024-11-18 19:25:18.801153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.244 [2024-11-18 19:25:18.816998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.244 [2024-11-18 19:25:18.817032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.244 [2024-11-18 19:25:18.817051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.244 [2024-11-18 19:25:18.833798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.244 [2024-11-18 19:25:18.833826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:5715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.244 [2024-11-18 19:25:18.833855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.851115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.851153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:4956 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.851173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.867767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.867799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:22897 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.867816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.883063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.883098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:16240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.883117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.894445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.894481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.894500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.911797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.911826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11433 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.911853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.928601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.928656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.928681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.945532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.945566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:2352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.945587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.961906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.961941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.961961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.977144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.977185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:4532 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.977205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:18.988389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:18.988423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:4331 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:18.988442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.003739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.003767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:23142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.003787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.019904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.019956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:2077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.019985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.036049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.036084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.036103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.053012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.053047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.053065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.068222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.068257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:19722 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.068276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.086680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.086708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:14829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.086724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.503 [2024-11-18 19:25:19.103675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.503 [2024-11-18 19:25:19.103707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:7983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.503 [2024-11-18 19:25:19.103726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.119556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.119594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:14469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.119624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.132560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.132616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.132638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.147022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.147057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:8781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.147077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.162512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.162546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.162565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.179424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.179460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:18953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.179479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.196304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.196338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.196358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.213287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.213322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:20527 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.213341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.228985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.229019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:3848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.229039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.240915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.240968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:6235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.240995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.258757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.258787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8840 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.258803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.274851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.274879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:23992 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.274895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.292087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.292122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:16413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.762 [2024-11-18 19:25:19.292141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.762 [2024-11-18 19:25:19.309044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.762 [2024-11-18 19:25:19.309078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:19063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.763 [2024-11-18 19:25:19.309097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.763 [2024-11-18 19:25:19.325892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.763 [2024-11-18 19:25:19.325935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:5712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.763 [2024-11-18 19:25:19.325951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.763 [2024-11-18 19:25:19.341128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.763 [2024-11-18 19:25:19.341161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20026 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.763 [2024-11-18 19:25:19.341180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:00.763 [2024-11-18 19:25:19.352726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:00.763 [2024-11-18 19:25:19.352755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:00.763 [2024-11-18 19:25:19.352771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.021 [2024-11-18 19:25:19.369916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.021 [2024-11-18 19:25:19.369949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:904 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.021 [2024-11-18 19:25:19.369981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.021 [2024-11-18 19:25:19.386835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.021 [2024-11-18 19:25:19.386869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:16044 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.386886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.403768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.403796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.403812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.420618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.420666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:21410 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.420683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.437389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.437424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14571 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.437443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.454292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.454329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:25013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.454347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.478808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.478839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.478857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.489431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.489465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:1476 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.489484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.505493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.505528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.505548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.519032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.519066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.519091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.531602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.531658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:18094 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.531676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.547005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.547040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:10174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.547059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.560751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.560779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:21760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.560795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.577705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.577736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23187 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.577754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.592938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.592986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:17946 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.593005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.610323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.610357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:21023 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.610376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.022 [2024-11-18 19:25:19.621240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.022 [2024-11-18 19:25:19.621296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10074 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.022 [2024-11-18 19:25:19.621326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.638230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.638267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:2314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.638288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.655268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.655311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:20721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.655331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.671804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.671836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.671853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.683822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.683852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:11603 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.683868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.699353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.699388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:12138 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.699408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.717005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.717040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:21414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.717059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.728319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.728353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:5066 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.728372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.744110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.744146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:9526 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.744165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.758967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.759015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:14395 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.759036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.774232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.774268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:17887 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.774287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.784604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.784673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:14240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.784689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.799703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.281 [2024-11-18 19:25:19.799731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.281 [2024-11-18 19:25:19.799747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.281 [2024-11-18 19:25:19.816487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.282 [2024-11-18 19:25:19.816521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:12724 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.282 [2024-11-18 19:25:19.816540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.282 [2024-11-18 19:25:19.828973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.282 [2024-11-18 19:25:19.829007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.282 [2024-11-18 19:25:19.829027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.282 [2024-11-18 19:25:19.845939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.282 [2024-11-18 19:25:19.845973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:9469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.282 [2024-11-18 19:25:19.845993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.282 [2024-11-18 19:25:19.856737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.282 [2024-11-18 19:25:19.856767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:21722 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.282 [2024-11-18 19:25:19.856798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.282 [2024-11-18 19:25:19.872321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.282 [2024-11-18 19:25:19.872356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.282 [2024-11-18 19:25:19.872376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.540 [2024-11-18 19:25:19.890506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.540 [2024-11-18 19:25:19.890544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4947 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.540 [2024-11-18 19:25:19.890565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.540 [2024-11-18 19:25:19.905853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.540 [2024-11-18 19:25:19.905886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.540 [2024-11-18 19:25:19.905925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.540 [2024-11-18 19:25:19.917340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.540 [2024-11-18 19:25:19.917374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:21538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.540 [2024-11-18 19:25:19.917394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.540 [2024-11-18 19:25:19.934128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x75fbb0) 00:27:01.540 [2024-11-18 19:25:19.934174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:14829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:01.540 [2024-11-18 19:25:19.934194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:01.540 00:27:01.540 Latency(us) 00:27:01.540 [2024-11-18T18:25:20.145Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.540 [2024-11-18T18:25:20.145Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:01.540 nvme0n1 : 2.01 16219.11 63.36 0.00 0.00 7885.55 3640.89 32039.82 00:27:01.540 [2024-11-18T18:25:20.145Z] =================================================================================================================== 00:27:01.540 [2024-11-18T18:25:20.145Z] Total : 16219.11 63.36 0.00 0.00 7885.55 3640.89 32039.82 00:27:01.540 0 00:27:01.540 19:25:19 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:01.540 19:25:19 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:01.540 19:25:19 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:01.540 | .driver_specific 00:27:01.540 | .nvme_error 00:27:01.540 | .status_code 00:27:01.540 | .command_transient_transport_error' 00:27:01.540 19:25:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:01.798 19:25:20 -- host/digest.sh@71 -- # (( 127 > 0 )) 00:27:01.798 19:25:20 -- host/digest.sh@73 -- # killprocess 3555809 00:27:01.798 19:25:20 -- common/autotest_common.sh@936 -- # '[' -z 3555809 ']' 00:27:01.798 19:25:20 -- common/autotest_common.sh@940 -- # kill -0 3555809 00:27:01.798 19:25:20 -- common/autotest_common.sh@941 -- # uname 00:27:01.799 19:25:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:01.799 19:25:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3555809 00:27:01.799 19:25:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:01.799 19:25:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:01.799 19:25:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3555809' 00:27:01.799 killing process with pid 3555809 00:27:01.799 19:25:20 -- common/autotest_common.sh@955 -- # kill 3555809 00:27:01.799 Received shutdown signal, test time was about 2.000000 seconds 00:27:01.799 00:27:01.799 Latency(us) 00:27:01.799 [2024-11-18T18:25:20.404Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:01.799 [2024-11-18T18:25:20.404Z] =================================================================================================================== 00:27:01.799 [2024-11-18T18:25:20.404Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:01.799 19:25:20 -- common/autotest_common.sh@960 -- # wait 3555809 00:27:02.057 19:25:20 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:02.057 19:25:20 -- host/digest.sh@54 -- # local rw bs qd 00:27:02.057 19:25:20 -- host/digest.sh@56 -- # rw=randread 00:27:02.057 19:25:20 -- host/digest.sh@56 -- # bs=131072 00:27:02.057 19:25:20 -- host/digest.sh@56 -- # qd=16 00:27:02.057 19:25:20 -- host/digest.sh@58 -- # bperfpid=3556362 00:27:02.057 19:25:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:02.057 19:25:20 -- host/digest.sh@60 -- # waitforlisten 3556362 /var/tmp/bperf.sock 00:27:02.057 19:25:20 -- common/autotest_common.sh@829 -- # '[' -z 3556362 ']' 00:27:02.057 19:25:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:02.057 19:25:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:02.057 19:25:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:02.057 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:02.057 19:25:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:02.057 19:25:20 -- common/autotest_common.sh@10 -- # set +x 00:27:02.057 [2024-11-18 19:25:20.587160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:02.057 [2024-11-18 19:25:20.587250] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3556362 ] 00:27:02.057 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:02.057 Zero copy mechanism will not be used. 00:27:02.057 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.057 [2024-11-18 19:25:20.644823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:02.316 [2024-11-18 19:25:20.751163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.249 19:25:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:03.249 19:25:21 -- common/autotest_common.sh@862 -- # return 0 00:27:03.249 19:25:21 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:03.249 19:25:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:03.506 19:25:21 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:03.506 19:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.506 19:25:21 -- common/autotest_common.sh@10 -- # set +x 00:27:03.506 19:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.506 19:25:21 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.506 19:25:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:03.765 nvme0n1 00:27:03.765 19:25:22 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:03.765 19:25:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:03.765 19:25:22 -- common/autotest_common.sh@10 -- # set +x 00:27:03.765 19:25:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:03.765 19:25:22 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:03.765 19:25:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:03.765 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:03.765 Zero copy mechanism will not be used. 00:27:03.765 Running I/O for 2 seconds... 00:27:04.024 [2024-11-18 19:25:22.380128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.024 [2024-11-18 19:25:22.380183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.024 [2024-11-18 19:25:22.380207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.024 [2024-11-18 19:25:22.386470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.386507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.386527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.393909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.393967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.393998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.401730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.401762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.401789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.407427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.407462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.407493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.412504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.412538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.412564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.417438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.417473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.417492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.422307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.422342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.422372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.427066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.427100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.427120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.432026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.432060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.432080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.436962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.437010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.437031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.442075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.442108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.442128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.447061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.447095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.447115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.451773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.451804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.451821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.456568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.456618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.456654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.461320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.461354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.461374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.466057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.466090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.466108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.470699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.470728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.470748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.475455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.475488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.475507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.480144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.480176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.480206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.484897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.484926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.484944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.025 [2024-11-18 19:25:22.489561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.025 [2024-11-18 19:25:22.489604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.025 [2024-11-18 19:25:22.489632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.494281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.494315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.494334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.499153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.499187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.499216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.503833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.503864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.503881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.508521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.508554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.508577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.513327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.513370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.513390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.518315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.518348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.518368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.524210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.524249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.524267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.530256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.530290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.530311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.536184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.536217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.536237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.542077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.542109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.542132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.547986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.548029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.548048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.553795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.553825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.553843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.559743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.559774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.559793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.565620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.565668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.565686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.571519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.571553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.571583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.577416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.577449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.577468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.583484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.583517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.583538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.589275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.589309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.589328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.595206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.595241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.595260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.600961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.601000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.601020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.606725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.606756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.606774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.612580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.612622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.026 [2024-11-18 19:25:22.612658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.026 [2024-11-18 19:25:22.618993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.026 [2024-11-18 19:25:22.619028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.027 [2024-11-18 19:25:22.619048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.027 [2024-11-18 19:25:22.626083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.027 [2024-11-18 19:25:22.626139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.027 [2024-11-18 19:25:22.626162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.633686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.633720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.633739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.640437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.640473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.640502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.648131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.648166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.648187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.654965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.655000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.655020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.662219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.662255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.662275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.668618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.668652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.668691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.675221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.675255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.675280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.682317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.682352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.682372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.690400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.690435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.690455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.698006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.698041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.698060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.705811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.287 [2024-11-18 19:25:22.705841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.287 [2024-11-18 19:25:22.705879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.287 [2024-11-18 19:25:22.713793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.713825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.713858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.720925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.720971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.720996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.727471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.727506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.727525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.733814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.733845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.733863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.740269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.740304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.740323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.745421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.745455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.745481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.750854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.750886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.750905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.756004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.756038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.756057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.761131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.761165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.761184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.766005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.766039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.766060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.770683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.770714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.770732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.775289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.775323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.775344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.780475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.780509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.780528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.786286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.786320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.786341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.792239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.792274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.792293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.798218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.798253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.798274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.804085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.804119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.804139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.809946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.809993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.810016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.815796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.815827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.815845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.821717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.821763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.821781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.827513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.827547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.827566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.833501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.833535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.833554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.288 [2024-11-18 19:25:22.839404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.288 [2024-11-18 19:25:22.839437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.288 [2024-11-18 19:25:22.839467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.845266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.845301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.845321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.851098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.851133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.851153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.856875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.856921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.856941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.862787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.862818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.862836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.868443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.868478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.868498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.874301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.874336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.874356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.880102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.880138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.880157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.289 [2024-11-18 19:25:22.886033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.289 [2024-11-18 19:25:22.886066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.289 [2024-11-18 19:25:22.886085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.892057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.892101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.892122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.897898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.897950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.897971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.903865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.903896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.903931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.908730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.908762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.908780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.913537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.913571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.913591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.918423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.918457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.918477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.923213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.923247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.923266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.928150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.928183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.928202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.933016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.549 [2024-11-18 19:25:22.933050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.549 [2024-11-18 19:25:22.933071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.549 [2024-11-18 19:25:22.937909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.937944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.937963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.942763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.942794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.942812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.947765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.947795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.947814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.952745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.952776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.952795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.957532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.957566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.957586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.962453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.962487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.962506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.967357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.967390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.967410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.972220] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.972253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.972272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.976837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.976867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.976891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.981459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.981493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.981513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.986117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.986150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.986169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.990838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.990887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.990904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.995577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.995617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.995653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:22.999227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:22.999260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:22.999279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.004392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.004427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.004447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.010136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.010170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.010189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.015986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.016038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.016059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.021911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.021964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.021985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.027684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.027716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.027733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.033392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.033426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.033447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.039254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.039288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.039308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.045095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.045129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.045148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.051046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.051080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.051099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.056887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.056934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.056953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.062597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.062637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.062671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.068260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.068293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.068312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.550 [2024-11-18 19:25:23.074080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.550 [2024-11-18 19:25:23.074112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.550 [2024-11-18 19:25:23.074131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.080041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.080075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.080094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.085678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.085709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.085725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.091326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.091359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.091379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.097186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.097219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.097238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.103111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.103146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.103165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.108775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.108805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.108822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.114518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.114551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.114570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.120306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.120339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.120365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.126076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.126109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.126128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.132045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.132078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.132097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.137750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.137780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.137796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.143486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.143520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.143539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.551 [2024-11-18 19:25:23.149259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.551 [2024-11-18 19:25:23.149296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.551 [2024-11-18 19:25:23.149317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.155057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.155095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.155115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.160988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.161025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.161046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.166818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.166850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.166867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.172712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.172743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.172760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.178411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.178446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.178465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.184255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.184288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.184307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.190176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.190210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.190230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.196094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.196129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.196149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.202120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.202155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.202174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.207900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.207929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.207965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.213800] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.213831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.213848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.219537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.219571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.219597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.225290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.225324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.225343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.230983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.231018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.231038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.236707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.236738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.236755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.242345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.242378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.242397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.248043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.248078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.248098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.253723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.253753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.253770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.259507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.259540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.259560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.811 [2024-11-18 19:25:23.265234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.811 [2024-11-18 19:25:23.265268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.811 [2024-11-18 19:25:23.265287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.270994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.271037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.271058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.276707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.276737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.276754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.282392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.282426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.282445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.288082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.288116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.288136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.293778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.293808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.293825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.299534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.299568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.299587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.305259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.305291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.305309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.310953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.311002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.311022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.316734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.316764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.316781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.322474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.322507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.322526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.328248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.328281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.328300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.334034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.334069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.334090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.339674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.339705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.339723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.345308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.345342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.345361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.351047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.351080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.351098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.357018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.357052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.357071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.362908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.362956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.362975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.368868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.368899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.368940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.374687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.374718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.374736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.380378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.380411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.380430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.386110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.386143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.386162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.391947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.391982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.392002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.397763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.397794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.397811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.403577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.403617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.403652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:04.812 [2024-11-18 19:25:23.409321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:04.812 [2024-11-18 19:25:23.409355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.812 [2024-11-18 19:25:23.409375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.415105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.415143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.415163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.420916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.420971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.420994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.426758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.426789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.426808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.432561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.432596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.432626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.438498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.438533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.438552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.444231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.444265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.444283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.450083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.450117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.450137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.455814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.455845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.455862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.461570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.461604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.461632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.467379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.467412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.467430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.473082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.473115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.473135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.478792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.478822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.478839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.484572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.484605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.484632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.490374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.490407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.490426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.496128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.496162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.496182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.502023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.502071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.502091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.507973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.508006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.508025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.513697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.513728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.513745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.519378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.519411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.519438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.525146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.525178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.525199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.531136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.531169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.531188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.536774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.536805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.073 [2024-11-18 19:25:23.536822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.073 [2024-11-18 19:25:23.542776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.073 [2024-11-18 19:25:23.542807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.542824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.549780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.549812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.549830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.557181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.557216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.557237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.563432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.563467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.563487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.568933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.568968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.568987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.574063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.574102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.574123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.579052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.579086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.579107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.584996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.585030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.585050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.590899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.590950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.590971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.596730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.596759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.596776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.602573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.602618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.602656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.608442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.608475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.608502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.614311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.614345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.614364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.620242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.620271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.620304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.626162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.626196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.626215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.632073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.632107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.632127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.638035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.638069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.638088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.643877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.643930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.643951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.649761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.649792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.649809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.655398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.655432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.655452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.661119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.661152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.661171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.666804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.666834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.666851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.074 [2024-11-18 19:25:23.672629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.074 [2024-11-18 19:25:23.672687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.074 [2024-11-18 19:25:23.672707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.678678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.678711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.678729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.684551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.684589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.684619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.690435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.690470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.690489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.696314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.696347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.696366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.702198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.702232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.702252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.708160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.708193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.708213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.714032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.714066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.714086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.719813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.719845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.719863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.725468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.725502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.725521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.731206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.731239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.731258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.737078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.737113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.737133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.743083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.743117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.743136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.749018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.749052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.749071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.755073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.755106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.755125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.760898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.760927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.760945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.766912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.766942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.766977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.772868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.772914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.772938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.778728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.778773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.778790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.784476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.784510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.784530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.790251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.790285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.335 [2024-11-18 19:25:23.790305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.335 [2024-11-18 19:25:23.796166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.335 [2024-11-18 19:25:23.796211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.796230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.802204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.802238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.802257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.808202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.808236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.808256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.814138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.814171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.814190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.820038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.820072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.820091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.825748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.825801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.825819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.831542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.831576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.831596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.837311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.837344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.837363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.843056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.843090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.843110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.847960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.847994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.848014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.852776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.852806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.852822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.857498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.857531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.857550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.862123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.862155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.862174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.866934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.866967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.866987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.871943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.871977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.871995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.877915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.877960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.877981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.883792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.883823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.883839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.889662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.889707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.889724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.895497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.895530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.895549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.901136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.901168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.901187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.906858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.906887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.906920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.912552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.912583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.912602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.918239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.918279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.918298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.924182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.924215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.924234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.930030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.930065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.930084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.336 [2024-11-18 19:25:23.935860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.336 [2024-11-18 19:25:23.935893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.336 [2024-11-18 19:25:23.935912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.941567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.941603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.941633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.947376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.947412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.947433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.953021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.953055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.953076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.958831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.958876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.958893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.964582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.964622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.964644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.970232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.970266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.970285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.975936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.975981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.975998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.981805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.981835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.981852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.987472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.987506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.987525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.993112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.993145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.993165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:23.998763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:23.998808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:23.998825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.004631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.004676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.004694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.010481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.010514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.010533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.016177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.016211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.016237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.021862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.021907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.021923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.027738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.027767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.027785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.033462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.033493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.033512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.039216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.039248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.039267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.045012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.045045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.045064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.051085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.051118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.051136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.056993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.057027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.057047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.062773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.062803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.062820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.068486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.068525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.068545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.074235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.074269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.074288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.597 [2024-11-18 19:25:24.079244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.597 [2024-11-18 19:25:24.079278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.597 [2024-11-18 19:25:24.079297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.087096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.087130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.087150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.093463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.093498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.093518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.099775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.099807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.099825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.105991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.106025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.106045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.112639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.112686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.112705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.119603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.119658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.119682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.124115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.124148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.124168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.131600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.131657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.131676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.139232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.139267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.139287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.145846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.145876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.145895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.152170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.152205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.152226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.158456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.158490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.158509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.165572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.165616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.165639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.173172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.173208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.173227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.180903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.180958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.180979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.188534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.188568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.188588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.598 [2024-11-18 19:25:24.195133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.598 [2024-11-18 19:25:24.195174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.598 [2024-11-18 19:25:24.195203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.201377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.201415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.201436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.207543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.207579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.207599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.212717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.212749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.212767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.217899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.217944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.217961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.223174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.223209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.223229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.229144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.229178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.229197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.235073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.235109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.235129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.239994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.240028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.240048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.245093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.245128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.245148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.250054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.250089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.250109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.254993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.255027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.255047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.260162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.260196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.260216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.265054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.265087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.265107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.270058] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.270091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.270111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.274532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.274565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.274591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.278291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.278325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.278345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.282528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.282563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.282582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.286655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.286701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.858 [2024-11-18 19:25:24.286718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.858 [2024-11-18 19:25:24.291503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.858 [2024-11-18 19:25:24.291535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.291554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.296257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.296289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.296308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.301294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.301328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.301347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.306107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.306141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.306160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.310893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.310940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.310959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.315952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.315994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.316014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.320494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.320527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.320546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.325033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.325068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.325088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.328832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.328861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.328893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.334458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.334493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.334512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.340506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.340540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.340560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.346389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.346423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.346442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.352562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.352596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.352626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.358579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.358621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.358643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.364586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.364630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.364651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:05.859 [2024-11-18 19:25:24.370834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x163bbb0) 00:27:05.859 [2024-11-18 19:25:24.370865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:05.859 [2024-11-18 19:25:24.370883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:05.859 00:27:05.859 Latency(us) 00:27:05.859 [2024-11-18T18:25:24.464Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:05.859 [2024-11-18T18:25:24.464Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:05.859 nvme0n1 : 2.00 5412.26 676.53 0.00 0.00 2952.24 615.92 10485.76 00:27:05.859 [2024-11-18T18:25:24.464Z] =================================================================================================================== 00:27:05.859 [2024-11-18T18:25:24.464Z] Total : 5412.26 676.53 0.00 0.00 2952.24 615.92 10485.76 00:27:05.859 0 00:27:05.859 19:25:24 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:05.859 19:25:24 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:05.859 19:25:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:05.859 19:25:24 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:05.859 | .driver_specific 00:27:05.859 | .nvme_error 00:27:05.859 | .status_code 00:27:05.859 | .command_transient_transport_error' 00:27:06.118 19:25:24 -- host/digest.sh@71 -- # (( 349 > 0 )) 00:27:06.118 19:25:24 -- host/digest.sh@73 -- # killprocess 3556362 00:27:06.118 19:25:24 -- common/autotest_common.sh@936 -- # '[' -z 3556362 ']' 00:27:06.118 19:25:24 -- common/autotest_common.sh@940 -- # kill -0 3556362 00:27:06.118 19:25:24 -- common/autotest_common.sh@941 -- # uname 00:27:06.118 19:25:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:06.118 19:25:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3556362 00:27:06.118 19:25:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:06.118 19:25:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:06.118 19:25:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3556362' 00:27:06.118 killing process with pid 3556362 00:27:06.118 19:25:24 -- common/autotest_common.sh@955 -- # kill 3556362 00:27:06.118 Received shutdown signal, test time was about 2.000000 seconds 00:27:06.118 00:27:06.118 Latency(us) 00:27:06.118 [2024-11-18T18:25:24.723Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.118 [2024-11-18T18:25:24.723Z] =================================================================================================================== 00:27:06.118 [2024-11-18T18:25:24.723Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:06.118 19:25:24 -- common/autotest_common.sh@960 -- # wait 3556362 00:27:06.377 19:25:24 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:06.377 19:25:24 -- host/digest.sh@54 -- # local rw bs qd 00:27:06.377 19:25:24 -- host/digest.sh@56 -- # rw=randwrite 00:27:06.377 19:25:24 -- host/digest.sh@56 -- # bs=4096 00:27:06.377 19:25:24 -- host/digest.sh@56 -- # qd=128 00:27:06.377 19:25:24 -- host/digest.sh@58 -- # bperfpid=3556919 00:27:06.377 19:25:24 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:06.377 19:25:24 -- host/digest.sh@60 -- # waitforlisten 3556919 /var/tmp/bperf.sock 00:27:06.377 19:25:24 -- common/autotest_common.sh@829 -- # '[' -z 3556919 ']' 00:27:06.377 19:25:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:06.377 19:25:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:06.377 19:25:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:06.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:06.377 19:25:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:06.377 19:25:24 -- common/autotest_common.sh@10 -- # set +x 00:27:06.635 [2024-11-18 19:25:24.994600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:06.636 [2024-11-18 19:25:24.994706] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3556919 ] 00:27:06.636 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.636 [2024-11-18 19:25:25.058575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:06.636 [2024-11-18 19:25:25.171225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:07.571 19:25:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:07.571 19:25:25 -- common/autotest_common.sh@862 -- # return 0 00:27:07.572 19:25:25 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.572 19:25:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:07.830 19:25:26 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:07.830 19:25:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:07.830 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:27:07.830 19:25:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:07.830 19:25:26 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:07.830 19:25:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:08.088 nvme0n1 00:27:08.088 19:25:26 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:08.088 19:25:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:08.088 19:25:26 -- common/autotest_common.sh@10 -- # set +x 00:27:08.088 19:25:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:08.088 19:25:26 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:08.088 19:25:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:08.088 Running I/O for 2 seconds... 00:27:08.088 [2024-11-18 19:25:26.659430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f6020 00:27:08.088 [2024-11-18 19:25:26.659683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:6364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.088 [2024-11-18 19:25:26.659720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:27:08.088 [2024-11-18 19:25:26.673045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ed920 00:27:08.088 [2024-11-18 19:25:26.674321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:8223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.088 [2024-11-18 19:25:26.674357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:08.088 [2024-11-18 19:25:26.685604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e95a0 00:27:08.088 [2024-11-18 19:25:26.686432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:1700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.088 [2024-11-18 19:25:26.686468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:08.347 [2024-11-18 19:25:26.699127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e1b48 00:27:08.347 [2024-11-18 19:25:26.700816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:11989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.347 [2024-11-18 19:25:26.700849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:08.347 [2024-11-18 19:25:26.710245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e12d8 00:27:08.347 [2024-11-18 19:25:26.711415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:24648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.347 [2024-11-18 19:25:26.711449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.347 [2024-11-18 19:25:26.722734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e99d8 00:27:08.347 [2024-11-18 19:25:26.723481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:15680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.347 [2024-11-18 19:25:26.723516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:08.347 [2024-11-18 19:25:26.734944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e0630 00:27:08.347 [2024-11-18 19:25:26.735694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:19363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.347 [2024-11-18 19:25:26.735725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:08.347 [2024-11-18 19:25:26.747120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ea680 00:27:08.347 [2024-11-18 19:25:26.747855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:21419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.347 [2024-11-18 19:25:26.747901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.347 [2024-11-18 19:25:26.759208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e1f80 00:27:08.347 [2024-11-18 19:25:26.759911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:7633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.347 [2024-11-18 19:25:26.759959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.771286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ebb98 00:27:08.348 [2024-11-18 19:25:26.771982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:23609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.772016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.783266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e2c28 00:27:08.348 [2024-11-18 19:25:26.784068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:22294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.784103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.794173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190de038 00:27:08.348 [2024-11-18 19:25:26.794285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:8780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.794322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0003 p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.808448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e95a0 00:27:08.348 [2024-11-18 19:25:26.809095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:5584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.809128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0035 p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.822048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e7818 00:27:08.348 [2024-11-18 19:25:26.824159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:13565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.824192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.834170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190eee38 00:27:08.348 [2024-11-18 19:25:26.835240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:5226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.835272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.847996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ee5c8 00:27:08.348 [2024-11-18 19:25:26.849457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:21636 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.849491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.857993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f7da8 00:27:08.348 [2024-11-18 19:25:26.859430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:5708 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.859463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.871851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e5220 00:27:08.348 [2024-11-18 19:25:26.872854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:7854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.872883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.882837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190fd640 00:27:08.348 [2024-11-18 19:25:26.883676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:18370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.883706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.895020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e84c0 00:27:08.348 [2024-11-18 19:25:26.896376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:15949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.896409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.908138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190fa3a0 00:27:08.348 [2024-11-18 19:25:26.908767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.908796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.920552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190eea00 00:27:08.348 [2024-11-18 19:25:26.921344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.921377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.933089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f6cc8 00:27:08.348 [2024-11-18 19:25:26.933823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16364 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.933853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:08.348 [2024-11-18 19:25:26.945358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ec840 00:27:08.348 [2024-11-18 19:25:26.946062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25555 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.348 [2024-11-18 19:25:26.946095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:26.957646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ec408 00:27:08.607 [2024-11-18 19:25:26.958301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17734 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:26.958337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:26.969892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e49b0 00:27:08.607 [2024-11-18 19:25:26.970512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:22874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:26.970546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:26.982174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ef270 00:27:08.607 [2024-11-18 19:25:26.982756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:4199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:26.982786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:26.994405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190eb328 00:27:08.607 [2024-11-18 19:25:26.994936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:26.994970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.006591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ec840 00:27:08.607 [2024-11-18 19:25:27.007133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.007166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.018853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ed4e8 00:27:08.607 [2024-11-18 19:25:27.019349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:11916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.019383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.030983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f1ca0 00:27:08.607 [2024-11-18 19:25:27.031482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:21348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.031515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.042940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:08.607 [2024-11-18 19:25:27.043757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:2999 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.043787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.055101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f5be8 00:27:08.607 [2024-11-18 19:25:27.056600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:8383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.056656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.067665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f9b30 00:27:08.607 [2024-11-18 19:25:27.068286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:15641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.068319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.082477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190eaef0 00:27:08.607 [2024-11-18 19:25:27.084301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:21440 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.084334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.092893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e4578 00:27:08.607 [2024-11-18 19:25:27.094340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:22875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.094372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.107185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190eb760 00:27:08.607 [2024-11-18 19:25:27.109007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:5419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.607 [2024-11-18 19:25:27.109040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.607 [2024-11-18 19:25:27.117621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ed4e8 00:27:08.607 [2024-11-18 19:25:27.119053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:6678 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.119091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.130762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e5658 00:27:08.608 [2024-11-18 19:25:27.132118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:12045 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.132151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.143005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190fda78 00:27:08.608 [2024-11-18 19:25:27.144876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:5450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.144929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.156223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e4578 00:27:08.608 [2024-11-18 19:25:27.158096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10673 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.158129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.166929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e27f0 00:27:08.608 [2024-11-18 19:25:27.168036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.168068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.179030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e27f0 00:27:08.608 [2024-11-18 19:25:27.180539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:2954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.180571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.190466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190df988 00:27:08.608 [2024-11-18 19:25:27.191698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:18081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.191728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:08.608 [2024-11-18 19:25:27.203039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190edd58 00:27:08.608 [2024-11-18 19:25:27.204178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:15400 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.608 [2024-11-18 19:25:27.204212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.215376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190fda78 00:27:08.867 [2024-11-18 19:25:27.216772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:9630 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.216805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.227680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e4140 00:27:08.867 [2024-11-18 19:25:27.228861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:25126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.228891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.239921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e6b70 00:27:08.867 [2024-11-18 19:25:27.241092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:7337 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.241126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.252070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ee190 00:27:08.867 [2024-11-18 19:25:27.253256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:22552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.253299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.264295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ef270 00:27:08.867 [2024-11-18 19:25:27.265480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.265514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.276859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190fc998 00:27:08.867 [2024-11-18 19:25:27.277654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:12416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.277700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.289118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e4140 00:27:08.867 [2024-11-18 19:25:27.289617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:21728 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.867 [2024-11-18 19:25:27.289664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:08.867 [2024-11-18 19:25:27.301351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ee190 00:27:08.868 [2024-11-18 19:25:27.301824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:13496 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.301868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.313451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f4f40 00:27:08.868 [2024-11-18 19:25:27.313897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:20861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.313926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.325809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e6738 00:27:08.868 [2024-11-18 19:25:27.326223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:6888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.326256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.337913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f4f40 00:27:08.868 [2024-11-18 19:25:27.338245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.338278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.350151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190ee190 00:27:08.868 [2024-11-18 19:25:27.350442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:16113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.350475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.362204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e4140 00:27:08.868 [2024-11-18 19:25:27.362460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:13406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.362493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.374504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e88f8 00:27:08.868 [2024-11-18 19:25:27.374758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:12894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.374788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.388763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190efae0 00:27:08.868 [2024-11-18 19:25:27.390536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.390570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.401067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:08.868 [2024-11-18 19:25:27.402870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:16215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.402899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.413377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190e1f80 00:27:08.868 [2024-11-18 19:25:27.415015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:15634 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.415048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.424386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:08.868 [2024-11-18 19:25:27.425473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.425505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.438082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:08.868 [2024-11-18 19:25:27.438389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:4153 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.438427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.451448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:08.868 [2024-11-18 19:25:27.451760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9269 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.451790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.868 [2024-11-18 19:25:27.464945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:08.868 [2024-11-18 19:25:27.465253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:23807 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.868 [2024-11-18 19:25:27.465284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.478436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.478749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.478781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.492013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.492319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.492352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.505546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.505892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:4994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.505921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.519120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.519426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:11959 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.519458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.532710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.533014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:11611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.533061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.546387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.546715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:12195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.546744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.559882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.560203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:7396 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.560235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.573453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.573770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:3071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.573799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.587075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.587380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:24259 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.587411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.600561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.600894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.600922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.614170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.614479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:10164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.614511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.627722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.628015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:1994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.628058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.641343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.641677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.641706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.654862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.655182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.655213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.668401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.668730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:10488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.668757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.681855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.682165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:15418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.682196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.695487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.695839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:20416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.695868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.709073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.709377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.709409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.127 [2024-11-18 19:25:27.722655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.127 [2024-11-18 19:25:27.722991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:7529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.127 [2024-11-18 19:25:27.723022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.736193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.736498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:21668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.736533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.749874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.750197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:21575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.750231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.763514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.763859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:12870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.763904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.777167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.777473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:25453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.777505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.790867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.791194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:19340 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.791232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.804556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.804935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:19095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.804981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.818320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.818653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:17681 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.818683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.832072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.832378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.832410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.845780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.846116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:6308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.389 [2024-11-18 19:25:27.846149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.389 [2024-11-18 19:25:27.859370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.389 [2024-11-18 19:25:27.859695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.859724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.872921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.873240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:1719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.873271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.886378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.886698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:10815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.886743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.900090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.900393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:6864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.900424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.913815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.914158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.914195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.927411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.927735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:15094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.927764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.941186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.941457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:6732 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.941488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.954773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.955084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:3620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.955116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.968363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.968674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:13708 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.968720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.390 [2024-11-18 19:25:27.981979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.390 [2024-11-18 19:25:27.982282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:9656 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.390 [2024-11-18 19:25:27.982315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:27.995532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:27.995881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24171 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:27.995929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.009143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.009462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:8675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.009497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.022733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.023156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.023189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.036390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.036712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:21785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.036742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.050097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.050408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:3954 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.050440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.063721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.064065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:19072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.064097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.077433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.077761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:16517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.077790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.091194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.091501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:3940 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.091533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.104879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.105204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:15339 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.105236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.118639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.119001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:23457 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.119033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.132113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.132419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:10373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.132452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.145568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.145996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:6421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.146029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.159057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.159360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:24076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.159392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.172522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.172892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:12823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.172921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.186029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.186330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:6921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.186362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.199506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.199790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10969 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.199820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.212958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.213284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.213315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.226396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.226720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:14821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.226750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.649 [2024-11-18 19:25:28.239831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.649 [2024-11-18 19:25:28.240175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.649 [2024-11-18 19:25:28.240206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.253251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.907 [2024-11-18 19:25:28.253585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:13192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.907 [2024-11-18 19:25:28.253650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.266687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.907 [2024-11-18 19:25:28.266983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:3733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.907 [2024-11-18 19:25:28.267027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.280348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.907 [2024-11-18 19:25:28.280750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:6209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.907 [2024-11-18 19:25:28.280780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.294069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.907 [2024-11-18 19:25:28.294446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25171 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.907 [2024-11-18 19:25:28.294476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.307753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.907 [2024-11-18 19:25:28.308167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:14896 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.907 [2024-11-18 19:25:28.308199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.321516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.907 [2024-11-18 19:25:28.321890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:6620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.907 [2024-11-18 19:25:28.321918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.907 [2024-11-18 19:25:28.335141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.335472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:12684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.335503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.348789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.349141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.349169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.362481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.362799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:23564 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.362828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.376250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.376731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:6280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.376760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.390058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.390405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:12123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.390434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.403808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.404146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7839 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.404174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.417605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.418010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:5768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.418055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.431351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.431757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:20804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.431785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.444954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.445339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:5745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.445367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.458617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.458942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:5499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.458970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.472222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.472552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:18750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.472582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.485756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.486109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:4708 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.486137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:09.908 [2024-11-18 19:25:28.499288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:09.908 [2024-11-18 19:25:28.499617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:9410 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:09.908 [2024-11-18 19:25:28.499645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.190 [2024-11-18 19:25:28.512862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.190 [2024-11-18 19:25:28.513270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.190 [2024-11-18 19:25:28.513304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.190 [2024-11-18 19:25:28.526396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.190 [2024-11-18 19:25:28.526737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:1019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.190 [2024-11-18 19:25:28.526768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.190 [2024-11-18 19:25:28.539904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.190 [2024-11-18 19:25:28.540233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.190 [2024-11-18 19:25:28.540262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.190 [2024-11-18 19:25:28.553506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.190 [2024-11-18 19:25:28.553812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:10098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.553841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.567149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.567529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:16843 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.567559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.580705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.581119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:1209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.581150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.594322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.594647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.594676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.607953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.608348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:20691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.608375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.621726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.622034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:2606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.622068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.635353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.635754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:5541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.635783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 [2024-11-18 19:25:28.649115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44ad0) with pdu=0x2000190f8a50 00:27:10.191 [2024-11-18 19:25:28.649389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:10.191 [2024-11-18 19:25:28.649416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:10.191 00:27:10.191 Latency(us) 00:27:10.191 [2024-11-18T18:25:28.796Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.191 [2024-11-18T18:25:28.796Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:10.191 nvme0n1 : 2.01 19470.42 76.06 0.00 0.00 6559.91 3082.62 15631.55 00:27:10.191 [2024-11-18T18:25:28.796Z] =================================================================================================================== 00:27:10.191 [2024-11-18T18:25:28.796Z] Total : 19470.42 76.06 0.00 0.00 6559.91 3082.62 15631.55 00:27:10.191 0 00:27:10.191 19:25:28 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:10.191 19:25:28 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:10.191 19:25:28 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:10.191 | .driver_specific 00:27:10.191 | .nvme_error 00:27:10.191 | .status_code 00:27:10.191 | .command_transient_transport_error' 00:27:10.191 19:25:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:10.491 19:25:28 -- host/digest.sh@71 -- # (( 153 > 0 )) 00:27:10.491 19:25:28 -- host/digest.sh@73 -- # killprocess 3556919 00:27:10.491 19:25:28 -- common/autotest_common.sh@936 -- # '[' -z 3556919 ']' 00:27:10.492 19:25:28 -- common/autotest_common.sh@940 -- # kill -0 3556919 00:27:10.492 19:25:28 -- common/autotest_common.sh@941 -- # uname 00:27:10.492 19:25:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:10.492 19:25:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3556919 00:27:10.492 19:25:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:10.492 19:25:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:10.492 19:25:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3556919' 00:27:10.492 killing process with pid 3556919 00:27:10.492 19:25:28 -- common/autotest_common.sh@955 -- # kill 3556919 00:27:10.492 Received shutdown signal, test time was about 2.000000 seconds 00:27:10.492 00:27:10.492 Latency(us) 00:27:10.492 [2024-11-18T18:25:29.097Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:10.492 [2024-11-18T18:25:29.097Z] =================================================================================================================== 00:27:10.492 [2024-11-18T18:25:29.097Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:10.492 19:25:28 -- common/autotest_common.sh@960 -- # wait 3556919 00:27:10.752 19:25:29 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:10.752 19:25:29 -- host/digest.sh@54 -- # local rw bs qd 00:27:10.752 19:25:29 -- host/digest.sh@56 -- # rw=randwrite 00:27:10.752 19:25:29 -- host/digest.sh@56 -- # bs=131072 00:27:10.752 19:25:29 -- host/digest.sh@56 -- # qd=16 00:27:10.752 19:25:29 -- host/digest.sh@58 -- # bperfpid=3557348 00:27:10.752 19:25:29 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:10.752 19:25:29 -- host/digest.sh@60 -- # waitforlisten 3557348 /var/tmp/bperf.sock 00:27:10.752 19:25:29 -- common/autotest_common.sh@829 -- # '[' -z 3557348 ']' 00:27:10.752 19:25:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:10.752 19:25:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:10.752 19:25:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:10.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:10.752 19:25:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:10.752 19:25:29 -- common/autotest_common.sh@10 -- # set +x 00:27:10.752 [2024-11-18 19:25:29.278850] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:10.752 [2024-11-18 19:25:29.278939] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3557348 ] 00:27:10.752 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:10.752 Zero copy mechanism will not be used. 00:27:10.752 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.752 [2024-11-18 19:25:29.342050] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:11.011 [2024-11-18 19:25:29.454299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:11.944 19:25:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:11.944 19:25:30 -- common/autotest_common.sh@862 -- # return 0 00:27:11.944 19:25:30 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:11.944 19:25:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:12.202 19:25:30 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:12.202 19:25:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.202 19:25:30 -- common/autotest_common.sh@10 -- # set +x 00:27:12.202 19:25:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.202 19:25:30 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.202 19:25:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:12.460 nvme0n1 00:27:12.460 19:25:31 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:12.460 19:25:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.460 19:25:31 -- common/autotest_common.sh@10 -- # set +x 00:27:12.460 19:25:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.460 19:25:31 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:12.460 19:25:31 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:12.720 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:12.720 Zero copy mechanism will not be used. 00:27:12.720 Running I/O for 2 seconds... 00:27:12.720 [2024-11-18 19:25:31.168818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.169111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.169155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.173762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.173942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.173978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.178352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.178510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.178541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.182882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.183025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.183056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.188132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.188215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.188246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.192903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.193027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.193059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.197503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.197659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.197705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.202119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.202365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.202399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.206620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.206852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.206883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.211168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.211363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.211395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.215687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.215798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.215827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.220147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.220261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.220293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.224588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.224732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.224761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.229122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.229295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.229326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.233618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.233783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.233812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.238216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.238456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.720 [2024-11-18 19:25:31.238490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.720 [2024-11-18 19:25:31.242697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.720 [2024-11-18 19:25:31.242917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.242952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.247214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.247417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.247448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.251705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.251825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.251853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.256183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.256291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.256329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.260630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.260749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.260777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.264864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.265018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.265047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.269047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.269191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.269221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.273200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.273421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.273450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.277315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.277547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.277591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.282163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.282314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.282355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.286486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.286599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.286644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.290507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.290619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.290646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.294557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.294676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.294706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.298676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.298863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.298893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.302791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.302918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.302947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.306965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.307181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.307211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.310932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.311140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.311169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.315020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.315194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.315224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.319056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.721 [2024-11-18 19:25:31.319208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.721 [2024-11-18 19:25:31.319241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.721 [2024-11-18 19:25:31.323026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.323132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.323161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.327033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.327144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.327194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.331103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.331261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.331292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.335171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.335297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.335327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.339439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.339665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.339696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.343509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.343698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.343728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.347536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.347704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.347734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.351588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.351715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.351744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.355562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.355660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.355687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.359571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.359703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.359732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.364093] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.364276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.364306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.369178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.369311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.369340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.375516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.375804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.375834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.381017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.381266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.381299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.386354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.386518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.386551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.391819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.391971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.392004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.397127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.397262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.397295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.981 [2024-11-18 19:25:31.402319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.981 [2024-11-18 19:25:31.402458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.981 [2024-11-18 19:25:31.402490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.407752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.408052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.408085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.413253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.413424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.413456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.418745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.418864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.418892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.424378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.424702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.424731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.429550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.429740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.429769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.434821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.434988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.435020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.440363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.440680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.440711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.445949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.446174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.446207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.451471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.451625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.451673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.456447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.456678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.456713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.460878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.461073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.461106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.466245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.466371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.466403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.471823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.472022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.472056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.476540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.476717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.476747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.481378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.481605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.481652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.486066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.486251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.486284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.490862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.490994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.491027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.495720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.495873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.495925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.500498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.500693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.500723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.505064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.505165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.505195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.510206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.510443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.510476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.515376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.515692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.515723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.521007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.521178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.521211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.526877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.527056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.527089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.531353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.531508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.531542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.536050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.536212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.536242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.982 [2024-11-18 19:25:31.540735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.982 [2024-11-18 19:25:31.540857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.982 [2024-11-18 19:25:31.540887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.545227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.545385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.545418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.549834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.550067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.550097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.554839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.555040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.555070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.559852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.560019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.560048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.565313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.565570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.565620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.571430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.571603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.571638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.576198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.576296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.576323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.983 [2024-11-18 19:25:31.580460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:12.983 [2024-11-18 19:25:31.580695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.983 [2024-11-18 19:25:31.580728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.243 [2024-11-18 19:25:31.585167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.243 [2024-11-18 19:25:31.585349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.243 [2024-11-18 19:25:31.585395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.243 [2024-11-18 19:25:31.590845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.243 [2024-11-18 19:25:31.591019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.243 [2024-11-18 19:25:31.591050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.243 [2024-11-18 19:25:31.595663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.243 [2024-11-18 19:25:31.595841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.243 [2024-11-18 19:25:31.595871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.243 [2024-11-18 19:25:31.601081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.243 [2024-11-18 19:25:31.601208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.601239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.606468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.606730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.606761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.612409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.612558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.612590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.618579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.618809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.618840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.623681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.623924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.623957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.628234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.628409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.628441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.632745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.632885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.632932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.637216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.637408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.637439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.641527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.641653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.641699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.645966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.646110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.646140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.650571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.650744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.650773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.656303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.656413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.656443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.661945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.662234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.662264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.668467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.668740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.668770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.673805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.674018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.674065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.678962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.679153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.679185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.684388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.684522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.684553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.689823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.689967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.689998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.695269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.695412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.695444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.700967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.701217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.701250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.706465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.706746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.706776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.712113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.712384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.712417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.717507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.717714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.717744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.722992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.723123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.723154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.728605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.728843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.728872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.734276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.734448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.734480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.244 [2024-11-18 19:25:31.739781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.244 [2024-11-18 19:25:31.739932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.244 [2024-11-18 19:25:31.739963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.745506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.745681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.745710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.751013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.751276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.751309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.756550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.756707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.756737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.761068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.761209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.761242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.765575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.765734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.765764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.770063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.770205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.770237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.774701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.774859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.774888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.779896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.780002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.780032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.785027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.785255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.785287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.789518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.789732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.789762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.793954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.794121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.794153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.798365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.798484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.798516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.802778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.802886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.802932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.807216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.807376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.807413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.811595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.811738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.811767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.816048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.816187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.816219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.820532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.820756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.820786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.824990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.825177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.825210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.829403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.829563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.829595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.833780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.833887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.833933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.838198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.838330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.838363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.245 [2024-11-18 19:25:31.843058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.245 [2024-11-18 19:25:31.843215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.245 [2024-11-18 19:25:31.843249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.848264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.848508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.848543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.853575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.853764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.853797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.858770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.859018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.859052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.863297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.863563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.863596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.868752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.869028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.869062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.873686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.873848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.873878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.878082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.878199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.878231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.883301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.505 [2024-11-18 19:25:31.883414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.505 [2024-11-18 19:25:31.883445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.505 [2024-11-18 19:25:31.888460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.888594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.888637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.892828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.892956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.892988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.897177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.897285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.897317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.901692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.901874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.901903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.906162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.906387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.906419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.910577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.910744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.910774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.914859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.914969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.915007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.919146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.919344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.919377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.923585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.923745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.923773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.928017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.928135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.928172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.932602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.932821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.932850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.936897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.937085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.937131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.941477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.941726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.941756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.945955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.946145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.946176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.950377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.950510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.950540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.954864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.955063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.955095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.959220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.959358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.959389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.963634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.963759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.963788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.968391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.968589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.968629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.973277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.973404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.973436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.978447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.978692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.978722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.983466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.983649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.983695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.988468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.988550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.988579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.993557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.993736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.993766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:31.998736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:31.998856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:31.998885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:32.003811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:32.003929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:32.003961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:32.009491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.506 [2024-11-18 19:25:32.009745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.506 [2024-11-18 19:25:32.009775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.506 [2024-11-18 19:25:32.014782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.014904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.014953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.020018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.020216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.020248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.025164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.025289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.025321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.030399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.030484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.030513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.035567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.035774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.035802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.040577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.040743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.040773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.045731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.045804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.045830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.050925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.051126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.051158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.056112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.056219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.056262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.060842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.060971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.061003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.065974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.066109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.066141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.070969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.071054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.071084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.076154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.076316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.076348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.081203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.081343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.081375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.086203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.086285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.086315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.091421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.091603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.091643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.096673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.096829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.096859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.101948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.102149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.102179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.507 [2024-11-18 19:25:32.106826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.507 [2024-11-18 19:25:32.106964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.507 [2024-11-18 19:25:32.106998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.111631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.111724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.111753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.116715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.116853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.116883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.121887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.122011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.122042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.126868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.127004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.127035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.132037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.132225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.132257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.137205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.137423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.137452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.142503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.142735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.142769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.147994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.767 [2024-11-18 19:25:32.148133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.767 [2024-11-18 19:25:32.148164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.767 [2024-11-18 19:25:32.152489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.152631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.152662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.156942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.157138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.157170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.161290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.161423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.161453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.165708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.165815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.165843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.170142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.170350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.170381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.174491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.174718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.174747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.178974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.179200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.179231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.183228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.183386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.183415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.187171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.187270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.187297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.191133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.191300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.191328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.195443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.195566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.195596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.199859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.199983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.200012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.204380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.204585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.204630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.208806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.209011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.209042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.213270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.213498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.213531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.217737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.217889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.217917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.222113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.222230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.222260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.226544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.226750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.226779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.230957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.231110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.231141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.235335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.235451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.235481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.239831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.240039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.240069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.244187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.244375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.244405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.248686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.248894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.248923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.253092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.253266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.253296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.257436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.257551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.257588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.261949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.262151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.262182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.266333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.768 [2024-11-18 19:25:32.266480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.768 [2024-11-18 19:25:32.266511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.768 [2024-11-18 19:25:32.270755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.270856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.270883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.275250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.275457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.275489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.279627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.279824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.279852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.284100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.284333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.284367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.288511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.288665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.288693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.292901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.293057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.293087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.297426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.297654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.297683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.301857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.302018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.302049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.306244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.306345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.306375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.310657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.310869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.310898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.315071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.315271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.315302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.319551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.319789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.319820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.323998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.324164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.324194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.328346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.328462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.328493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.332798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.332989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.333019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.337178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.337347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.337378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.341592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.341732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.341760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.346031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.346239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.346270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.350424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.350636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.350667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.354899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.355150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.355184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.359282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.359460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.359491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.363650] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.363777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.363805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.769 [2024-11-18 19:25:32.368060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:13.769 [2024-11-18 19:25:32.368260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.769 [2024-11-18 19:25:32.368291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.372347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.372468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.372507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.376600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.376746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.376780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.381046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.381253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.381285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.385460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.385655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.385700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.389894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.390146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.390180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.394295] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.394493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.394525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.398684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.398776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.398804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.403142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.403356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.403387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.407576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.407736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.407765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.412021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.412132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.412163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.416507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.416731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.416759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.420859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.421069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.421101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.029 [2024-11-18 19:25:32.425307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.029 [2024-11-18 19:25:32.425534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.029 [2024-11-18 19:25:32.425566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.429736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.429886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.429914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.434420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.434564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.434592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.439596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.439836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.439866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.445415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.445601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.445640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.451182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.451304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.451340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.455798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.456013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.456045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.460539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.460719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.460750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.465319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.465545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.465578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.469975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.470159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.470201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.474573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.474716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.474745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.479082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.479303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.479335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.484102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.484364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.484398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.489294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.489529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.489563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.494553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.494834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.494866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.499348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.499570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.499602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.504082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.504304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.504338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.509150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.509315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.509346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.514292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.514488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.514518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.520236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.520434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.520466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.526154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.526360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.526393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.530844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.530977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.531008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.535560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.535817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.535848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.541243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.541464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.541496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.545890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.546102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.546133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.550310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.550442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.550473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.554749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.554861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.554888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.030 [2024-11-18 19:25:32.559133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.030 [2024-11-18 19:25:32.559244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.030 [2024-11-18 19:25:32.559275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.563647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.563829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.563856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.568040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.568186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.568217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.572561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.572812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.572843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.576959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.577200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.577239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.581383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.581583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.581622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.585789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.585901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.585946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.590170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.590277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.590304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.594579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.594727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.594756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.599049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.599220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.599251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.603456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.603603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.603642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.608007] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.608248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.608282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.612397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.612636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.612684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.616883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.617101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.617134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.621296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.621441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.621473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.625729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.625826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.625853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.031 [2024-11-18 19:25:32.630035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.031 [2024-11-18 19:25:32.630153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.031 [2024-11-18 19:25:32.630185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.291 [2024-11-18 19:25:32.634472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.634669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.634701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.638810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.638981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.639016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.643318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.643558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.643591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.647756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.647996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.648028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.652057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.652226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.652260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.656491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.656619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.656665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.660950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.661056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.661088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.665403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.665525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.665557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.669944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.670141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.670174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.674378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.674527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.674559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.678920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.679191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.679224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.683408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.683656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.683703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.687447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.687626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.687657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.691369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.691485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.691518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.695284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.695377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.695405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.699741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.699818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.699844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.704190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.704360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.704392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.709032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.709154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.709186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.713946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.714190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.714223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.718392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.718623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.718656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.722746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.722937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.722968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.727100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.727227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.727258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.731467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.731595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.731638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.736050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.736153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.736185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.740513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.740713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.740743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.744912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.745057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.292 [2024-11-18 19:25:32.745089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.292 [2024-11-18 19:25:32.749446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.292 [2024-11-18 19:25:32.749706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.749736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.753772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.754004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.754037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.758288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.758480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.758513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.762719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.762817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.762844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.767120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.767224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.767254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.771539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.771658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.771702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.776046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.776180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.776209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.779984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.780119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.780148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.784027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.784244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.784272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.788010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.788220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.788249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.792003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.792156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.792184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.795997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.796106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.796133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.800050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.800185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.800216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.804472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.804591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.804650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.809042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.809221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.809253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.813389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.813537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.813568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.817938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.818179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.818212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.822319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.822547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.822579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.826805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.826984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.827017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.831190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.831320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.831350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.835554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.835677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.835705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.839983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.840098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.840128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.844408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.844584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.844626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.848811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.848949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.848992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.853341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.853583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.853625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.857769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.858004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.858036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.862214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.862390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.293 [2024-11-18 19:25:32.862421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.293 [2024-11-18 19:25:32.866632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.293 [2024-11-18 19:25:32.866768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.866796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.294 [2024-11-18 19:25:32.871022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.294 [2024-11-18 19:25:32.871138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.871168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.294 [2024-11-18 19:25:32.875380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.294 [2024-11-18 19:25:32.875504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.875534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.294 [2024-11-18 19:25:32.879853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.294 [2024-11-18 19:25:32.880037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.880073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.294 [2024-11-18 19:25:32.884204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.294 [2024-11-18 19:25:32.884379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.884409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.294 [2024-11-18 19:25:32.888718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.294 [2024-11-18 19:25:32.888952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.888985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.294 [2024-11-18 19:25:32.893128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.294 [2024-11-18 19:25:32.893329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.294 [2024-11-18 19:25:32.893363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.897459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.897624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.897656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.901940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.902087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.902120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.906392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.906522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.906553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.910779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.910889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.910918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.915229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.915401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.915432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.919677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.919806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.919833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.924219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.924461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.924494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.928605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.928834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.928863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.933071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.933264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.933297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.937751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.937888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.937932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.943024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.943211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.943239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.948131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.948255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.948286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.954595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.954700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.954727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.554 [2024-11-18 19:25:32.959352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.554 [2024-11-18 19:25:32.959511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.554 [2024-11-18 19:25:32.959542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.964205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.964375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.964406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.969191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.969430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.969463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.973970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.974167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.974198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.978805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.978966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.978998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.983299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.983437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.983468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.987902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.988046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.988076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.993192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.993369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.993399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:32.998533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:32.998750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:32.998779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.004696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.004945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.004985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.010376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.010561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.010592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.016684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.016876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.016904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.023180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.023406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.023437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.029931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.030143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.030173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.036400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.036541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.036571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.042734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.042837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.042865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.049121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.049237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.049268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.056031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.056260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.056292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.062391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.062696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.062728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.068965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.069190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.069222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.075214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.075397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.075427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.081443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.081557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.081587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.087703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.087870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.087899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.094299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.094638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.094686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.100635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.555 [2024-11-18 19:25:33.100816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.555 [2024-11-18 19:25:33.100846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.555 [2024-11-18 19:25:33.107418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.107735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.107764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.113724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.113911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.113960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.120290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.120450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.120482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.126718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.126852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.126880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.133353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.133546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.133578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.139427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.139507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.139537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.144951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.145133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.145166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.149469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.149691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.149721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:14.556 [2024-11-18 19:25:33.153970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.556 [2024-11-18 19:25:33.154208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.556 [2024-11-18 19:25:33.154243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:14.815 [2024-11-18 19:25:33.158255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.815 [2024-11-18 19:25:33.158405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.815 [2024-11-18 19:25:33.158437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.815 [2024-11-18 19:25:33.162237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1e44fb0) with pdu=0x2000190fef90 00:27:14.815 [2024-11-18 19:25:33.162350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.815 [2024-11-18 19:25:33.162396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:14.815 00:27:14.815 Latency(us) 00:27:14.815 [2024-11-18T18:25:33.420Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:14.815 [2024-11-18T18:25:33.420Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:14.815 nvme0n1 : 2.00 6462.27 807.78 0.00 0.00 2468.79 1796.17 9466.31 00:27:14.815 [2024-11-18T18:25:33.420Z] =================================================================================================================== 00:27:14.815 [2024-11-18T18:25:33.420Z] Total : 6462.27 807.78 0.00 0.00 2468.79 1796.17 9466.31 00:27:14.815 0 00:27:14.815 19:25:33 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:14.815 19:25:33 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:14.815 19:25:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:14.815 19:25:33 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:14.815 | .driver_specific 00:27:14.815 | .nvme_error 00:27:14.815 | .status_code 00:27:14.815 | .command_transient_transport_error' 00:27:15.074 19:25:33 -- host/digest.sh@71 -- # (( 417 > 0 )) 00:27:15.074 19:25:33 -- host/digest.sh@73 -- # killprocess 3557348 00:27:15.074 19:25:33 -- common/autotest_common.sh@936 -- # '[' -z 3557348 ']' 00:27:15.074 19:25:33 -- common/autotest_common.sh@940 -- # kill -0 3557348 00:27:15.074 19:25:33 -- common/autotest_common.sh@941 -- # uname 00:27:15.074 19:25:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.074 19:25:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3557348 00:27:15.074 19:25:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:15.074 19:25:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:15.074 19:25:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3557348' 00:27:15.074 killing process with pid 3557348 00:27:15.074 19:25:33 -- common/autotest_common.sh@955 -- # kill 3557348 00:27:15.074 Received shutdown signal, test time was about 2.000000 seconds 00:27:15.074 00:27:15.074 Latency(us) 00:27:15.074 [2024-11-18T18:25:33.679Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:15.074 [2024-11-18T18:25:33.679Z] =================================================================================================================== 00:27:15.074 [2024-11-18T18:25:33.679Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:15.074 19:25:33 -- common/autotest_common.sh@960 -- # wait 3557348 00:27:15.332 19:25:33 -- host/digest.sh@115 -- # killprocess 3555790 00:27:15.332 19:25:33 -- common/autotest_common.sh@936 -- # '[' -z 3555790 ']' 00:27:15.332 19:25:33 -- common/autotest_common.sh@940 -- # kill -0 3555790 00:27:15.332 19:25:33 -- common/autotest_common.sh@941 -- # uname 00:27:15.332 19:25:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.332 19:25:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3555790 00:27:15.332 19:25:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:15.332 19:25:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:15.332 19:25:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3555790' 00:27:15.332 killing process with pid 3555790 00:27:15.332 19:25:33 -- common/autotest_common.sh@955 -- # kill 3555790 00:27:15.332 19:25:33 -- common/autotest_common.sh@960 -- # wait 3555790 00:27:15.590 00:27:15.590 real 0m18.197s 00:27:15.590 user 0m37.062s 00:27:15.590 sys 0m4.484s 00:27:15.590 19:25:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:15.590 19:25:34 -- common/autotest_common.sh@10 -- # set +x 00:27:15.590 ************************************ 00:27:15.590 END TEST nvmf_digest_error 00:27:15.590 ************************************ 00:27:15.590 19:25:34 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:15.590 19:25:34 -- host/digest.sh@139 -- # nvmftestfini 00:27:15.590 19:25:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:15.590 19:25:34 -- nvmf/common.sh@116 -- # sync 00:27:15.590 19:25:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:15.591 19:25:34 -- nvmf/common.sh@119 -- # set +e 00:27:15.591 19:25:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:15.591 19:25:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:15.591 rmmod nvme_tcp 00:27:15.591 rmmod nvme_fabrics 00:27:15.591 rmmod nvme_keyring 00:27:15.591 19:25:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:15.591 19:25:34 -- nvmf/common.sh@123 -- # set -e 00:27:15.591 19:25:34 -- nvmf/common.sh@124 -- # return 0 00:27:15.591 19:25:34 -- nvmf/common.sh@477 -- # '[' -n 3555790 ']' 00:27:15.591 19:25:34 -- nvmf/common.sh@478 -- # killprocess 3555790 00:27:15.591 19:25:34 -- common/autotest_common.sh@936 -- # '[' -z 3555790 ']' 00:27:15.591 19:25:34 -- common/autotest_common.sh@940 -- # kill -0 3555790 00:27:15.591 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3555790) - No such process 00:27:15.591 19:25:34 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3555790 is not found' 00:27:15.591 Process with pid 3555790 is not found 00:27:15.591 19:25:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:15.591 19:25:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:15.591 19:25:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:15.591 19:25:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:15.591 19:25:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:15.591 19:25:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:15.591 19:25:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:15.591 19:25:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:18.121 19:25:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:18.121 00:27:18.121 real 0m38.345s 00:27:18.121 user 1m9.169s 00:27:18.121 sys 0m10.394s 00:27:18.121 19:25:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:18.121 19:25:36 -- common/autotest_common.sh@10 -- # set +x 00:27:18.121 ************************************ 00:27:18.121 END TEST nvmf_digest 00:27:18.121 ************************************ 00:27:18.121 19:25:36 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:18.121 19:25:36 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:18.121 19:25:36 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:18.121 19:25:36 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:18.121 19:25:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:18.121 19:25:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:18.121 19:25:36 -- common/autotest_common.sh@10 -- # set +x 00:27:18.121 ************************************ 00:27:18.121 START TEST nvmf_bdevperf 00:27:18.121 ************************************ 00:27:18.121 19:25:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:18.121 * Looking for test storage... 00:27:18.121 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:18.121 19:25:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:18.121 19:25:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:18.121 19:25:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:18.121 19:25:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:18.121 19:25:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:18.121 19:25:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:18.121 19:25:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:18.121 19:25:36 -- scripts/common.sh@335 -- # IFS=.-: 00:27:18.121 19:25:36 -- scripts/common.sh@335 -- # read -ra ver1 00:27:18.121 19:25:36 -- scripts/common.sh@336 -- # IFS=.-: 00:27:18.121 19:25:36 -- scripts/common.sh@336 -- # read -ra ver2 00:27:18.121 19:25:36 -- scripts/common.sh@337 -- # local 'op=<' 00:27:18.121 19:25:36 -- scripts/common.sh@339 -- # ver1_l=2 00:27:18.121 19:25:36 -- scripts/common.sh@340 -- # ver2_l=1 00:27:18.121 19:25:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:18.121 19:25:36 -- scripts/common.sh@343 -- # case "$op" in 00:27:18.121 19:25:36 -- scripts/common.sh@344 -- # : 1 00:27:18.121 19:25:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:18.121 19:25:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:18.122 19:25:36 -- scripts/common.sh@364 -- # decimal 1 00:27:18.122 19:25:36 -- scripts/common.sh@352 -- # local d=1 00:27:18.122 19:25:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:18.122 19:25:36 -- scripts/common.sh@354 -- # echo 1 00:27:18.122 19:25:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:18.122 19:25:36 -- scripts/common.sh@365 -- # decimal 2 00:27:18.122 19:25:36 -- scripts/common.sh@352 -- # local d=2 00:27:18.122 19:25:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:18.122 19:25:36 -- scripts/common.sh@354 -- # echo 2 00:27:18.122 19:25:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:18.122 19:25:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:18.122 19:25:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:18.122 19:25:36 -- scripts/common.sh@367 -- # return 0 00:27:18.122 19:25:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:18.122 19:25:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:18.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:18.122 --rc genhtml_branch_coverage=1 00:27:18.122 --rc genhtml_function_coverage=1 00:27:18.122 --rc genhtml_legend=1 00:27:18.122 --rc geninfo_all_blocks=1 00:27:18.122 --rc geninfo_unexecuted_blocks=1 00:27:18.122 00:27:18.122 ' 00:27:18.122 19:25:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:18.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:18.122 --rc genhtml_branch_coverage=1 00:27:18.122 --rc genhtml_function_coverage=1 00:27:18.122 --rc genhtml_legend=1 00:27:18.122 --rc geninfo_all_blocks=1 00:27:18.122 --rc geninfo_unexecuted_blocks=1 00:27:18.122 00:27:18.122 ' 00:27:18.122 19:25:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:18.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:18.122 --rc genhtml_branch_coverage=1 00:27:18.122 --rc genhtml_function_coverage=1 00:27:18.122 --rc genhtml_legend=1 00:27:18.122 --rc geninfo_all_blocks=1 00:27:18.122 --rc geninfo_unexecuted_blocks=1 00:27:18.122 00:27:18.122 ' 00:27:18.122 19:25:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:18.122 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:18.122 --rc genhtml_branch_coverage=1 00:27:18.122 --rc genhtml_function_coverage=1 00:27:18.122 --rc genhtml_legend=1 00:27:18.122 --rc geninfo_all_blocks=1 00:27:18.122 --rc geninfo_unexecuted_blocks=1 00:27:18.122 00:27:18.122 ' 00:27:18.122 19:25:36 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:18.122 19:25:36 -- nvmf/common.sh@7 -- # uname -s 00:27:18.122 19:25:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:18.122 19:25:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:18.122 19:25:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:18.122 19:25:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:18.122 19:25:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:18.122 19:25:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:18.122 19:25:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:18.122 19:25:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:18.122 19:25:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:18.122 19:25:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:18.122 19:25:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:18.122 19:25:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:18.122 19:25:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:18.122 19:25:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:18.122 19:25:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:18.122 19:25:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:18.122 19:25:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:18.122 19:25:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:18.122 19:25:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:18.122 19:25:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.122 19:25:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.122 19:25:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.122 19:25:36 -- paths/export.sh@5 -- # export PATH 00:27:18.122 19:25:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.122 19:25:36 -- nvmf/common.sh@46 -- # : 0 00:27:18.122 19:25:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:18.122 19:25:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:18.122 19:25:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:18.122 19:25:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:18.122 19:25:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:18.122 19:25:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:18.122 19:25:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:18.122 19:25:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:18.122 19:25:36 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:18.122 19:25:36 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:18.122 19:25:36 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:18.122 19:25:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:18.122 19:25:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:18.122 19:25:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:18.122 19:25:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:18.122 19:25:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:18.122 19:25:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:18.122 19:25:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:18.122 19:25:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:18.122 19:25:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:18.122 19:25:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:18.122 19:25:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:18.122 19:25:36 -- common/autotest_common.sh@10 -- # set +x 00:27:20.024 19:25:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:20.024 19:25:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:20.024 19:25:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:20.024 19:25:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:20.024 19:25:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:20.024 19:25:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:20.024 19:25:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:20.024 19:25:38 -- nvmf/common.sh@294 -- # net_devs=() 00:27:20.024 19:25:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:20.024 19:25:38 -- nvmf/common.sh@295 -- # e810=() 00:27:20.024 19:25:38 -- nvmf/common.sh@295 -- # local -ga e810 00:27:20.024 19:25:38 -- nvmf/common.sh@296 -- # x722=() 00:27:20.024 19:25:38 -- nvmf/common.sh@296 -- # local -ga x722 00:27:20.024 19:25:38 -- nvmf/common.sh@297 -- # mlx=() 00:27:20.024 19:25:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:20.024 19:25:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:20.024 19:25:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:20.024 19:25:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:20.024 19:25:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:20.024 19:25:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:20.024 19:25:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:20.024 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:20.024 19:25:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:20.024 19:25:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:20.024 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:20.024 19:25:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:20.024 19:25:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:20.024 19:25:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:20.024 19:25:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:20.024 19:25:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:20.024 19:25:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:20.025 19:25:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:20.025 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:20.025 19:25:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:20.025 19:25:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:20.025 19:25:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:20.025 19:25:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:20.025 19:25:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:20.025 19:25:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:20.025 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:20.025 19:25:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:20.025 19:25:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:20.025 19:25:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:20.025 19:25:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:20.025 19:25:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:20.025 19:25:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:20.025 19:25:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:20.025 19:25:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:20.025 19:25:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:20.025 19:25:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:20.025 19:25:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:20.025 19:25:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:20.025 19:25:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:20.025 19:25:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:20.025 19:25:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:20.025 19:25:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:20.025 19:25:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:20.025 19:25:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:20.025 19:25:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:20.025 19:25:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:20.025 19:25:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:20.025 19:25:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:20.025 19:25:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:20.025 19:25:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:20.025 19:25:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:20.025 19:25:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:20.025 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:20.025 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:27:20.025 00:27:20.025 --- 10.0.0.2 ping statistics --- 00:27:20.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:20.025 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:27:20.025 19:25:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:20.025 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:20.025 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:27:20.025 00:27:20.025 --- 10.0.0.1 ping statistics --- 00:27:20.025 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:20.025 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:27:20.025 19:25:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:20.025 19:25:38 -- nvmf/common.sh@410 -- # return 0 00:27:20.025 19:25:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:20.025 19:25:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:20.025 19:25:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:20.025 19:25:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:20.025 19:25:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:20.025 19:25:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:20.025 19:25:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:20.025 19:25:38 -- host/bdevperf.sh@25 -- # tgt_init 00:27:20.025 19:25:38 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:20.025 19:25:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:20.025 19:25:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:20.025 19:25:38 -- common/autotest_common.sh@10 -- # set +x 00:27:20.025 19:25:38 -- nvmf/common.sh@469 -- # nvmfpid=3559971 00:27:20.025 19:25:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:20.025 19:25:38 -- nvmf/common.sh@470 -- # waitforlisten 3559971 00:27:20.025 19:25:38 -- common/autotest_common.sh@829 -- # '[' -z 3559971 ']' 00:27:20.025 19:25:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:20.025 19:25:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:20.025 19:25:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:20.025 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:20.025 19:25:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:20.025 19:25:38 -- common/autotest_common.sh@10 -- # set +x 00:27:20.025 [2024-11-18 19:25:38.499605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:20.025 [2024-11-18 19:25:38.499699] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:20.025 EAL: No free 2048 kB hugepages reported on node 1 00:27:20.025 [2024-11-18 19:25:38.569127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:20.283 [2024-11-18 19:25:38.684711] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:20.283 [2024-11-18 19:25:38.684875] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:20.284 [2024-11-18 19:25:38.684893] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:20.284 [2024-11-18 19:25:38.684905] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:20.284 [2024-11-18 19:25:38.684996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:20.284 [2024-11-18 19:25:38.688629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:20.284 [2024-11-18 19:25:38.688642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:21.217 19:25:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:21.217 19:25:39 -- common/autotest_common.sh@862 -- # return 0 00:27:21.217 19:25:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:21.217 19:25:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:21.217 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.217 19:25:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:21.217 19:25:39 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:21.217 19:25:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.217 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.217 [2024-11-18 19:25:39.568823] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:21.217 19:25:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.217 19:25:39 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:21.217 19:25:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.217 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.217 Malloc0 00:27:21.217 19:25:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.217 19:25:39 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:21.217 19:25:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.217 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.217 19:25:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.217 19:25:39 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:21.217 19:25:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.217 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.217 19:25:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.217 19:25:39 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:21.217 19:25:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:21.217 19:25:39 -- common/autotest_common.sh@10 -- # set +x 00:27:21.217 [2024-11-18 19:25:39.629160] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:21.217 19:25:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:21.217 19:25:39 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:21.217 19:25:39 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:21.217 19:25:39 -- nvmf/common.sh@520 -- # config=() 00:27:21.217 19:25:39 -- nvmf/common.sh@520 -- # local subsystem config 00:27:21.217 19:25:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:21.217 19:25:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:21.217 { 00:27:21.217 "params": { 00:27:21.217 "name": "Nvme$subsystem", 00:27:21.217 "trtype": "$TEST_TRANSPORT", 00:27:21.217 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:21.217 "adrfam": "ipv4", 00:27:21.217 "trsvcid": "$NVMF_PORT", 00:27:21.217 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:21.217 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:21.217 "hdgst": ${hdgst:-false}, 00:27:21.217 "ddgst": ${ddgst:-false} 00:27:21.217 }, 00:27:21.217 "method": "bdev_nvme_attach_controller" 00:27:21.217 } 00:27:21.217 EOF 00:27:21.217 )") 00:27:21.217 19:25:39 -- nvmf/common.sh@542 -- # cat 00:27:21.217 19:25:39 -- nvmf/common.sh@544 -- # jq . 00:27:21.217 19:25:39 -- nvmf/common.sh@545 -- # IFS=, 00:27:21.217 19:25:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:21.217 "params": { 00:27:21.217 "name": "Nvme1", 00:27:21.217 "trtype": "tcp", 00:27:21.217 "traddr": "10.0.0.2", 00:27:21.217 "adrfam": "ipv4", 00:27:21.217 "trsvcid": "4420", 00:27:21.217 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:21.217 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:21.217 "hdgst": false, 00:27:21.217 "ddgst": false 00:27:21.217 }, 00:27:21.217 "method": "bdev_nvme_attach_controller" 00:27:21.217 }' 00:27:21.217 [2024-11-18 19:25:39.672751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.217 [2024-11-18 19:25:39.672830] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3560145 ] 00:27:21.217 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.217 [2024-11-18 19:25:39.733157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.476 [2024-11-18 19:25:39.844098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:21.734 Running I/O for 1 seconds... 00:27:22.667 00:27:22.667 Latency(us) 00:27:22.667 [2024-11-18T18:25:41.272Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.667 [2024-11-18T18:25:41.272Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:22.667 Verification LBA range: start 0x0 length 0x4000 00:27:22.667 Nvme1n1 : 1.01 12866.61 50.26 0.00 0.00 9900.73 1304.65 14660.65 00:27:22.667 [2024-11-18T18:25:41.272Z] =================================================================================================================== 00:27:22.667 [2024-11-18T18:25:41.272Z] Total : 12866.61 50.26 0.00 0.00 9900.73 1304.65 14660.65 00:27:22.925 19:25:41 -- host/bdevperf.sh@30 -- # bdevperfpid=3560293 00:27:22.925 19:25:41 -- host/bdevperf.sh@32 -- # sleep 3 00:27:22.925 19:25:41 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:22.925 19:25:41 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:22.925 19:25:41 -- nvmf/common.sh@520 -- # config=() 00:27:22.925 19:25:41 -- nvmf/common.sh@520 -- # local subsystem config 00:27:22.925 19:25:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:22.925 19:25:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:22.925 { 00:27:22.925 "params": { 00:27:22.925 "name": "Nvme$subsystem", 00:27:22.925 "trtype": "$TEST_TRANSPORT", 00:27:22.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:22.925 "adrfam": "ipv4", 00:27:22.925 "trsvcid": "$NVMF_PORT", 00:27:22.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:22.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:22.925 "hdgst": ${hdgst:-false}, 00:27:22.925 "ddgst": ${ddgst:-false} 00:27:22.925 }, 00:27:22.925 "method": "bdev_nvme_attach_controller" 00:27:22.925 } 00:27:22.925 EOF 00:27:22.925 )") 00:27:22.925 19:25:41 -- nvmf/common.sh@542 -- # cat 00:27:22.925 19:25:41 -- nvmf/common.sh@544 -- # jq . 00:27:22.925 19:25:41 -- nvmf/common.sh@545 -- # IFS=, 00:27:22.925 19:25:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:22.925 "params": { 00:27:22.925 "name": "Nvme1", 00:27:22.925 "trtype": "tcp", 00:27:22.925 "traddr": "10.0.0.2", 00:27:22.925 "adrfam": "ipv4", 00:27:22.925 "trsvcid": "4420", 00:27:22.925 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:22.925 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:22.925 "hdgst": false, 00:27:22.925 "ddgst": false 00:27:22.925 }, 00:27:22.925 "method": "bdev_nvme_attach_controller" 00:27:22.925 }' 00:27:22.925 [2024-11-18 19:25:41.490198] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:22.925 [2024-11-18 19:25:41.490277] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3560293 ] 00:27:22.925 EAL: No free 2048 kB hugepages reported on node 1 00:27:23.184 [2024-11-18 19:25:41.549127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:23.184 [2024-11-18 19:25:41.657315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:23.442 Running I/O for 15 seconds... 00:27:25.976 19:25:44 -- host/bdevperf.sh@33 -- # kill -9 3559971 00:27:25.976 19:25:44 -- host/bdevperf.sh@35 -- # sleep 3 00:27:25.976 [2024-11-18 19:25:44.460924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:121352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.460979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:121384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:121424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:121432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:121440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:121448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:121456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:121464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:120832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:120848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:120856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:120864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:120904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:120928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:120944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:120976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:121472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:121480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:121488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:121496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:121504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:121512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:121520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:121528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.461829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:121536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:121544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:121552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:121560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.976 [2024-11-18 19:25:44.461970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.461987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:121568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.462003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.462020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:121576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.462035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.462056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:121584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.976 [2024-11-18 19:25:44.462073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.976 [2024-11-18 19:25:44.462091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:121592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:121600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:121608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:121616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:121624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:121632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:121640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:121648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:121656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:121664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:121672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:121680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:121688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:121696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:121704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:121712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:121720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:121728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:121736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:121744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:121752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:121760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:121768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.462840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:121008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:121024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:121040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.462979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:121056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.462994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:121064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:121072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:121080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:121088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:121776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:121784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.463186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:121792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.463219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:121800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.463251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:121808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:121816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:121824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:121832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.977 [2024-11-18 19:25:44.463388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.977 [2024-11-18 19:25:44.463405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:121840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.977 [2024-11-18 19:25:44.463420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:121848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.463453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:121856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:121112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:121120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:121136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:121160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:121184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:121192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:121200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:121208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:121864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.463810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:121872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:121880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:121888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.463917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:121896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.463951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.463968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:121904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.463984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:121912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.464016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:121920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:121928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.464083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:121936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:121240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:121256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:121272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:121280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:121304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:121320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:121328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:121336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:121944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:121952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:121960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:121968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.464517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:121976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.464549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:121984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:121992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.978 [2024-11-18 19:25:44.464623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:122000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:122008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:122016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:122024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.978 [2024-11-18 19:25:44.464760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.978 [2024-11-18 19:25:44.464776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:122032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.979 [2024-11-18 19:25:44.464789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.464804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:122040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.979 [2024-11-18 19:25:44.464818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.464833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:122048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.464847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.464863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:122056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.464877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.464911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:122064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.464926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.464943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:122072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.464959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.464976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:122080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.979 [2024-11-18 19:25:44.464992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:122088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.979 [2024-11-18 19:25:44.465024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:122096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:122104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:121344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:121360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:121368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:121376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:121392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:121400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:121408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:25.979 [2024-11-18 19:25:44.465320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x187a740 is same with the state(5) to be set 00:27:25.979 [2024-11-18 19:25:44.465355] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:25.979 [2024-11-18 19:25:44.465367] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:25.979 [2024-11-18 19:25:44.465380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:121416 len:8 PRP1 0x0 PRP2 0x0 00:27:25.979 [2024-11-18 19:25:44.465394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:25.979 [2024-11-18 19:25:44.465463] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x187a740 was disconnected and freed. reset controller. 00:27:25.979 [2024-11-18 19:25:44.467746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.979 [2024-11-18 19:25:44.467813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.979 [2024-11-18 19:25:44.468462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.468590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.468634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.979 [2024-11-18 19:25:44.468673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.979 [2024-11-18 19:25:44.468841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.979 [2024-11-18 19:25:44.469007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.979 [2024-11-18 19:25:44.469030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.979 [2024-11-18 19:25:44.469049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.979 [2024-11-18 19:25:44.471453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.979 [2024-11-18 19:25:44.480630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.979 [2024-11-18 19:25:44.480969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.481140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.481169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.979 [2024-11-18 19:25:44.481187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.979 [2024-11-18 19:25:44.481317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.979 [2024-11-18 19:25:44.481487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.979 [2024-11-18 19:25:44.481510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.979 [2024-11-18 19:25:44.481526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.979 [2024-11-18 19:25:44.483906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.979 [2024-11-18 19:25:44.493315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.979 [2024-11-18 19:25:44.493636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.493741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.493770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.979 [2024-11-18 19:25:44.493788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.979 [2024-11-18 19:25:44.493990] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.979 [2024-11-18 19:25:44.494177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.979 [2024-11-18 19:25:44.494200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.979 [2024-11-18 19:25:44.494217] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.979 [2024-11-18 19:25:44.496705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.979 [2024-11-18 19:25:44.506144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.979 [2024-11-18 19:25:44.506456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.506710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.506743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.979 [2024-11-18 19:25:44.506760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.979 [2024-11-18 19:25:44.506931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.979 [2024-11-18 19:25:44.507101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.979 [2024-11-18 19:25:44.507124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.979 [2024-11-18 19:25:44.507140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.979 [2024-11-18 19:25:44.509527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.979 [2024-11-18 19:25:44.518625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.979 [2024-11-18 19:25:44.518934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.519143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.979 [2024-11-18 19:25:44.519169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.979 [2024-11-18 19:25:44.519184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.979 [2024-11-18 19:25:44.519333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.979 [2024-11-18 19:25:44.519497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.980 [2024-11-18 19:25:44.519520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.980 [2024-11-18 19:25:44.519536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.980 [2024-11-18 19:25:44.521938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.980 [2024-11-18 19:25:44.531176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.980 [2024-11-18 19:25:44.531486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.531651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.531678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.980 [2024-11-18 19:25:44.531694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.980 [2024-11-18 19:25:44.531828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.980 [2024-11-18 19:25:44.531992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.980 [2024-11-18 19:25:44.532016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.980 [2024-11-18 19:25:44.532032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.980 [2024-11-18 19:25:44.534509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.980 [2024-11-18 19:25:44.543837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.980 [2024-11-18 19:25:44.544149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.544274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.544302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.980 [2024-11-18 19:25:44.544326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.980 [2024-11-18 19:25:44.544510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.980 [2024-11-18 19:25:44.544656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.980 [2024-11-18 19:25:44.544681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.980 [2024-11-18 19:25:44.544697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.980 [2024-11-18 19:25:44.547083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.980 [2024-11-18 19:25:44.556325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.980 [2024-11-18 19:25:44.556633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.556789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.556840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.980 [2024-11-18 19:25:44.556858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.980 [2024-11-18 19:25:44.556987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.980 [2024-11-18 19:25:44.557138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.980 [2024-11-18 19:25:44.557162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.980 [2024-11-18 19:25:44.557177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.980 [2024-11-18 19:25:44.559387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.980 [2024-11-18 19:25:44.568924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.980 [2024-11-18 19:25:44.569208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.569376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.980 [2024-11-18 19:25:44.569429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:25.980 [2024-11-18 19:25:44.569446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:25.980 [2024-11-18 19:25:44.569594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:25.980 [2024-11-18 19:25:44.569792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.980 [2024-11-18 19:25:44.569816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.980 [2024-11-18 19:25:44.569832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.980 [2024-11-18 19:25:44.572041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.581579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.581884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.582054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.582114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.582132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.582321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.582455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.582478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.582494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.584894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.594335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.594669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.594802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.594830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.594848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.595013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.595165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.595189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.595205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.597628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.606823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.607138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.607309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.607337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.607355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.607502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.607665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.607690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.607705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.609985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.619212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.619523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.619731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.619786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.619804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.619970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.620182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.620206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.620221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.622194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.631735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.632044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.632200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.632226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.632241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.632399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.632550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.632574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.632590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.634988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.644315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.644615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.644751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.644780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.644798] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.644928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.645133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.645157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.645173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.647716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.656764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.657097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.657268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.657293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.241 [2024-11-18 19:25:44.657309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.241 [2024-11-18 19:25:44.657474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.241 [2024-11-18 19:25:44.657675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.241 [2024-11-18 19:25:44.657706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.241 [2024-11-18 19:25:44.657722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.241 [2024-11-18 19:25:44.659912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.241 [2024-11-18 19:25:44.669639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.241 [2024-11-18 19:25:44.669951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.670135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.241 [2024-11-18 19:25:44.670163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.670181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.670365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.670552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.670576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.670591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.672955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.682293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.682549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.682670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.682701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.682719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.682903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.683109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.683133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.683148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.685249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.695273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.695577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.695714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.695744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.695762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.695909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.696060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.696084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.696106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.698341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.707723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.708035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.708192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.708221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.708239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.708387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.708556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.708579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.708595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.711157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.720377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.720648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.720737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.720763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.720780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.720944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.721096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.721120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.721136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.723356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.733193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.733467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.733556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.733582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.733598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.733756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.733908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.733933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.733948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.736433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.745636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.745898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.746017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.746046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.746063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.746211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.746398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.746421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.746437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.748818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.758073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.758395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.758525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.758552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.758568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.758738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.758908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.758932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.758948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.761138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.770409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.770757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.770861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.770890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.770908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.771038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.242 [2024-11-18 19:25:44.771261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.242 [2024-11-18 19:25:44.771285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.242 [2024-11-18 19:25:44.771301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.242 [2024-11-18 19:25:44.773792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.242 [2024-11-18 19:25:44.783048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.242 [2024-11-18 19:25:44.783364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.783502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.242 [2024-11-18 19:25:44.783530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.242 [2024-11-18 19:25:44.783547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.242 [2024-11-18 19:25:44.783707] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.243 [2024-11-18 19:25:44.783859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.243 [2024-11-18 19:25:44.783882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.243 [2024-11-18 19:25:44.783898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.243 [2024-11-18 19:25:44.786197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.243 [2024-11-18 19:25:44.795691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.243 [2024-11-18 19:25:44.795980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.796105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.796133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.243 [2024-11-18 19:25:44.796150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.243 [2024-11-18 19:25:44.796280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.243 [2024-11-18 19:25:44.796449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.243 [2024-11-18 19:25:44.796473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.243 [2024-11-18 19:25:44.796488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.243 [2024-11-18 19:25:44.798838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.243 [2024-11-18 19:25:44.808193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.243 [2024-11-18 19:25:44.808452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.808581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.808618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.243 [2024-11-18 19:25:44.808638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.243 [2024-11-18 19:25:44.808840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.243 [2024-11-18 19:25:44.808974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.243 [2024-11-18 19:25:44.808998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.243 [2024-11-18 19:25:44.809013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.243 [2024-11-18 19:25:44.811382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.243 [2024-11-18 19:25:44.820897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.243 [2024-11-18 19:25:44.821202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.821360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.821390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.243 [2024-11-18 19:25:44.821407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.243 [2024-11-18 19:25:44.821573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.243 [2024-11-18 19:25:44.821735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.243 [2024-11-18 19:25:44.821760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.243 [2024-11-18 19:25:44.821776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.243 [2024-11-18 19:25:44.824092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.243 [2024-11-18 19:25:44.833519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.243 [2024-11-18 19:25:44.833768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.833873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.243 [2024-11-18 19:25:44.833902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.243 [2024-11-18 19:25:44.833919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.243 [2024-11-18 19:25:44.834084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.243 [2024-11-18 19:25:44.834218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.243 [2024-11-18 19:25:44.834241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.243 [2024-11-18 19:25:44.834256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.243 [2024-11-18 19:25:44.836485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.503 [2024-11-18 19:25:44.846192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.503 [2024-11-18 19:25:44.846492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.846592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.846631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.503 [2024-11-18 19:25:44.846650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.503 [2024-11-18 19:25:44.846834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.503 [2024-11-18 19:25:44.847003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.503 [2024-11-18 19:25:44.847027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.503 [2024-11-18 19:25:44.847042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.503 [2024-11-18 19:25:44.849395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.503 [2024-11-18 19:25:44.858578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.503 [2024-11-18 19:25:44.858860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.858990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.859024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.503 [2024-11-18 19:25:44.859042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.503 [2024-11-18 19:25:44.859226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.503 [2024-11-18 19:25:44.859450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.503 [2024-11-18 19:25:44.859474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.503 [2024-11-18 19:25:44.859489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.503 [2024-11-18 19:25:44.861977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.503 [2024-11-18 19:25:44.871151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.503 [2024-11-18 19:25:44.871443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.871623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.871650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.503 [2024-11-18 19:25:44.871665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.503 [2024-11-18 19:25:44.871812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.503 [2024-11-18 19:25:44.872019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.503 [2024-11-18 19:25:44.872043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.503 [2024-11-18 19:25:44.872058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.503 [2024-11-18 19:25:44.874392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.503 [2024-11-18 19:25:44.883732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.503 [2024-11-18 19:25:44.884022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.884153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.884181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.503 [2024-11-18 19:25:44.884199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.503 [2024-11-18 19:25:44.884365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.503 [2024-11-18 19:25:44.884535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.503 [2024-11-18 19:25:44.884558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.503 [2024-11-18 19:25:44.884573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.503 [2024-11-18 19:25:44.886901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.503 [2024-11-18 19:25:44.896350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.503 [2024-11-18 19:25:44.896700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.896837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.503 [2024-11-18 19:25:44.896866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.503 [2024-11-18 19:25:44.896890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.503 [2024-11-18 19:25:44.897038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.503 [2024-11-18 19:25:44.897226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.503 [2024-11-18 19:25:44.897249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.503 [2024-11-18 19:25:44.897265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.503 [2024-11-18 19:25:44.899666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.503 [2024-11-18 19:25:44.908850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.909131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.909238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.909268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.909286] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.909452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.909604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.909639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.909654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.912007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.921587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.921892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.922029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.922058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.922075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.922223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.922392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.922416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.922431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.924758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.933852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.934229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.934395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.934423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.934441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.934659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.934812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.934835] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.934850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.937038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.946319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.946613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.946816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.946868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.946885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.947033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.947238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.947261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.947277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.949593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.959078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.959379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.959474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.959503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.959521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.959680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.959868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.959892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.959908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.962043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.971744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.972058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.972188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.972230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.972246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.972410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.972595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.972629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.972646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.975008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.984223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.984493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.984621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.984652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.984670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.984799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.984932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.984956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.984972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.987254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:44.996769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:44.997095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.997226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:44.997255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:44.997273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:44.997438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:44.997623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:44.997657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:44.997674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:44.999921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:45.009301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:45.009627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:45.009766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:45.009795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.504 [2024-11-18 19:25:45.009812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.504 [2024-11-18 19:25:45.009959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.504 [2024-11-18 19:25:45.010129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.504 [2024-11-18 19:25:45.010158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.504 [2024-11-18 19:25:45.010174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.504 [2024-11-18 19:25:45.012404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.504 [2024-11-18 19:25:45.021973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.504 [2024-11-18 19:25:45.022262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:45.022377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.504 [2024-11-18 19:25:45.022406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.022424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.022571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.022733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.022758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.022774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.025128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.505 [2024-11-18 19:25:45.034673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.505 [2024-11-18 19:25:45.035022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.035175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.035204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.035221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.035350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.035520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.035543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.035559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.037921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.505 [2024-11-18 19:25:45.047162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.505 [2024-11-18 19:25:45.047498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.047631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.047661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.047679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.047862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.047996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.048019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.048041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.050430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.505 [2024-11-18 19:25:45.059593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.505 [2024-11-18 19:25:45.059891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.060024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.060077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.060094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.060259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.060464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.060487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.060503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.062850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.505 [2024-11-18 19:25:45.072223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.505 [2024-11-18 19:25:45.072552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.072679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.072709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.072727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.072946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.073115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.073139] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.073155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.075491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.505 [2024-11-18 19:25:45.084758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.505 [2024-11-18 19:25:45.084998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.085157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.085187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.085205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.085389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.085540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.085565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.085581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.087815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.505 [2024-11-18 19:25:45.097336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.505 [2024-11-18 19:25:45.097690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.097818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.505 [2024-11-18 19:25:45.097844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.505 [2024-11-18 19:25:45.097859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.505 [2024-11-18 19:25:45.097992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.505 [2024-11-18 19:25:45.098144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.505 [2024-11-18 19:25:45.098167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.505 [2024-11-18 19:25:45.098183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.505 [2024-11-18 19:25:45.100478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.765 [2024-11-18 19:25:45.110081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.765 [2024-11-18 19:25:45.110437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.110599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.110653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.765 [2024-11-18 19:25:45.110670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.765 [2024-11-18 19:25:45.110818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.765 [2024-11-18 19:25:45.110954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.765 [2024-11-18 19:25:45.110975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.765 [2024-11-18 19:25:45.110989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.765 [2024-11-18 19:25:45.113418] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.765 [2024-11-18 19:25:45.122485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.765 [2024-11-18 19:25:45.122812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.122921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.122950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.765 [2024-11-18 19:25:45.122968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.765 [2024-11-18 19:25:45.123151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.765 [2024-11-18 19:25:45.123285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.765 [2024-11-18 19:25:45.123308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.765 [2024-11-18 19:25:45.123324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.765 [2024-11-18 19:25:45.125553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.765 [2024-11-18 19:25:45.134964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.765 [2024-11-18 19:25:45.135263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.135402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.135431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.765 [2024-11-18 19:25:45.135448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.765 [2024-11-18 19:25:45.135622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.765 [2024-11-18 19:25:45.135793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.765 [2024-11-18 19:25:45.135817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.765 [2024-11-18 19:25:45.135833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.765 [2024-11-18 19:25:45.138275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.765 [2024-11-18 19:25:45.147546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.765 [2024-11-18 19:25:45.147939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.148073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.148102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.765 [2024-11-18 19:25:45.148120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.765 [2024-11-18 19:25:45.148286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.765 [2024-11-18 19:25:45.148491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.765 [2024-11-18 19:25:45.148515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.765 [2024-11-18 19:25:45.148531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.765 [2024-11-18 19:25:45.150942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.765 [2024-11-18 19:25:45.160082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.765 [2024-11-18 19:25:45.160407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.160495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.160523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.765 [2024-11-18 19:25:45.160542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.765 [2024-11-18 19:25:45.160789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.765 [2024-11-18 19:25:45.160983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.765 [2024-11-18 19:25:45.161003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.765 [2024-11-18 19:25:45.161016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.765 [2024-11-18 19:25:45.163461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.765 [2024-11-18 19:25:45.172886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.765 [2024-11-18 19:25:45.173266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.173440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.765 [2024-11-18 19:25:45.173466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.173498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.173653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.173758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.173779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.173793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.176303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.185592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.185934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.186058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.186087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.186104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.186324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.186511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.186535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.186551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.188873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.198345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.198675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.198797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.198822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.198838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.199016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.199240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.199263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.199279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.201711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.210949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.211277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.211435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.211469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.211488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.211689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.211913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.211937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.211954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.214280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.223689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.223935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.224070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.224100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.224118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.224284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.224418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.224441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.224457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.226954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.236333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.236699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.236802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.236829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.236845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.236986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.237174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.237197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.237213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.239537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.248900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.249229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.249352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.249381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.249404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.249535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.249704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.249725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.249738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.252109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.261312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.261661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.261785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.261813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.261829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.262010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.262247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.766 [2024-11-18 19:25:45.262267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.766 [2024-11-18 19:25:45.262281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.766 [2024-11-18 19:25:45.264570] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.766 [2024-11-18 19:25:45.274006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.766 [2024-11-18 19:25:45.274361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.274526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.766 [2024-11-18 19:25:45.274555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.766 [2024-11-18 19:25:45.274573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.766 [2024-11-18 19:25:45.274755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.766 [2024-11-18 19:25:45.274910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.274929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.274942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.277324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.286797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.287118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.287258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.287286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.287303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.287493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.287684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.287706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.287721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.290073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.299562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.299965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.300110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.300135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.300151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.300312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.300493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.300517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.300534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.302833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.312248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.312534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.312634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.312664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.312682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.312830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.313036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.313059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.313076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.315396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.324850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.325132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.325235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.325264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.325282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.325447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.325654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.325684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.325701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.327881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.337518] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.337882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.337988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.338016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.338034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.338217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.338369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.338393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.338410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.340891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.349871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.350181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.350311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.350339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.350357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.350541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.350684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.350710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.350726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.767 [2024-11-18 19:25:45.353040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.767 [2024-11-18 19:25:45.362271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.767 [2024-11-18 19:25:45.362561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.362688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.767 [2024-11-18 19:25:45.362715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:26.767 [2024-11-18 19:25:45.362730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:26.767 [2024-11-18 19:25:45.362875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:26.767 [2024-11-18 19:25:45.363082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.767 [2024-11-18 19:25:45.363112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.767 [2024-11-18 19:25:45.363129] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.768 [2024-11-18 19:25:45.365571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.027 [2024-11-18 19:25:45.374838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.027 [2024-11-18 19:25:45.375147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.027 [2024-11-18 19:25:45.375261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.027 [2024-11-18 19:25:45.375291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.027 [2024-11-18 19:25:45.375308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.027 [2024-11-18 19:25:45.375401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.027 [2024-11-18 19:25:45.375617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.027 [2024-11-18 19:25:45.375653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.027 [2024-11-18 19:25:45.375669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.027 [2024-11-18 19:25:45.377900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.387482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.387844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.387984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.388025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.388041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.388266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.388464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.388487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.388503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.390929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.399993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.400333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.400490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.400519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.400536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.400716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.400833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.400858] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.400890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.402977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.412483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.412812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.412962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.412988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.413004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.413169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.413298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.413322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.413337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.415528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.425146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.425444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.425599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.425638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.425657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.425805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.425974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.425998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.426013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.428531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.437797] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.438068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.438225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.438253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.438270] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.438454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.438605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.438640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.438656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.441070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.450320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.450625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.450786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.450815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.450832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.450998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.451131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.451154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.451170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.453528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.462815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.463125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.463260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.463295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.463330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.463513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.463711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.463736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.463752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.466089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.475574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.475882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.475979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.476005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.476020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.476174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.476308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.476333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.476349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.478698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.488168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.488447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.488619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.488650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.028 [2024-11-18 19:25:45.488670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.028 [2024-11-18 19:25:45.488836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.028 [2024-11-18 19:25:45.489007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.028 [2024-11-18 19:25:45.489030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.028 [2024-11-18 19:25:45.489046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.028 [2024-11-18 19:25:45.491203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.028 [2024-11-18 19:25:45.500928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.028 [2024-11-18 19:25:45.501194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.028 [2024-11-18 19:25:45.501366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.501392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.501407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.501601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.501794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.501818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.501833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.504259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.513624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.513957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.514077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.514106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.514124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.514272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.514440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.514464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.514479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.516686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.526250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.526560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.526709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.526736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.526752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.526853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.527034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.527058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.527073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.529395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.538801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.539104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.539263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.539291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.539308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.539456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.539621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.539650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.539667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.542035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.551155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.551471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.551630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.551659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.551677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.551861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.552067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.552090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.552107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.554371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.563868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.564157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.564325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.564356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.564372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.564502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.564695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.564720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.564736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.567071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.576472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.576825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.576974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.577016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.577034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.577235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.577439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.577463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.577479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.579849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.588860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.589169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.589295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.589324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.589341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.589506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.589652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.589676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.589692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.592029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.601272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.601621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.601848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.601874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.601895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.029 [2024-11-18 19:25:45.602010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.029 [2024-11-18 19:25:45.602196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.029 [2024-11-18 19:25:45.602219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.029 [2024-11-18 19:25:45.602235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.029 [2024-11-18 19:25:45.604466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.029 [2024-11-18 19:25:45.613892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.029 [2024-11-18 19:25:45.614194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.614364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.029 [2024-11-18 19:25:45.614390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.029 [2024-11-18 19:25:45.614405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.030 [2024-11-18 19:25:45.614600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.030 [2024-11-18 19:25:45.614747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.030 [2024-11-18 19:25:45.614771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.030 [2024-11-18 19:25:45.614787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.030 [2024-11-18 19:25:45.617144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.030 [2024-11-18 19:25:45.626498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.030 [2024-11-18 19:25:45.626813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.030 [2024-11-18 19:25:45.627022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.030 [2024-11-18 19:25:45.627049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.030 [2024-11-18 19:25:45.627065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.030 [2024-11-18 19:25:45.627306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.030 [2024-11-18 19:25:45.627440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.030 [2024-11-18 19:25:45.627464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.030 [2024-11-18 19:25:45.627479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.030 [2024-11-18 19:25:45.629823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.289 [2024-11-18 19:25:45.639089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.289 [2024-11-18 19:25:45.639402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.289 [2024-11-18 19:25:45.639499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.289 [2024-11-18 19:25:45.639528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.289 [2024-11-18 19:25:45.639546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.289 [2024-11-18 19:25:45.639753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.289 [2024-11-18 19:25:45.639927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.289 [2024-11-18 19:25:45.639955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.289 [2024-11-18 19:25:45.639979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.289 [2024-11-18 19:25:45.642233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.289 [2024-11-18 19:25:45.651600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.289 [2024-11-18 19:25:45.651886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.289 [2024-11-18 19:25:45.652044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.289 [2024-11-18 19:25:45.652073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.289 [2024-11-18 19:25:45.652091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.289 [2024-11-18 19:25:45.652221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.652391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.652414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.652430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.654691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.664060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.664396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.664514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.664544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.664562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.664760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.664985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.665009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.665025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.667470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.676577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.677074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.677194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.677222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.677239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.677370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.677581] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.677605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.677636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.679988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.689449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.689766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.689860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.689889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.689906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.690090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.690296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.690320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.690335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.692549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.701897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.702181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.702296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.702325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.702342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.702507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.702690] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.702715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.702731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.705070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.714365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.714665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.714798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.714827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.714844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.715029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.715180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.715209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.715225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.717602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.726926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.727219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.727322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.727351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.727369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.727518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.727663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.727688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.727703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.729863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.739464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.739782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.739938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.739967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.739985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.740195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.740365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.740389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.740405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.290 [2024-11-18 19:25:45.742684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.290 [2024-11-18 19:25:45.752267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.290 [2024-11-18 19:25:45.752603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.752740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.290 [2024-11-18 19:25:45.752768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.290 [2024-11-18 19:25:45.752785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.290 [2024-11-18 19:25:45.752933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.290 [2024-11-18 19:25:45.753102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.290 [2024-11-18 19:25:45.753125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.290 [2024-11-18 19:25:45.753147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.755419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.764706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.765031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.765139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.765168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.765185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.765369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.765502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.765525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.765541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.767925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.777228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.777602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.777711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.777739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.777757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.777959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.778147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.778170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.778185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.780584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.790008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.790359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.790523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.790549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.790565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.790725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.790857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.790877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.790906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.793323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.802573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.802832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.802975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.803000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.803017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.803172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.803360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.803383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.803399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.805823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.815309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.815542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.815686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.815712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.815727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.815872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.816028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.816052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.816068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.818368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.828153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.828409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.828568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.828596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.828626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.828827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.829014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.829038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.829055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.831483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.840825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.841154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.841313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.841342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.841360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.841544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.841713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.841734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.841747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.844103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.853314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.853585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.853751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.853780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.291 [2024-11-18 19:25:45.853797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.291 [2024-11-18 19:25:45.853981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.291 [2024-11-18 19:25:45.854151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.291 [2024-11-18 19:25:45.854174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.291 [2024-11-18 19:25:45.854190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.291 [2024-11-18 19:25:45.856549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.291 [2024-11-18 19:25:45.865898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.291 [2024-11-18 19:25:45.866196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.291 [2024-11-18 19:25:45.866305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.292 [2024-11-18 19:25:45.866333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.292 [2024-11-18 19:25:45.866350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.292 [2024-11-18 19:25:45.866498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.292 [2024-11-18 19:25:45.866716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.292 [2024-11-18 19:25:45.866740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.292 [2024-11-18 19:25:45.866757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.292 [2024-11-18 19:25:45.869092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.292 [2024-11-18 19:25:45.878519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.292 [2024-11-18 19:25:45.878805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.292 [2024-11-18 19:25:45.878949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.292 [2024-11-18 19:25:45.878992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.292 [2024-11-18 19:25:45.879009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.292 [2024-11-18 19:25:45.879192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.292 [2024-11-18 19:25:45.879361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.292 [2024-11-18 19:25:45.879385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.292 [2024-11-18 19:25:45.879401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.292 [2024-11-18 19:25:45.881751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.292 [2024-11-18 19:25:45.891021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.292 [2024-11-18 19:25:45.891334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.292 [2024-11-18 19:25:45.891460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.292 [2024-11-18 19:25:45.891488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.292 [2024-11-18 19:25:45.891506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.292 [2024-11-18 19:25:45.891720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.292 [2024-11-18 19:25:45.891924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.292 [2024-11-18 19:25:45.891945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.292 [2024-11-18 19:25:45.891960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.552 [2024-11-18 19:25:45.894294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.552 [2024-11-18 19:25:45.903581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.552 [2024-11-18 19:25:45.903875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.552 [2024-11-18 19:25:45.904119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.552 [2024-11-18 19:25:45.904148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.552 [2024-11-18 19:25:45.904165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.552 [2024-11-18 19:25:45.904330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.552 [2024-11-18 19:25:45.904500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.552 [2024-11-18 19:25:45.904524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.552 [2024-11-18 19:25:45.904540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.552 [2024-11-18 19:25:45.906916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.552 [2024-11-18 19:25:45.916181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.552 [2024-11-18 19:25:45.916542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.552 [2024-11-18 19:25:45.916666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.552 [2024-11-18 19:25:45.916711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.552 [2024-11-18 19:25:45.916727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.552 [2024-11-18 19:25:45.916844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.552 [2024-11-18 19:25:45.917047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.917071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.917087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.919406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:45.928691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:45.929009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.929142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.929171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:45.929189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:45.929318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:45.929524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.929548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.929564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.931984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:45.941260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:45.941553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.941679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.941706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:45.941722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:45.941923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:45.942105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.942129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.942144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.944521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:45.953858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:45.954144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.954277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.954306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:45.954329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:45.954496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:45.954660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.954685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.954701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.957110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:45.966437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:45.966790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.966901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.966930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:45.966948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:45.967131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:45.967320] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.967343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.967359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.969783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:45.979058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:45.979336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.979466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.979494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:45.979512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:45.979654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:45.979794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.979815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.979828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.982223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:45.991488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:45.991820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.991953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:45.991979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:45.991995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:45.992177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:45.992384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:45.992408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:45.992424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:45.994755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:46.004248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:46.004542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:46.004684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:46.004711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:46.004727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:46.004892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:46.005092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:46.005115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:46.005131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:46.007397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:46.016849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:46.017125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:46.017281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:46.017310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:46.017327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:46.017475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:46.017675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:46.017700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:46.017716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:46.019818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.553 [2024-11-18 19:25:46.029488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.553 [2024-11-18 19:25:46.029804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:46.029934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.553 [2024-11-18 19:25:46.029963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.553 [2024-11-18 19:25:46.029981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.553 [2024-11-18 19:25:46.030110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.553 [2024-11-18 19:25:46.030249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.553 [2024-11-18 19:25:46.030272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.553 [2024-11-18 19:25:46.030288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.553 [2024-11-18 19:25:46.032675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.041920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.042216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.042374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.042403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.042421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.042587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.042750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.042774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.042790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.045072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.054436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.054762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.054869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.054900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.054918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.055102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.055289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.055312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.055328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.057543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.066907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.067237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.067393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.067435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.067453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.067667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.067795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.067820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.067833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.070245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.079642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.079996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.080125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.080153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.080170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.080354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.080504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.080528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.080544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.082837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.092332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.092669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.092825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.092854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.092871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.093055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.093260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.093284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.093300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.095660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.104751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.105032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.105160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.105188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.105206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.105372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.105596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.105629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.105671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.108158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.117177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.117488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.117624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.117669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.117685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.117802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.117995] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.118019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.118035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.120375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.129773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.130027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.130185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.130214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.130231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.130414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.130602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.130641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.130670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.554 [2024-11-18 19:25:46.132722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.554 [2024-11-18 19:25:46.142496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.554 [2024-11-18 19:25:46.142874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.142991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.554 [2024-11-18 19:25:46.143020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.554 [2024-11-18 19:25:46.143038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.554 [2024-11-18 19:25:46.143186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.554 [2024-11-18 19:25:46.143337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.554 [2024-11-18 19:25:46.143361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.554 [2024-11-18 19:25:46.143377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.555 [2024-11-18 19:25:46.145860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.815 [2024-11-18 19:25:46.155025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.815 [2024-11-18 19:25:46.155389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.155511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.155537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.815 [2024-11-18 19:25:46.155553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.815 [2024-11-18 19:25:46.155680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.815 [2024-11-18 19:25:46.155860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.815 [2024-11-18 19:25:46.155881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.815 [2024-11-18 19:25:46.155894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.815 [2024-11-18 19:25:46.158139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.815 [2024-11-18 19:25:46.167784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.815 [2024-11-18 19:25:46.168127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.168273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.168300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.815 [2024-11-18 19:25:46.168316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.815 [2024-11-18 19:25:46.168497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.815 [2024-11-18 19:25:46.168662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.815 [2024-11-18 19:25:46.168689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.815 [2024-11-18 19:25:46.168705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.815 [2024-11-18 19:25:46.170991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.815 [2024-11-18 19:25:46.180333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.815 [2024-11-18 19:25:46.180576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.180731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.180758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.815 [2024-11-18 19:25:46.180773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.815 [2024-11-18 19:25:46.180958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.815 [2024-11-18 19:25:46.181145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.815 [2024-11-18 19:25:46.181169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.815 [2024-11-18 19:25:46.181184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.815 [2024-11-18 19:25:46.183451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.815 [2024-11-18 19:25:46.192876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.815 [2024-11-18 19:25:46.193200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.193315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.193345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.815 [2024-11-18 19:25:46.193363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.815 [2024-11-18 19:25:46.193493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.815 [2024-11-18 19:25:46.193672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.815 [2024-11-18 19:25:46.193696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.815 [2024-11-18 19:25:46.193712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.815 [2024-11-18 19:25:46.196231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.815 [2024-11-18 19:25:46.205225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.815 [2024-11-18 19:25:46.205516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.205669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.815 [2024-11-18 19:25:46.205696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.815 [2024-11-18 19:25:46.205712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.815 [2024-11-18 19:25:46.205888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.206001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.206025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.206041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.208129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.217882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.218202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.218334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.218364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.218382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.218584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.218765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.218790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.218806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.221054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.230360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.230688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.230808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.230834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.230850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.231047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.231253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.231277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.231292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.233672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.242918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.243221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.243325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.243352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.243368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.243507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.243673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.243698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.243714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.246054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.255456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.255829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.255971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.255997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.256012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.256251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.256410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.256434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.256450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.258797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.268020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.268263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.268410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.268437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.268454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.268662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.268793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.268817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.268833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.271188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.280343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.280672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.280778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.280803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.280819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.280976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.281146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.281169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.281184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.283371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.292948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.293256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.293338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.293381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.293399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.293565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.293736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.293758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.816 [2024-11-18 19:25:46.293772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.816 [2024-11-18 19:25:46.296240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.816 [2024-11-18 19:25:46.305763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.816 [2024-11-18 19:25:46.306056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.306198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.816 [2024-11-18 19:25:46.306228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.816 [2024-11-18 19:25:46.306251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.816 [2024-11-18 19:25:46.306454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.816 [2024-11-18 19:25:46.306636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.816 [2024-11-18 19:25:46.306661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.306677] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.309030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.318330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.318677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.318801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.318826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.318842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.318975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.319157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.319180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.319196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.321517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.331048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.331343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.331478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.331507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.331524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.331730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.331852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.331874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.331905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.334144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.343590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.343881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.344055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.344084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.344101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.344254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.344405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.344428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.344444] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.346759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.356231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.356500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.356654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.356682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.356697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.356847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.357019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.357043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.357058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.359384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.368514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.368834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.368952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.368980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.368998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.369198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.369386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.369409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.369425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.371811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.381215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.381567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.381701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.381728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.381743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.381926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.382084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.382107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.382123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.384403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.394028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.394345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.394477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.394506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.394523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.394712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.394907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.394926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.394938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.397416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.817 [2024-11-18 19:25:46.406418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.817 [2024-11-18 19:25:46.406741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.406876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.817 [2024-11-18 19:25:46.406905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:27.817 [2024-11-18 19:25:46.406923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:27.817 [2024-11-18 19:25:46.407107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:27.817 [2024-11-18 19:25:46.407277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.817 [2024-11-18 19:25:46.407301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.817 [2024-11-18 19:25:46.407316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.817 [2024-11-18 19:25:46.409530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.077 [2024-11-18 19:25:46.419067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.077 [2024-11-18 19:25:46.419422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.077 [2024-11-18 19:25:46.419527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.077 [2024-11-18 19:25:46.419556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.077 [2024-11-18 19:25:46.419574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.419773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.419943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.419967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.419983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.422282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.431621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.431945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.432076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.432105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.432123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.432306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.432441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.432464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.432480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.434701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.444251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.444569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.444731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.444758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.444774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.444951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.445151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.445175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.445190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.447403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.456856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.457171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.457327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.457355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.457373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.457556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.457741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.457761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.457778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.460142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.469469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.469796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.469925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.469951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.469967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.470166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.470336] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.470359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.470375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.472642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.482398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.482716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.482840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.482867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.482882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.483023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.483210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.483233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.483249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.485488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.494852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.495188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.495311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.495337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.495353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.495473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.495656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.495678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.495698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.497831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.507078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.507347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.507428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.507453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.507468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.507624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.507791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.507811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.078 [2024-11-18 19:25:46.507824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.078 [2024-11-18 19:25:46.509687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.078 [2024-11-18 19:25:46.519442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.078 [2024-11-18 19:25:46.519744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.519900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.078 [2024-11-18 19:25:46.519929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.078 [2024-11-18 19:25:46.519946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.078 [2024-11-18 19:25:46.520148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.078 [2024-11-18 19:25:46.520300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.078 [2024-11-18 19:25:46.520324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.520340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.522568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.532039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.532385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.532540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.532569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.532588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.532780] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.532967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.533003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.533018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.535258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.544579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.544861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.545051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.545078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.545094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.545248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.545469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.545492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.545508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.547868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.557033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.557333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.557505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.557532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.557548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.557695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.557860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.557881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.557909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.560116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.569731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.570085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.570242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.570271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.570288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.570418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.570551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.570574] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.570590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.572997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.582388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.582695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.582825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.582853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.582870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.583073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.583242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.583265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.583281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.585734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.594929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.595255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.595388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.595417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.595434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.595629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.595817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.595840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.595856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.598190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.607459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.607733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.607888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.607916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.607934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.608063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.608214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.079 [2024-11-18 19:25:46.608237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.079 [2024-11-18 19:25:46.608254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.079 [2024-11-18 19:25:46.610670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.079 [2024-11-18 19:25:46.620111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.079 [2024-11-18 19:25:46.620404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.620520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.079 [2024-11-18 19:25:46.620548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.079 [2024-11-18 19:25:46.620566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.079 [2024-11-18 19:25:46.620792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.079 [2024-11-18 19:25:46.620969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.080 [2024-11-18 19:25:46.620993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.080 [2024-11-18 19:25:46.621009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.080 [2024-11-18 19:25:46.623218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.080 [2024-11-18 19:25:46.632617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.080 [2024-11-18 19:25:46.632923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.633078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.633106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.080 [2024-11-18 19:25:46.633124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.080 [2024-11-18 19:25:46.633271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.080 [2024-11-18 19:25:46.633422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.080 [2024-11-18 19:25:46.633446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.080 [2024-11-18 19:25:46.633462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.080 [2024-11-18 19:25:46.636023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.080 [2024-11-18 19:25:46.645204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.080 [2024-11-18 19:25:46.645475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.645636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.645666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.080 [2024-11-18 19:25:46.645683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.080 [2024-11-18 19:25:46.645831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.080 [2024-11-18 19:25:46.645981] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.080 [2024-11-18 19:25:46.646005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.080 [2024-11-18 19:25:46.646021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.080 [2024-11-18 19:25:46.648213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.080 [2024-11-18 19:25:46.657693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.080 [2024-11-18 19:25:46.657993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.658126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.658155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.080 [2024-11-18 19:25:46.658178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.080 [2024-11-18 19:25:46.658346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.080 [2024-11-18 19:25:46.658479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.080 [2024-11-18 19:25:46.658503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.080 [2024-11-18 19:25:46.658518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.080 [2024-11-18 19:25:46.660790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.080 [2024-11-18 19:25:46.670379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.080 [2024-11-18 19:25:46.670708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.670841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.080 [2024-11-18 19:25:46.670870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.080 [2024-11-18 19:25:46.670887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.080 [2024-11-18 19:25:46.671055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.080 [2024-11-18 19:25:46.671224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.080 [2024-11-18 19:25:46.671248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.080 [2024-11-18 19:25:46.671264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.080 [2024-11-18 19:25:46.673683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.682949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.683285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.683403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.683431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.683449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.683644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.683777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.683801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.683816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.340 [2024-11-18 19:25:46.685914] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.695486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.695864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.696085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.696114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.696132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.696303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.696491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.696515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.696530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.340 [2024-11-18 19:25:46.698745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.708207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.708495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.708650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.708680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.708698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.708864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.709035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.709058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.709075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.340 [2024-11-18 19:25:46.711411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.720835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.721129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.721261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.721290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.721308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.721456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.721656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.721681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.721697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.340 [2024-11-18 19:25:46.724107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.733499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.733801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.733930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.733956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.733971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.734171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.734353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.734377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.734392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.340 [2024-11-18 19:25:46.736701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.746222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.746556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.746713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.746740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.746756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.746856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.747025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.747048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.747064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.340 [2024-11-18 19:25:46.749437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.340 [2024-11-18 19:25:46.758805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.340 [2024-11-18 19:25:46.759075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.759186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.340 [2024-11-18 19:25:46.759215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.340 [2024-11-18 19:25:46.759233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.340 [2024-11-18 19:25:46.759345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.340 [2024-11-18 19:25:46.759532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.340 [2024-11-18 19:25:46.759556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.340 [2024-11-18 19:25:46.759572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.761811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.771544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.771871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.771987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.772014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.772030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.772181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.772338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.772362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.772378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.774767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.784378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.784669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.784825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.784854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.784872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.785091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.785297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.785320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.785336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.787662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.797080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.797380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.797550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.797576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.797592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.797748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.797924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.797961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.797977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.800243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.809838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.810188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.810283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.810310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.810328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.810511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.810692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.810722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.810738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.813101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.822262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.822574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.822700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.822727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.822743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.822861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.823077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.823101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.823116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.825598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.834877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.835109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.835276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.835305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.835323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.835489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.835652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.835677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.835693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.837812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.847315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.847710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.847847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.847889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.847906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.848089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.848277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.848300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.848321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.850650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.859854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.860203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.860332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.860360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.860378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.860562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.860757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.860777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.860790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.863226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.872391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.872698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.872842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.341 [2024-11-18 19:25:46.872867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.341 [2024-11-18 19:25:46.872883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.341 [2024-11-18 19:25:46.873044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.341 [2024-11-18 19:25:46.873241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.341 [2024-11-18 19:25:46.873264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.341 [2024-11-18 19:25:46.873281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.341 [2024-11-18 19:25:46.875223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.341 [2024-11-18 19:25:46.885020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.341 [2024-11-18 19:25:46.885324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.885479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.885505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.342 [2024-11-18 19:25:46.885520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.342 [2024-11-18 19:25:46.885723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.342 [2024-11-18 19:25:46.885908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.342 [2024-11-18 19:25:46.885945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.342 [2024-11-18 19:25:46.885961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.342 [2024-11-18 19:25:46.888243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.342 [2024-11-18 19:25:46.897516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.342 [2024-11-18 19:25:46.897817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.897995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.898024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.342 [2024-11-18 19:25:46.898041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.342 [2024-11-18 19:25:46.898207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.342 [2024-11-18 19:25:46.898394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.342 [2024-11-18 19:25:46.898417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.342 [2024-11-18 19:25:46.898433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.342 [2024-11-18 19:25:46.900907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.342 [2024-11-18 19:25:46.910056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.342 [2024-11-18 19:25:46.910321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.910477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.910505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.342 [2024-11-18 19:25:46.910523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.342 [2024-11-18 19:25:46.910698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.342 [2024-11-18 19:25:46.910856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.342 [2024-11-18 19:25:46.910876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.342 [2024-11-18 19:25:46.910903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.342 [2024-11-18 19:25:46.913285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.342 [2024-11-18 19:25:46.922619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.342 [2024-11-18 19:25:46.922912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.923043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.923083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.342 [2024-11-18 19:25:46.923099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.342 [2024-11-18 19:25:46.923231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.342 [2024-11-18 19:25:46.923460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.342 [2024-11-18 19:25:46.923485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.342 [2024-11-18 19:25:46.923500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.342 [2024-11-18 19:25:46.925720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.342 [2024-11-18 19:25:46.934899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.342 [2024-11-18 19:25:46.935213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.935337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.342 [2024-11-18 19:25:46.935366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.342 [2024-11-18 19:25:46.935384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.342 [2024-11-18 19:25:46.935567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.342 [2024-11-18 19:25:46.935734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.342 [2024-11-18 19:25:46.935754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.342 [2024-11-18 19:25:46.935767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.342 [2024-11-18 19:25:46.938090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.601 [2024-11-18 19:25:46.947519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.601 [2024-11-18 19:25:46.947846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.601 [2024-11-18 19:25:46.947985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.601 [2024-11-18 19:25:46.948014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.601 [2024-11-18 19:25:46.948031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.601 [2024-11-18 19:25:46.948197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.601 [2024-11-18 19:25:46.948396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.601 [2024-11-18 19:25:46.948417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.601 [2024-11-18 19:25:46.948430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.601 [2024-11-18 19:25:46.950862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.601 [2024-11-18 19:25:46.960127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.601 [2024-11-18 19:25:46.960414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.601 [2024-11-18 19:25:46.960548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.601 [2024-11-18 19:25:46.960577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.601 [2024-11-18 19:25:46.960594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.601 [2024-11-18 19:25:46.960774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.601 [2024-11-18 19:25:46.960945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.601 [2024-11-18 19:25:46.960969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.601 [2024-11-18 19:25:46.960985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.601 [2024-11-18 19:25:46.963321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.601 [2024-11-18 19:25:46.972593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.601 [2024-11-18 19:25:46.972947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.601 [2024-11-18 19:25:46.973086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.601 [2024-11-18 19:25:46.973115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.601 [2024-11-18 19:25:46.973133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.601 [2024-11-18 19:25:46.973298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.601 [2024-11-18 19:25:46.973503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.601 [2024-11-18 19:25:46.973527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.601 [2024-11-18 19:25:46.973543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.601 [2024-11-18 19:25:46.976075] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.601 [2024-11-18 19:25:46.985271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:46.985632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:46.985770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:46.985815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:46.985832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:46.986058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:46.986282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:46.986306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:46.986323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:46.988605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:46.998037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:46.998315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:46.998483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:46.998512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:46.998530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:46.998701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:46.998834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:46.998854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:46.998867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.001219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.010660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.010958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.011091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.011125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.011143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.011345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.011514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.011538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.011554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.013777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.023419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.023700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.023811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.023840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.023858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.024061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.024195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.024219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.024235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.026658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.036035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.036352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.036459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.036488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.036505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.036698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.036870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.036890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.036902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.039260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.048566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.048935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.049050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.049077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.049100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.049303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.049473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.049496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.049512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.052096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.061033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.061384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.061527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.061552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.061568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.061743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.061940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.061965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.061980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.064244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.073503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.073872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.074016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.074046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.074064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.074249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.074472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.074496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.074511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.076931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.086267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.086595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.086731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.086760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.602 [2024-11-18 19:25:47.086778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.602 [2024-11-18 19:25:47.086967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.602 [2024-11-18 19:25:47.087120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.602 [2024-11-18 19:25:47.087143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.602 [2024-11-18 19:25:47.087159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.602 [2024-11-18 19:25:47.089555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.602 [2024-11-18 19:25:47.098878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.602 [2024-11-18 19:25:47.099140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.099313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.602 [2024-11-18 19:25:47.099338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.099369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.099517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.099709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.099730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.099743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.102300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.111627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.111948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.112111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.112137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.112152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.112300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.112467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.112491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.112506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.114857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.124071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.124328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.124461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.124491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.124509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.124731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.124874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.124915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.124931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.127467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.136770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.137168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.137300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.137331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.137348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.137514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.137737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.137760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.137774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.140115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.149146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.149384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.149548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.149576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.149593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.149786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.149921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.149945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.149961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.152375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.161708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.162002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.162135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.162163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.162180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.162364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.162480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.162511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.162529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.165006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.174205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.174455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.174623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.174652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.174669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.174835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.175059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.175082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.175098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.177309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.186605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.186931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.187062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.187090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.187107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.187308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.187532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.187556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.187572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.189776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.603 [2024-11-18 19:25:47.199147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.603 [2024-11-18 19:25:47.199413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.199540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.603 [2024-11-18 19:25:47.199569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.603 [2024-11-18 19:25:47.199587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.603 [2024-11-18 19:25:47.199732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.603 [2024-11-18 19:25:47.199938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.603 [2024-11-18 19:25:47.199962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.603 [2024-11-18 19:25:47.199983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.603 [2024-11-18 19:25:47.202249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.863 [2024-11-18 19:25:47.211734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.863 [2024-11-18 19:25:47.211974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.212108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.212136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.863 [2024-11-18 19:25:47.212154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.863 [2024-11-18 19:25:47.212300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.863 [2024-11-18 19:25:47.212506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.863 [2024-11-18 19:25:47.212530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.863 [2024-11-18 19:25:47.212546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.863 [2024-11-18 19:25:47.214893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.863 [2024-11-18 19:25:47.224337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.863 [2024-11-18 19:25:47.224683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.224842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.224871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.863 [2024-11-18 19:25:47.224889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.863 [2024-11-18 19:25:47.225090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.863 [2024-11-18 19:25:47.225278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.863 [2024-11-18 19:25:47.225301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.863 [2024-11-18 19:25:47.225317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.863 [2024-11-18 19:25:47.227548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.863 [2024-11-18 19:25:47.236866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.863 [2024-11-18 19:25:47.237134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.237268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.237297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.863 [2024-11-18 19:25:47.237315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.863 [2024-11-18 19:25:47.237463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.863 [2024-11-18 19:25:47.237647] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.863 [2024-11-18 19:25:47.237671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.863 [2024-11-18 19:25:47.237687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.863 [2024-11-18 19:25:47.239691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.863 [2024-11-18 19:25:47.249492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.863 [2024-11-18 19:25:47.249777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.249910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.249940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.863 [2024-11-18 19:25:47.249959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.863 [2024-11-18 19:25:47.250161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.863 [2024-11-18 19:25:47.250349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.863 [2024-11-18 19:25:47.250372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.863 [2024-11-18 19:25:47.250388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.863 [2024-11-18 19:25:47.252867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.863 [2024-11-18 19:25:47.262118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.863 [2024-11-18 19:25:47.262446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.262623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.863 [2024-11-18 19:25:47.262650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.863 [2024-11-18 19:25:47.262666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.262844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.263050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.263074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.263089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.265409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.274816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.275107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.275261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.275290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.275308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.275510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.275729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.275754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.275770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.278183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.287539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.287896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.288037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.288062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.288078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.288272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.288434] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.288458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.288473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.290751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.300058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.300391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.300496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.300525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.300542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.300684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.300800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.300824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.300839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.303177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.312483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.312806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.312969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.312998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.313016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.313145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.313297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.313320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.313336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.315759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.324995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.325320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.325515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.325541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.325557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.325776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.325962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.325985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.326001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.328446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.337658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.338008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.338171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.338198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.338214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.338390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.338535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.338559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.338574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.340885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.350365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.350702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.350838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.350868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.350886] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.351052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.351221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.351245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.351260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.353600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.362743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.363077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.363231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.363283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.363302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.363413] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.363599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.363637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.864 [2024-11-18 19:25:47.363653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.864 [2024-11-18 19:25:47.366121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.864 [2024-11-18 19:25:47.375324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.864 [2024-11-18 19:25:47.375618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.375748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.864 [2024-11-18 19:25:47.375776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.864 [2024-11-18 19:25:47.375794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.864 [2024-11-18 19:25:47.375960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.864 [2024-11-18 19:25:47.376093] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.864 [2024-11-18 19:25:47.376116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.376132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 [2024-11-18 19:25:47.378165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 [2024-11-18 19:25:47.387977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.388270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.388400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.388428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.388445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.388642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.388794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.388817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.388832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 [2024-11-18 19:25:47.391065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 [2024-11-18 19:25:47.400537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.400839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.400993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.401021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.401044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.401246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.401416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.401439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.401457] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 [2024-11-18 19:25:47.403899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 [2024-11-18 19:25:47.413279] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.413586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.413724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.413754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.413772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.413974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.414126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.414151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.414166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 [2024-11-18 19:25:47.416340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 [2024-11-18 19:25:47.425991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.426289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.426419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.426448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.426466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.426643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.426796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.426819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.426835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 [2024-11-18 19:25:47.429239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 [2024-11-18 19:25:47.438717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.439025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.439187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.439215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.439233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.439441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.439622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.439651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.439667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 [2024-11-18 19:25:47.441893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 [2024-11-18 19:25:47.451267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.451542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.451682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.451712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.451730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.451914] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.452066] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.452090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.452106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.865 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3559971 Killed "${NVMF_APP[@]}" "$@" 00:27:28.865 [2024-11-18 19:25:47.454515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.865 19:25:47 -- host/bdevperf.sh@36 -- # tgt_init 00:27:28.865 19:25:47 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:28.865 19:25:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:28.865 19:25:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:28.865 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:27:28.865 19:25:47 -- nvmf/common.sh@469 -- # nvmfpid=3561027 00:27:28.865 19:25:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:28.865 19:25:47 -- nvmf/common.sh@470 -- # waitforlisten 3561027 00:27:28.865 19:25:47 -- common/autotest_common.sh@829 -- # '[' -z 3561027 ']' 00:27:28.865 19:25:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:28.865 19:25:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:28.865 19:25:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:28.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:28.865 19:25:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:28.865 19:25:47 -- common/autotest_common.sh@10 -- # set +x 00:27:28.865 [2024-11-18 19:25:47.463628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.865 [2024-11-18 19:25:47.463980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.464102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.865 [2024-11-18 19:25:47.464128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:28.865 [2024-11-18 19:25:47.464144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:28.865 [2024-11-18 19:25:47.464325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:28.865 [2024-11-18 19:25:47.464493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.865 [2024-11-18 19:25:47.464520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.865 [2024-11-18 19:25:47.464535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.125 [2024-11-18 19:25:47.466657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.125 [2024-11-18 19:25:47.476255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.125 [2024-11-18 19:25:47.476554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.125 [2024-11-18 19:25:47.476666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.125 [2024-11-18 19:25:47.476695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.125 [2024-11-18 19:25:47.476712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.125 [2024-11-18 19:25:47.476890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.125 [2024-11-18 19:25:47.477054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.125 [2024-11-18 19:25:47.477077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.125 [2024-11-18 19:25:47.477092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.125 [2024-11-18 19:25:47.479390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.125 [2024-11-18 19:25:47.488623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.125 [2024-11-18 19:25:47.488900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.125 [2024-11-18 19:25:47.488994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.125 [2024-11-18 19:25:47.489020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.125 [2024-11-18 19:25:47.489036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.489170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.489354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.489375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.489390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.491517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.500463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:29.126 [2024-11-18 19:25:47.500518] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:29.126 [2024-11-18 19:25:47.500968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.501323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.501444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.501470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.501486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.501635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.501788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.501810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.501824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.504058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.513128] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.513450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.513581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.513616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.513634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.513784] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.513934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.513969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.513982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.515999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.525297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.525570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.525712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.525738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.525754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.525903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.526133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.526153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.526166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.528018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.126 [2024-11-18 19:25:47.537558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.538138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.538268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.538293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.538309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.538490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.538658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.538680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.538694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.540836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.550220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.550525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.550641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.550684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.550701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.550917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.551099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.551123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.551140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.553478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.562824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.563189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.563301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.563326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.563342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.563548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.563737] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.563760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.563774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.566523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.569700] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:29.126 [2024-11-18 19:25:47.575574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.575956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.576108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.576134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.576150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.576350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.576542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.576566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.576584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.579010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.588120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.588498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.588676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.588703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.126 [2024-11-18 19:25:47.588724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.126 [2024-11-18 19:25:47.588846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.126 [2024-11-18 19:25:47.589013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.126 [2024-11-18 19:25:47.589037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.126 [2024-11-18 19:25:47.589057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.126 [2024-11-18 19:25:47.591249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.126 [2024-11-18 19:25:47.600783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.126 [2024-11-18 19:25:47.601085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.601260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.126 [2024-11-18 19:25:47.601286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.601302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.601450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.601663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.601685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.601699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.604072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.613439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.613817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.613979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.614007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.614025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.614192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.614381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.614419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.614436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.616760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.626159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.626423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.626584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.626634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.626667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.626847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.627036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.627060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.627077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.629387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.638506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.639002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.639184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.639213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.639235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.639409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.639565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.639599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.639630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.642038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.650877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.651220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.651366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.651395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.651421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.651568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.651754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.651775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.651800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.654162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.663408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.663679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.663813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.663840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.663856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.664020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.664207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.664231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.664248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.666653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.676101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.676394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.676495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.676523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.676541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.676758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.676904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.676925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.676962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.679384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.685547] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:29.127 [2024-11-18 19:25:47.685692] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:29.127 [2024-11-18 19:25:47.685712] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:29.127 [2024-11-18 19:25:47.685725] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:29.127 [2024-11-18 19:25:47.685776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:29.127 [2024-11-18 19:25:47.685838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:29.127 [2024-11-18 19:25:47.685842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:29.127 [2024-11-18 19:25:47.688372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.688664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.688781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.688808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.688833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.688986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.689168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.689190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.689204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.691244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.700789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.127 [2024-11-18 19:25:47.701232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.701372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.127 [2024-11-18 19:25:47.701397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.127 [2024-11-18 19:25:47.701417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.127 [2024-11-18 19:25:47.701601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.127 [2024-11-18 19:25:47.701753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.127 [2024-11-18 19:25:47.701776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.127 [2024-11-18 19:25:47.701795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.127 [2024-11-18 19:25:47.703873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.127 [2024-11-18 19:25:47.713069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.128 [2024-11-18 19:25:47.713518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.128 [2024-11-18 19:25:47.713641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.128 [2024-11-18 19:25:47.713669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.128 [2024-11-18 19:25:47.713689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.128 [2024-11-18 19:25:47.713911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.128 [2024-11-18 19:25:47.714097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.128 [2024-11-18 19:25:47.714119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.128 [2024-11-18 19:25:47.714136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.128 [2024-11-18 19:25:47.716121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.128 [2024-11-18 19:25:47.725649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.128 [2024-11-18 19:25:47.726036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.128 [2024-11-18 19:25:47.726187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.128 [2024-11-18 19:25:47.726214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.128 [2024-11-18 19:25:47.726235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.128 [2024-11-18 19:25:47.726395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.128 [2024-11-18 19:25:47.726570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.128 [2024-11-18 19:25:47.726593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.128 [2024-11-18 19:25:47.726624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.387 [2024-11-18 19:25:47.728787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.738042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.738434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.738575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.738603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.738635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.738771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.738896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.738940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.738958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.741170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.750557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.750969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.751112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.751139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.751161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.751320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.751460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.751482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.751501] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.753558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.762936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.763328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.763484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.763511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.763533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.763708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.763915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.763938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.763956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.766161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.775495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.775820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.775953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.775980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.775996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.776162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.776311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.776332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.776346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.778398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.788007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.788258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.788387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.788413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.788429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.788595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.788760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.788782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.788797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.790882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.800218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.800518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.800614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.800643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.800658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.800792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.800943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.800969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.800984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.803095] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.812474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.812798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.812895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.812920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.812936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.813117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.813297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.813318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.813331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.815277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.824861] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.825162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.825259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.825286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.825302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.825451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.825662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.825684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.825699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.827696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.837148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.837413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.837538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.388 [2024-11-18 19:25:47.837564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.388 [2024-11-18 19:25:47.837580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.388 [2024-11-18 19:25:47.837730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.388 [2024-11-18 19:25:47.837868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.388 [2024-11-18 19:25:47.837903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.388 [2024-11-18 19:25:47.837922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.388 [2024-11-18 19:25:47.839959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.388 [2024-11-18 19:25:47.849428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.388 [2024-11-18 19:25:47.849749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.849831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.849857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.849874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.850039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.850235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.850256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.850269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.852351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.861783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.862138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.862222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.862247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.862263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.862380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.862515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.862536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.862549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.864668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.873893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.874164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.874296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.874321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.874337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.874486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.874678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.874701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.874715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.876859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.886075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.886336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.886430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.886456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.886472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.886630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.886751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.886772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.886786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.888882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.898441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.898780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.898870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.898896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.898912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.899028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.899210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.899230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.899244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.901143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.910670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.911055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.911185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.911210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.911225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.911406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.911571] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.911592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.911613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.913760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.923101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.923417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.923519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.923544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.923559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.923734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.923871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.923907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.923921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.926099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.935431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.935735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.935833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.935859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.935874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.936070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.936218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.936238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.936252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.938177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.947735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.948039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.948158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.948184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.948200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.948366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.389 [2024-11-18 19:25:47.948547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.389 [2024-11-18 19:25:47.948568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.389 [2024-11-18 19:25:47.948582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.389 [2024-11-18 19:25:47.950653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.389 [2024-11-18 19:25:47.959989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.389 [2024-11-18 19:25:47.960310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.960433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.389 [2024-11-18 19:25:47.960459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.389 [2024-11-18 19:25:47.960474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.389 [2024-11-18 19:25:47.960631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.390 [2024-11-18 19:25:47.960817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.390 [2024-11-18 19:25:47.960838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.390 [2024-11-18 19:25:47.960853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.390 [2024-11-18 19:25:47.962916] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.390 [2024-11-18 19:25:47.972219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.390 [2024-11-18 19:25:47.972538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.390 [2024-11-18 19:25:47.972635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.390 [2024-11-18 19:25:47.972661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.390 [2024-11-18 19:25:47.972677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.390 [2024-11-18 19:25:47.972874] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.390 [2024-11-18 19:25:47.973054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.390 [2024-11-18 19:25:47.973076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.390 [2024-11-18 19:25:47.973089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.390 [2024-11-18 19:25:47.975142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.390 [2024-11-18 19:25:47.984520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.390 [2024-11-18 19:25:47.984817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.390 [2024-11-18 19:25:47.984938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.390 [2024-11-18 19:25:47.984964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.390 [2024-11-18 19:25:47.984979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.390 [2024-11-18 19:25:47.985160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.390 [2024-11-18 19:25:47.985326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.390 [2024-11-18 19:25:47.985347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.390 [2024-11-18 19:25:47.985360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.390 [2024-11-18 19:25:47.987562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.649 [2024-11-18 19:25:47.997017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.649 [2024-11-18 19:25:47.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.649 [2024-11-18 19:25:47.997462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.649 [2024-11-18 19:25:47.997494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.649 [2024-11-18 19:25:47.997511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.649 [2024-11-18 19:25:47.997652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.649 [2024-11-18 19:25:47.997807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.649 [2024-11-18 19:25:47.997829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.649 [2024-11-18 19:25:47.997844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.649 [2024-11-18 19:25:47.999861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.649 [2024-11-18 19:25:48.009443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.649 [2024-11-18 19:25:48.009760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.649 [2024-11-18 19:25:48.009890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.649 [2024-11-18 19:25:48.009916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.649 [2024-11-18 19:25:48.009932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.649 [2024-11-18 19:25:48.010082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.649 [2024-11-18 19:25:48.010235] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.649 [2024-11-18 19:25:48.010257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.649 [2024-11-18 19:25:48.010271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.649 [2024-11-18 19:25:48.012559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.649 [2024-11-18 19:25:48.021858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.649 [2024-11-18 19:25:48.022152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.649 [2024-11-18 19:25:48.022242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.649 [2024-11-18 19:25:48.022268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.649 [2024-11-18 19:25:48.022284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.649 [2024-11-18 19:25:48.022416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.649 [2024-11-18 19:25:48.022597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.649 [2024-11-18 19:25:48.022627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.649 [2024-11-18 19:25:48.022642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.649 [2024-11-18 19:25:48.024696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.034065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.034403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.034488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.034514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.034535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.034711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.034848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.034869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.034883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.036768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.046189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.046438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.046544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.046570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.046586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.046760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.046945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.046966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.046979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.049011] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.058404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.058731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.058831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.058857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.058873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.059005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.059173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.059194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.059207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.061370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.070747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.071061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.071172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.071199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.071214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.071369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.071488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.071509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.071522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.073800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.083096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.083354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.083468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.083493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.083508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.083667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.083853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.083874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.083889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.085893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.095600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.095841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.095960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.095986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.096001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.096151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.096301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.096322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.096336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.098445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.107932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.108238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.108330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.108356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.108372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.108521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.108693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.108716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.108730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.110750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.120168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.120466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.120584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.120618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.120636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.120738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.120908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.120943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.120957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.122979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.132450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.132773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.132915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.650 [2024-11-18 19:25:48.132940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.650 [2024-11-18 19:25:48.132956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.650 [2024-11-18 19:25:48.133056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.650 [2024-11-18 19:25:48.133254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.650 [2024-11-18 19:25:48.133275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.650 [2024-11-18 19:25:48.133289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.650 [2024-11-18 19:25:48.135465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.650 [2024-11-18 19:25:48.144984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.650 [2024-11-18 19:25:48.145282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.145374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.145400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.145416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.145532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.145678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.145705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.145721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.147872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.157266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.157566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.157675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.157701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.157717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.157899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.158032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.158052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.158066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.160234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.169557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.169798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.169885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.169911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.169927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.170108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.170273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.170294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.170307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.172431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.182055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.182350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.182496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.182522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.182537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.182695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.182849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.182870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.182889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.185115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.194406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.194650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.194740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.194766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.194781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.194947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.195126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.195147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.195161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.197317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.206831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.207127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.207215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.207241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.207257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.207406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.207591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.207622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.207638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.209675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.218881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.219192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.219287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.219313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.219328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.219460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.219596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.219641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.219657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.221743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.231106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.231444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.231557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.231582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.231598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.231740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.231877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.231913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.231927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.234060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.651 [2024-11-18 19:25:48.243404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.651 [2024-11-18 19:25:48.243725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.243821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.651 [2024-11-18 19:25:48.243847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.651 [2024-11-18 19:25:48.243863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.651 [2024-11-18 19:25:48.244028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.651 [2024-11-18 19:25:48.244178] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.651 [2024-11-18 19:25:48.244199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.651 [2024-11-18 19:25:48.244213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.651 [2024-11-18 19:25:48.246368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.911 [2024-11-18 19:25:48.255716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.256019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.256138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.256165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.256181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.256298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.256497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.256519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.256533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.258557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.267964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.268267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.268364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.268391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.268407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.268539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.268699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.268723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.268737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.270719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.280283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.280662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.280690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.280706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.280888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.281073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.281094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.281108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.283124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.292706] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.293061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.293152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.293179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.293195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.293329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.293479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.293499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.293513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.295617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.305089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.305388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.305500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.305526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.305541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.305684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.305838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.305859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.305874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.307845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.317580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.317862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.317957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.317983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.317999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.318148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.318329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.318350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.318363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.320494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.329826] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.330168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.330272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.330297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.330313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.330461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.330652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.330675] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.330689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.332878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.342057] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.342335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.342453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.342484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.342501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.342676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.342813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.342834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.342849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.344925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.354458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.354730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.354851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.354878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.912 [2024-11-18 19:25:48.354894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.912 [2024-11-18 19:25:48.355043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.912 [2024-11-18 19:25:48.355193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.912 [2024-11-18 19:25:48.355214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.912 [2024-11-18 19:25:48.355228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.912 [2024-11-18 19:25:48.357454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.912 [2024-11-18 19:25:48.366711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.912 [2024-11-18 19:25:48.367032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.912 [2024-11-18 19:25:48.367155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.367181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.367196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.367345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.367512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.367532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.367546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.369630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.378859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.379141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.379258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.379284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.379305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.379439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.379664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.379687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.379702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.381785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.391016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.391247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.391373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.391399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.391415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.391579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.391723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.391746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.391760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.393858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.403466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.403791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.403946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.403972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.403987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.404120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.404286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.404308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.404322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.406294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.415636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.415963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.416081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.416108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.416124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.416311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.416478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.416499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.416513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.418582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.427735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.428052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.428164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.428190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.428207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.428323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.428458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.428479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.428493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.430623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.440065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.440320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.440407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.440433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.440448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.440622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.440792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.440814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.440828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.442983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.452505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.452784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.452878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.452903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.452919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.453084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.453223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.453244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.453258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.455320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 [2024-11-18 19:25:48.465014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 [2024-11-18 19:25:48.465273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.465389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.465414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.465430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.913 [2024-11-18 19:25:48.465620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.913 [2024-11-18 19:25:48.465758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.913 [2024-11-18 19:25:48.465779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.913 [2024-11-18 19:25:48.465794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.913 [2024-11-18 19:25:48.467905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.913 19:25:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:29.913 19:25:48 -- common/autotest_common.sh@862 -- # return 0 00:27:29.913 [2024-11-18 19:25:48.477412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.913 19:25:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:29.913 [2024-11-18 19:25:48.477662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 19:25:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:29.913 [2024-11-18 19:25:48.477782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.913 [2024-11-18 19:25:48.477807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.913 [2024-11-18 19:25:48.477823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.914 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:29.914 [2024-11-18 19:25:48.478005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.914 [2024-11-18 19:25:48.478206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.914 [2024-11-18 19:25:48.478228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.914 [2024-11-18 19:25:48.478242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.914 [2024-11-18 19:25:48.480566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.914 [2024-11-18 19:25:48.489665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.914 [2024-11-18 19:25:48.489883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.914 [2024-11-18 19:25:48.489994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.914 [2024-11-18 19:25:48.490020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.914 [2024-11-18 19:25:48.490035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.914 [2024-11-18 19:25:48.490157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.914 [2024-11-18 19:25:48.490330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.914 [2024-11-18 19:25:48.490351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.914 [2024-11-18 19:25:48.490366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.914 [2024-11-18 19:25:48.492321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.914 19:25:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:29.914 19:25:48 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:29.914 19:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.914 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:29.914 [2024-11-18 19:25:48.500824] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:29.914 [2024-11-18 19:25:48.502064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:29.914 [2024-11-18 19:25:48.502357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.914 [2024-11-18 19:25:48.502503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:29.914 [2024-11-18 19:25:48.502528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:29.914 [2024-11-18 19:25:48.502544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:29.914 [2024-11-18 19:25:48.502718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:29.914 [2024-11-18 19:25:48.502855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:29.914 [2024-11-18 19:25:48.502877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:29.914 [2024-11-18 19:25:48.502891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:29.914 [2024-11-18 19:25:48.504799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:29.914 19:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:29.914 19:25:48 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:29.914 19:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:29.914 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:30.172 [2024-11-18 19:25:48.514751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.172 [2024-11-18 19:25:48.515062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.172 [2024-11-18 19:25:48.515156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.172 [2024-11-18 19:25:48.515183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:30.172 [2024-11-18 19:25:48.515199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:30.172 [2024-11-18 19:25:48.515316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:30.172 [2024-11-18 19:25:48.515512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.172 [2024-11-18 19:25:48.515534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.172 [2024-11-18 19:25:48.515548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.172 [2024-11-18 19:25:48.517695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.172 [2024-11-18 19:25:48.527270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.172 [2024-11-18 19:25:48.527524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.172 [2024-11-18 19:25:48.527645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.172 [2024-11-18 19:25:48.527672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:30.172 [2024-11-18 19:25:48.527688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:30.172 [2024-11-18 19:25:48.527870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:30.172 [2024-11-18 19:25:48.528060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.172 [2024-11-18 19:25:48.528080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.172 [2024-11-18 19:25:48.528094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.172 [2024-11-18 19:25:48.530043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.172 [2024-11-18 19:25:48.539670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.172 [2024-11-18 19:25:48.540172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.172 [2024-11-18 19:25:48.540300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.172 [2024-11-18 19:25:48.540326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:30.172 [2024-11-18 19:25:48.540346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:30.172 [2024-11-18 19:25:48.540551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:30.172 [2024-11-18 19:25:48.540720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.172 [2024-11-18 19:25:48.540743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.173 [2024-11-18 19:25:48.540762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.173 [2024-11-18 19:25:48.542925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.173 Malloc0 00:27:30.173 19:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:30.173 19:25:48 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:30.173 19:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:30.173 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:30.173 [2024-11-18 19:25:48.552167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.173 [2024-11-18 19:25:48.552468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.173 [2024-11-18 19:25:48.552630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.173 [2024-11-18 19:25:48.552658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:30.173 [2024-11-18 19:25:48.552674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:30.173 [2024-11-18 19:25:48.552856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:30.173 [2024-11-18 19:25:48.552993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.173 [2024-11-18 19:25:48.553014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.173 [2024-11-18 19:25:48.553029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.173 19:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:30.173 19:25:48 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:30.173 19:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:30.173 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:30.173 [2024-11-18 19:25:48.555349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.173 19:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:30.173 19:25:48 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:30.173 19:25:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:30.173 19:25:48 -- common/autotest_common.sh@10 -- # set +x 00:27:30.173 [2024-11-18 19:25:48.564407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.173 [2024-11-18 19:25:48.564739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.173 [2024-11-18 19:25:48.564846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:30.173 [2024-11-18 19:25:48.564872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x185b160 with addr=10.0.0.2, port=4420 00:27:30.173 [2024-11-18 19:25:48.564888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185b160 is same with the state(5) to be set 00:27:30.173 [2024-11-18 19:25:48.565063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x185b160 (9): Bad file descriptor 00:27:30.173 [2024-11-18 19:25:48.565245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:30.173 [2024-11-18 19:25:48.565266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:30.173 [2024-11-18 19:25:48.565280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:30.173 [2024-11-18 19:25:48.565273] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:30.173 [2024-11-18 19:25:48.567291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:30.173 19:25:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:30.173 19:25:48 -- host/bdevperf.sh@38 -- # wait 3560293 00:27:30.173 [2024-11-18 19:25:48.576977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:30.173 [2024-11-18 19:25:48.611851] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:40.138 00:27:40.138 Latency(us) 00:27:40.138 [2024-11-18T18:25:58.743Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:40.138 [2024-11-18T18:25:58.743Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:40.138 Verification LBA range: start 0x0 length 0x4000 00:27:40.138 Nvme1n1 : 15.01 9239.81 36.09 15925.77 0.00 5071.62 600.75 18447.17 00:27:40.138 [2024-11-18T18:25:58.743Z] =================================================================================================================== 00:27:40.138 [2024-11-18T18:25:58.743Z] Total : 9239.81 36.09 15925.77 0.00 5071.62 600.75 18447.17 00:27:40.138 19:25:57 -- host/bdevperf.sh@39 -- # sync 00:27:40.138 19:25:57 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:40.138 19:25:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:40.138 19:25:57 -- common/autotest_common.sh@10 -- # set +x 00:27:40.138 19:25:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:40.138 19:25:57 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:40.138 19:25:57 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:40.138 19:25:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:40.138 19:25:57 -- nvmf/common.sh@116 -- # sync 00:27:40.138 19:25:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:40.138 19:25:57 -- nvmf/common.sh@119 -- # set +e 00:27:40.138 19:25:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:40.138 19:25:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:40.138 rmmod nvme_tcp 00:27:40.138 rmmod nvme_fabrics 00:27:40.138 rmmod nvme_keyring 00:27:40.138 19:25:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:40.138 19:25:57 -- nvmf/common.sh@123 -- # set -e 00:27:40.138 19:25:57 -- nvmf/common.sh@124 -- # return 0 00:27:40.138 19:25:57 -- nvmf/common.sh@477 -- # '[' -n 3561027 ']' 00:27:40.138 19:25:57 -- nvmf/common.sh@478 -- # killprocess 3561027 00:27:40.138 19:25:57 -- common/autotest_common.sh@936 -- # '[' -z 3561027 ']' 00:27:40.138 19:25:57 -- common/autotest_common.sh@940 -- # kill -0 3561027 00:27:40.138 19:25:57 -- common/autotest_common.sh@941 -- # uname 00:27:40.138 19:25:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:40.138 19:25:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3561027 00:27:40.138 19:25:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:40.138 19:25:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:40.138 19:25:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3561027' 00:27:40.138 killing process with pid 3561027 00:27:40.138 19:25:57 -- common/autotest_common.sh@955 -- # kill 3561027 00:27:40.138 19:25:57 -- common/autotest_common.sh@960 -- # wait 3561027 00:27:40.138 19:25:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:40.138 19:25:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:40.138 19:25:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:40.138 19:25:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:40.138 19:25:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:40.138 19:25:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.138 19:25:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:40.138 19:25:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:41.072 19:25:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:41.072 00:27:41.072 real 0m23.419s 00:27:41.072 user 1m3.357s 00:27:41.072 sys 0m4.234s 00:27:41.072 19:25:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:41.072 19:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:41.072 ************************************ 00:27:41.072 END TEST nvmf_bdevperf 00:27:41.072 ************************************ 00:27:41.072 19:25:59 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:41.072 19:25:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:41.072 19:25:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.072 19:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:41.072 ************************************ 00:27:41.072 START TEST nvmf_target_disconnect 00:27:41.072 ************************************ 00:27:41.072 19:25:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:41.072 * Looking for test storage... 00:27:41.072 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:41.072 19:25:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:41.072 19:25:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:41.072 19:25:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:41.330 19:25:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:41.330 19:25:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:41.330 19:25:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:41.330 19:25:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:41.330 19:25:59 -- scripts/common.sh@335 -- # IFS=.-: 00:27:41.330 19:25:59 -- scripts/common.sh@335 -- # read -ra ver1 00:27:41.330 19:25:59 -- scripts/common.sh@336 -- # IFS=.-: 00:27:41.330 19:25:59 -- scripts/common.sh@336 -- # read -ra ver2 00:27:41.330 19:25:59 -- scripts/common.sh@337 -- # local 'op=<' 00:27:41.330 19:25:59 -- scripts/common.sh@339 -- # ver1_l=2 00:27:41.330 19:25:59 -- scripts/common.sh@340 -- # ver2_l=1 00:27:41.330 19:25:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:41.330 19:25:59 -- scripts/common.sh@343 -- # case "$op" in 00:27:41.330 19:25:59 -- scripts/common.sh@344 -- # : 1 00:27:41.330 19:25:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:41.330 19:25:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:41.330 19:25:59 -- scripts/common.sh@364 -- # decimal 1 00:27:41.330 19:25:59 -- scripts/common.sh@352 -- # local d=1 00:27:41.330 19:25:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:41.330 19:25:59 -- scripts/common.sh@354 -- # echo 1 00:27:41.330 19:25:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:41.330 19:25:59 -- scripts/common.sh@365 -- # decimal 2 00:27:41.330 19:25:59 -- scripts/common.sh@352 -- # local d=2 00:27:41.330 19:25:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:41.330 19:25:59 -- scripts/common.sh@354 -- # echo 2 00:27:41.330 19:25:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:41.330 19:25:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:41.330 19:25:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:41.330 19:25:59 -- scripts/common.sh@367 -- # return 0 00:27:41.330 19:25:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:41.330 19:25:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:41.330 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.330 --rc genhtml_branch_coverage=1 00:27:41.330 --rc genhtml_function_coverage=1 00:27:41.330 --rc genhtml_legend=1 00:27:41.330 --rc geninfo_all_blocks=1 00:27:41.330 --rc geninfo_unexecuted_blocks=1 00:27:41.330 00:27:41.330 ' 00:27:41.330 19:25:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:41.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.331 --rc genhtml_branch_coverage=1 00:27:41.331 --rc genhtml_function_coverage=1 00:27:41.331 --rc genhtml_legend=1 00:27:41.331 --rc geninfo_all_blocks=1 00:27:41.331 --rc geninfo_unexecuted_blocks=1 00:27:41.331 00:27:41.331 ' 00:27:41.331 19:25:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:41.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.331 --rc genhtml_branch_coverage=1 00:27:41.331 --rc genhtml_function_coverage=1 00:27:41.331 --rc genhtml_legend=1 00:27:41.331 --rc geninfo_all_blocks=1 00:27:41.331 --rc geninfo_unexecuted_blocks=1 00:27:41.331 00:27:41.331 ' 00:27:41.331 19:25:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:41.331 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:41.331 --rc genhtml_branch_coverage=1 00:27:41.331 --rc genhtml_function_coverage=1 00:27:41.331 --rc genhtml_legend=1 00:27:41.331 --rc geninfo_all_blocks=1 00:27:41.331 --rc geninfo_unexecuted_blocks=1 00:27:41.331 00:27:41.331 ' 00:27:41.331 19:25:59 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:41.331 19:25:59 -- nvmf/common.sh@7 -- # uname -s 00:27:41.331 19:25:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:41.331 19:25:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:41.331 19:25:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:41.331 19:25:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:41.331 19:25:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:41.331 19:25:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:41.331 19:25:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:41.331 19:25:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:41.331 19:25:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:41.331 19:25:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:41.331 19:25:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:41.331 19:25:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:41.331 19:25:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:41.331 19:25:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:41.331 19:25:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:41.331 19:25:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:41.331 19:25:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:41.331 19:25:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:41.331 19:25:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:41.331 19:25:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.331 19:25:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.331 19:25:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.331 19:25:59 -- paths/export.sh@5 -- # export PATH 00:27:41.331 19:25:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:41.331 19:25:59 -- nvmf/common.sh@46 -- # : 0 00:27:41.331 19:25:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:41.331 19:25:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:41.331 19:25:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:41.331 19:25:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:41.331 19:25:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:41.331 19:25:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:41.331 19:25:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:41.331 19:25:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:41.331 19:25:59 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:41.331 19:25:59 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:41.331 19:25:59 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:41.331 19:25:59 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:41.331 19:25:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:41.331 19:25:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:41.331 19:25:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:41.331 19:25:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:41.331 19:25:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:41.331 19:25:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:41.331 19:25:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:41.331 19:25:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:41.331 19:25:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:41.331 19:25:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:41.331 19:25:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:41.331 19:25:59 -- common/autotest_common.sh@10 -- # set +x 00:27:43.271 19:26:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:43.271 19:26:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:43.271 19:26:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:43.271 19:26:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:43.271 19:26:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:43.271 19:26:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:43.271 19:26:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:43.271 19:26:01 -- nvmf/common.sh@294 -- # net_devs=() 00:27:43.271 19:26:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:43.271 19:26:01 -- nvmf/common.sh@295 -- # e810=() 00:27:43.271 19:26:01 -- nvmf/common.sh@295 -- # local -ga e810 00:27:43.271 19:26:01 -- nvmf/common.sh@296 -- # x722=() 00:27:43.271 19:26:01 -- nvmf/common.sh@296 -- # local -ga x722 00:27:43.271 19:26:01 -- nvmf/common.sh@297 -- # mlx=() 00:27:43.271 19:26:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:43.271 19:26:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:43.271 19:26:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:43.271 19:26:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:43.271 19:26:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:43.271 19:26:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:43.271 19:26:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:43.271 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:43.271 19:26:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:43.271 19:26:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:43.271 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:43.271 19:26:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:43.271 19:26:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:43.271 19:26:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:43.271 19:26:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:43.271 19:26:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:43.271 19:26:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:43.271 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:43.271 19:26:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:43.271 19:26:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:43.271 19:26:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:43.271 19:26:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:43.271 19:26:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:43.271 19:26:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:43.271 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:43.271 19:26:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:43.271 19:26:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:43.271 19:26:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:43.271 19:26:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:43.271 19:26:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:43.271 19:26:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:43.271 19:26:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:43.271 19:26:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:43.271 19:26:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:43.271 19:26:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:43.271 19:26:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:43.271 19:26:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:43.271 19:26:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:43.271 19:26:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:43.271 19:26:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:43.271 19:26:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:43.271 19:26:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:43.271 19:26:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:43.271 19:26:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:43.271 19:26:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:43.271 19:26:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:43.271 19:26:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:43.271 19:26:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:43.271 19:26:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:43.271 19:26:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:43.271 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:43.271 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.290 ms 00:27:43.271 00:27:43.271 --- 10.0.0.2 ping statistics --- 00:27:43.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:43.272 rtt min/avg/max/mdev = 0.290/0.290/0.290/0.000 ms 00:27:43.272 19:26:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:43.272 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:43.272 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:27:43.272 00:27:43.272 --- 10.0.0.1 ping statistics --- 00:27:43.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:43.272 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:27:43.272 19:26:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:43.272 19:26:01 -- nvmf/common.sh@410 -- # return 0 00:27:43.272 19:26:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:43.272 19:26:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:43.272 19:26:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:43.272 19:26:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:43.272 19:26:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:43.272 19:26:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:43.272 19:26:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:43.531 19:26:01 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:43.531 19:26:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:43.531 19:26:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:43.531 19:26:01 -- common/autotest_common.sh@10 -- # set +x 00:27:43.531 ************************************ 00:27:43.531 START TEST nvmf_target_disconnect_tc1 00:27:43.531 ************************************ 00:27:43.531 19:26:01 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:43.531 19:26:01 -- host/target_disconnect.sh@32 -- # set +e 00:27:43.531 19:26:01 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:43.531 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.531 [2024-11-18 19:26:01.975433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.531 [2024-11-18 19:26:01.975648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.531 [2024-11-18 19:26:01.975681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x868b40 with addr=10.0.0.2, port=4420 00:27:43.531 [2024-11-18 19:26:01.975718] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:43.531 [2024-11-18 19:26:01.975741] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:43.531 [2024-11-18 19:26:01.975756] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:43.531 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:43.531 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:43.531 Initializing NVMe Controllers 00:27:43.531 19:26:01 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:43.531 19:26:01 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:43.531 19:26:01 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:43.531 19:26:01 -- common/autotest_common.sh@1142 -- # return 0 00:27:43.531 19:26:01 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:43.531 19:26:01 -- host/target_disconnect.sh@41 -- # set -e 00:27:43.531 00:27:43.531 real 0m0.091s 00:27:43.531 user 0m0.036s 00:27:43.531 sys 0m0.054s 00:27:43.531 19:26:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:43.531 19:26:01 -- common/autotest_common.sh@10 -- # set +x 00:27:43.531 ************************************ 00:27:43.531 END TEST nvmf_target_disconnect_tc1 00:27:43.531 ************************************ 00:27:43.531 19:26:02 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:43.531 19:26:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:43.531 19:26:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:43.531 19:26:02 -- common/autotest_common.sh@10 -- # set +x 00:27:43.531 ************************************ 00:27:43.531 START TEST nvmf_target_disconnect_tc2 00:27:43.531 ************************************ 00:27:43.531 19:26:02 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:43.531 19:26:02 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:43.531 19:26:02 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:43.531 19:26:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:43.531 19:26:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:43.531 19:26:02 -- common/autotest_common.sh@10 -- # set +x 00:27:43.531 19:26:02 -- nvmf/common.sh@469 -- # nvmfpid=3564181 00:27:43.531 19:26:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:43.531 19:26:02 -- nvmf/common.sh@470 -- # waitforlisten 3564181 00:27:43.531 19:26:02 -- common/autotest_common.sh@829 -- # '[' -z 3564181 ']' 00:27:43.531 19:26:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:43.531 19:26:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:43.531 19:26:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:43.531 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:43.531 19:26:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:43.531 19:26:02 -- common/autotest_common.sh@10 -- # set +x 00:27:43.531 [2024-11-18 19:26:02.064662] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:43.531 [2024-11-18 19:26:02.064730] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:43.531 EAL: No free 2048 kB hugepages reported on node 1 00:27:43.531 [2024-11-18 19:26:02.126081] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:43.789 [2024-11-18 19:26:02.235347] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:43.789 [2024-11-18 19:26:02.235500] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:43.789 [2024-11-18 19:26:02.235518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:43.789 [2024-11-18 19:26:02.235532] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:43.789 [2024-11-18 19:26:02.235630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:43.789 [2024-11-18 19:26:02.235750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:43.789 [2024-11-18 19:26:02.235895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:43.789 [2024-11-18 19:26:02.235900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:44.722 19:26:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:44.722 19:26:03 -- common/autotest_common.sh@862 -- # return 0 00:27:44.722 19:26:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:44.722 19:26:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 19:26:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:44.722 19:26:03 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:44.722 19:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 Malloc0 00:27:44.722 19:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.722 19:26:03 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:44.722 19:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 [2024-11-18 19:26:03.106471] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:44.722 19:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.722 19:26:03 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:44.722 19:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 19:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.722 19:26:03 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:44.722 19:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 19:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.722 19:26:03 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:44.722 19:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 [2024-11-18 19:26:03.134758] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:44.722 19:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.722 19:26:03 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:44.722 19:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:44.722 19:26:03 -- common/autotest_common.sh@10 -- # set +x 00:27:44.722 19:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:44.722 19:26:03 -- host/target_disconnect.sh@50 -- # reconnectpid=3564338 00:27:44.722 19:26:03 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:44.722 19:26:03 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:44.722 EAL: No free 2048 kB hugepages reported on node 1 00:27:46.627 19:26:05 -- host/target_disconnect.sh@53 -- # kill -9 3564181 00:27:46.627 19:26:05 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 [2024-11-18 19:26:05.158345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 [2024-11-18 19:26:05.158744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Read completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 Write completed with error (sct=0, sc=8) 00:27:46.627 starting I/O failed 00:27:46.627 [2024-11-18 19:26:05.159069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:46.627 [2024-11-18 19:26:05.159268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.627 [2024-11-18 19:26:05.159420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.627 [2024-11-18 19:26:05.159446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.627 qpair failed and we were unable to recover it. 00:27:46.627 [2024-11-18 19:26:05.159549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.159668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.159695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.159808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.159928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.159956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.160051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.160291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.160533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.160764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.160888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.161002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.161266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.161556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.161818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.161934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.162064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.162286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.162585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.162812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.162962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.163050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.163297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.163551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.163822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.163974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.164093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.164239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.164270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.164400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.164499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.164527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.164678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.164792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.164818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.164953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.165209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.165464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.165703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.165815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.165933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.166153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.166370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.628 [2024-11-18 19:26:05.166645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.628 [2024-11-18 19:26:05.166752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.628 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.166853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.166939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.166964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.167043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.167243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.167476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.167712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.167826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.167942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.168191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.168506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.168772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.168880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.168971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.169186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.169512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.169725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.169849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.169942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.170171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.170364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.170584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.170829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.170944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.171035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.171267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.171527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.171778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.171890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.171986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.172208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.172424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.172627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.172879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.172990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.173017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.173127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.173242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.173269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.629 qpair failed and we were unable to recover it. 00:27:46.629 [2024-11-18 19:26:05.173393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.173520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.629 [2024-11-18 19:26:05.173546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.173633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.173763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.173790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.173915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.174176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.174482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.174715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.174816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.174914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.175201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.175427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.175663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.175798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.175951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.176202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.176410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.176680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.176822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.176933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.177251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.177563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.177877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.177986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.178102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.178302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.178554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.178815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.178992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.179149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.179375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.179629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.179862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.179999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.180076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.180414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.180646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.630 qpair failed and we were unable to recover it. 00:27:46.630 [2024-11-18 19:26:05.180855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.630 [2024-11-18 19:26:05.180961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.181172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.181409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.181651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.181886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.181998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.182131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.182330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.182569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.182808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.182950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.183095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.183307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.183590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.183866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.183985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.184100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.184238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.184263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.184383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.184478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.184502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.184626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.184735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.184777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.184889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.185198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.185395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.185642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.185814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.185956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.186204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.186444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.186715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.631 [2024-11-18 19:26:05.186882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.631 qpair failed and we were unable to recover it. 00:27:46.631 [2024-11-18 19:26:05.187015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.187302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.187613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.187867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.187969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.188104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.188406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.188634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.188833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.188987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.189139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.189365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.189656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.189894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.189984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.190124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.190343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.190601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.190758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.190874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.191197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.191526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.191813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.191916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.192032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.192293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.192537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.192767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.192934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.193303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.193632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.193879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.193982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.194097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.194220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.194245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.632 [2024-11-18 19:26:05.194376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.194507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.632 [2024-11-18 19:26:05.194535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.632 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.194645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.194788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.194813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.194933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.195172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.195393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.195664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.195854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.195974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.196223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.196424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.196659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.196768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.196903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.197172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.197422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.197653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.197867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.197976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.198142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.198393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.198626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.198894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.198979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.199091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.199364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.199673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.199803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.199936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.200135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.200392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.200618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.200849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.200982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.201099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.201241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.201265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.201358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.201508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.201533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.633 [2024-11-18 19:26:05.201644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.201727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.633 [2024-11-18 19:26:05.201752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.633 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.201832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.201955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.201982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.202079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.202282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.202523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.202744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.202882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.202973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.203272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.203556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.203806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.203928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.204044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.204256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.204478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.204750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.204938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.205079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.205308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.205545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.205772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.205907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.206046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.206164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.206192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.206291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.206418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.206444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.206566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.206786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.206813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.206929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.207231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.207522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.207754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.207912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.208037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.208253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.208498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.208762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.208904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.634 qpair failed and we were unable to recover it. 00:27:46.634 [2024-11-18 19:26:05.209018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.209107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.634 [2024-11-18 19:26:05.209132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.209227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.209319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.209344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.209476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.209641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.209667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.209743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.209859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.209886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.210022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.210279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.210570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.210766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.210863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.210979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.211227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.211485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.211692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.211829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.211967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.212290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.212536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.212843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.212984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.213098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.213224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.213248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.213365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.213501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.213526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.213676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.213786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.213811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.213923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.214140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.214366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.214604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.214775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.214916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.215175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.215450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.215675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.215901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.215975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.216000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.216113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.216227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.216252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.635 qpair failed and we were unable to recover it. 00:27:46.635 [2024-11-18 19:26:05.216385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.635 [2024-11-18 19:26:05.216478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.216503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.216619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.216725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.216750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.216845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.216929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.216954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.217035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.217354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.217575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.217815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.217954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.218037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.218296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.218560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.218780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.218917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.219029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.219237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.219554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.219815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.219945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.220065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.220335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.220587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.220837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.220967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.221054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.221320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.221564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.221815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.221983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.222071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.222167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.222191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.222347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.222432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.222459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.636 [2024-11-18 19:26:05.222566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.222746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.636 [2024-11-18 19:26:05.222772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.636 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.222885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.222998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.223116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.223372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.223616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.223854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.223989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.224131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.224248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.224274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.224424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.224540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.224565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.224671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.224783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.224808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.637 [2024-11-18 19:26:05.224894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.225016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.637 [2024-11-18 19:26:05.225041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.637 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.225141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.225396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.225646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.225853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.225992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.226070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.226274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.226525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.226736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.226877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.226961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.227186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.227430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.227668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.227895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.227984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.228139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.228380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.228677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.228782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.228935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.229228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.229431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.229659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.229799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.229892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.230138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.230374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.230631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.916 qpair failed and we were unable to recover it. 00:27:46.916 [2024-11-18 19:26:05.230819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.916 [2024-11-18 19:26:05.230964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.230990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.231137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.231260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.231285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.231432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.231521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.231547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.231740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.231883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.231925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.232029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.232299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.232525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.232775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.232906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.232993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.233244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.233523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.233786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.233900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.234016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.234261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.234524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.234785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.234954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.235102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.235337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.235568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.235803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.235919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.236004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.236267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.236594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.236796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.236937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.237050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.237311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.237532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.237792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.237982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.238007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.917 qpair failed and we were unable to recover it. 00:27:46.917 [2024-11-18 19:26:05.238146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.238267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.917 [2024-11-18 19:26:05.238292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.238483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.238627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.238652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.238770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.238943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.238967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.239063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.239337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.239601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.239880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.239994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.240164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.240429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.240709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.240808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.240920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.241142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.241411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.241710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.241899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.241988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.242128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.242363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.242637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.242847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.242984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.243102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.243344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.243575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.243809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.243977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.244105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.244198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.244227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.244423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.244547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.244572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.244678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.244765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.244789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.244988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.245267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.245501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.918 qpair failed and we were unable to recover it. 00:27:46.918 [2024-11-18 19:26:05.245765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.918 [2024-11-18 19:26:05.245853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.245878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.245995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.246220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.246541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.246770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.246913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.247104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.247268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.247296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.247395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.247555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.247580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.247730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.247847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.247872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.247956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.248219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.248434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.248640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.248776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.248926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.249149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.249428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.249673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.249875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.249986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.250149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.250408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.250705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.250853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.250939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.251208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.251485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.251765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.251877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.251998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.252258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.252486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.252717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.252857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.252967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.253047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.919 [2024-11-18 19:26:05.253072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.919 qpair failed and we were unable to recover it. 00:27:46.919 [2024-11-18 19:26:05.253200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.253293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.253318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.253439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.253522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.253547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.253658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.253773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.253800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.253944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.254235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.254494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.254787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.254924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.255019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.255311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.255583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.255856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.255991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.256076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.256323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.256567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.256819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.256978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.257159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.257375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.257590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.257758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.257914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.258171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.258371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.258618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.258808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.258942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.920 [2024-11-18 19:26:05.259060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.259144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.920 [2024-11-18 19:26:05.259169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.920 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.259287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.259369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.259394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.259508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.259620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.259645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.259738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.259870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.259898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.260034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.260330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.260587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.260882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.260982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.261106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.261352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.261580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.261823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.261961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.262076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.262296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.262483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.262782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.262887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.263006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.263188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.263418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.263686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.263902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.264003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.264162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.264189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.264331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.264414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.264440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.264633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.264718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.264743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.264889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.265161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.265366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.265639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.265781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.265870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.266060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.266085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.266173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.266316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.266341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.921 qpair failed and we were unable to recover it. 00:27:46.921 [2024-11-18 19:26:05.266426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.266533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.921 [2024-11-18 19:26:05.266558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.266679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.266762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.266788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.266908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.267179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.267440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.267825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.267984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.268145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.268389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.268643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.268831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.268948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.269077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.269277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.269510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.269871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.269992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.270100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.270357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.270547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.270746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.270897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.271024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.271216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.271473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.271746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.271887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.272005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.272214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.272436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.272636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.272749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.272888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.273179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.273395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.922 qpair failed and we were unable to recover it. 00:27:46.922 [2024-11-18 19:26:05.273710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.922 [2024-11-18 19:26:05.273825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.273850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.273972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.274219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.274455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.274760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.274866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.274990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.275166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.275191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.275312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.275424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.275448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.275589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.275787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.275817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.275903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.276157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.276406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.276673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.276794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.276907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.277199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.277513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.277796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.277903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.278049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.278277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.278539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.278790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.278931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.279018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.279342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.279562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.279853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.279982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.280155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.280425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.280651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.280883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.280992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.281016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.281117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.281275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.281299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.923 qpair failed and we were unable to recover it. 00:27:46.923 [2024-11-18 19:26:05.281419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.923 [2024-11-18 19:26:05.281524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.281566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.281683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.281823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.281848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.281996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.282323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.282520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.282806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.282933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.283029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.283349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.283605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.283816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.283958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.284091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.284282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.284514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.284823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.284965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.285111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.285390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.285674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.285897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.285998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.286107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.286322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.286522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.286780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.286883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.287005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.287258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.287524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.287780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.287926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.288053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.288209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.288236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.288393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.288511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.924 [2024-11-18 19:26:05.288538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.924 qpair failed and we were unable to recover it. 00:27:46.924 [2024-11-18 19:26:05.288697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.288806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.288831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.288953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.289176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.289516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.289742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.289876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.289964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.290281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.290507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.290778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.290894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.291028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.291267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.291522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.291798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.291929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.292108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.292391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.292670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.292872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.292988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.293126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.293268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.293293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.293456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.293558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.293585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.293695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.293838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.293862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.293949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.294200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.294455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.294813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.294962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.925 [2024-11-18 19:26:05.295091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.295229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.925 [2024-11-18 19:26:05.295254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.925 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.295398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.295495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.295523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.295682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.295770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.295798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.295910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.296205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.296470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.296708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.296815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.296930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.297225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.297434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.297736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.297852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.297975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.298218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.298544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.298788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.298895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.299023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.299278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.299492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.299760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.299879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.300000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.300186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.300447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.300669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.300777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.300867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.301172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.301486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.301837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.301970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.302054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.302159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.302183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.302312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.302439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.302467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.926 qpair failed and we were unable to recover it. 00:27:46.926 [2024-11-18 19:26:05.302589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.302751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.926 [2024-11-18 19:26:05.302780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.302910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.303179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.303446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.303718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.303857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.303940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.304161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.304343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.304564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.304809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.304966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.305134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.305247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.305272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.305449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.305583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.305617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.305723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.305839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.305864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.305947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.306169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.306381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.306636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.306848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.306994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.307077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.307183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.307208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.307333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.307455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.307481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.307635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.307755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.307780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.307898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.308193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.308484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.308712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.308857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.308944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.309151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.309364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.309641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.309806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.927 qpair failed and we were unable to recover it. 00:27:46.927 [2024-11-18 19:26:05.309953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.927 [2024-11-18 19:26:05.310107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.310241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.310497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.310749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.310929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.311035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.311355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.311622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.311858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.311981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.312113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.312192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.312217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.312375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.312491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.312519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.312686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.312783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.312811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.312945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.313230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.313471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.313770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.313911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.314049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.314330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.314559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.314789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.314952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.315079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.315171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.315199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.315303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.315511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.315536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.315651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.315778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.315804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.315921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.316247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.316546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.316848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.316961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.317068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.317186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.317211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.317356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.317485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.317513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.317646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.317744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.928 [2024-11-18 19:26:05.317772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.928 qpair failed and we were unable to recover it. 00:27:46.928 [2024-11-18 19:26:05.317910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.318231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.318477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.318774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.318945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.319064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.319316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.319589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.319884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.319992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.320092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.320297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.320547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.320868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.320985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.321142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.321367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.321594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.321863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.321998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.322080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.322339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.322620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.322869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.322988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.323122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.323391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.323699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.323843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.323964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.324235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.324451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.929 qpair failed and we were unable to recover it. 00:27:46.929 [2024-11-18 19:26:05.324705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.929 [2024-11-18 19:26:05.324808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.324929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.325145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.325379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.325604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.325858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.325992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.326116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.326376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.326621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.326862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.326998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.327192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.327473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.327791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.327932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.328035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.328294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.328551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.328826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.328968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.329084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.329340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.329565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.329759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.329866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.329984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.330253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.330526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.330803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.330948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.331066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.331187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.331215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.331328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.331426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.331454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.331593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.331766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.930 [2024-11-18 19:26:05.331796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.930 qpair failed and we were unable to recover it. 00:27:46.930 [2024-11-18 19:26:05.331912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.331999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.332144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.332438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.332729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.332930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.333023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.333313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.333520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.333836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.333972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.334133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.334293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.334321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.334445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.334574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.334616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.334751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.334858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.334883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.335038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.335297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.335515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.335836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.335944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.336063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.336180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.336208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.336344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.336462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.336490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.336619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.336708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.336734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.336900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.337145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.337401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.337691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.337830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.337915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.338137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.338409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.338668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.338807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.338953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.339071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.339099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.339192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.339355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.339383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.931 qpair failed and we were unable to recover it. 00:27:46.931 [2024-11-18 19:26:05.339487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.339577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.931 [2024-11-18 19:26:05.339605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.339716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.339808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.339833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.339978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.340287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.340571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.340831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.340974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.341111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.341388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.341655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.341885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.341984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.342145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.342424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.342685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.342827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.342920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.343204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.343493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.343736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.343856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.343936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.344218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.344520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.344827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.344989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.345131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.345475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.345761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.345869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.346014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.346267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.346583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.346858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.346995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.347022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.347120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.347224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.347252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.932 qpair failed and we were unable to recover it. 00:27:46.932 [2024-11-18 19:26:05.347367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.932 [2024-11-18 19:26:05.347475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.347501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.347643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.347806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.347833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.347945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.348174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.348486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.348780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.348880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.349010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.349260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.349549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.349866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.349973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.350063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.350204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.350246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.350370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.350461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.350489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.350591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.350736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.350761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.350848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.351186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.351458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.351691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.351857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.351959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.352239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.352548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.352856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.352977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.353089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.353337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.353539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.353747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.353859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.354017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.354231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.354497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.354759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.933 [2024-11-18 19:26:05.354903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.933 qpair failed and we were unable to recover it. 00:27:46.933 [2024-11-18 19:26:05.355021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.355293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.355576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.355823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.355978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.356114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.356228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.356253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.356385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.356538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.356565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.356723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.356805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.356830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.356952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.357264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.357492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.357812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.357950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.358068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.358316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.358580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.358833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.358967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.359093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.359227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.359255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.359415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.359551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.359576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.359735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.359850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.359874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.359984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.360226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.360505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.360746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.360887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.360998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.361113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.361138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.361276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.361370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.361397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.361558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.361662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.934 [2024-11-18 19:26:05.361688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.934 qpair failed and we were unable to recover it. 00:27:46.934 [2024-11-18 19:26:05.361804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.361944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.361973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.362067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.362204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.362232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.362395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.362487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.362515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.362622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.362761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.362785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.362939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.363191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.363479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.363802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.363943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.364023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.364277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.364531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.364832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.364960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.365072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.365281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.365526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.365767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.365908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.365985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.366306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.366586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.366839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.366986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.367173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.367415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.367664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.367911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.367985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.368116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.368450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.368765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.368919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.369061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.369170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.369195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.935 [2024-11-18 19:26:05.369359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.369443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.935 [2024-11-18 19:26:05.369471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.935 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.369600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.369696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.369723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.369858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.369950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.369978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.370132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.370237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.370262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.370552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.370720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.370748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.370880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.370974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.371169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.371481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.371789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.371943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.372096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.372348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.372571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.372839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.372963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.373089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.373388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.373649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.373849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.373960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.374055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.374169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.374195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.374319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.374424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.374452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.374595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.374718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.374744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.374902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.375209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.375461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.375712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.375864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.375960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.376251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.376497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.376776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.376887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.376980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.377085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.377112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.936 qpair failed and we were unable to recover it. 00:27:46.936 [2024-11-18 19:26:05.377213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.377307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.936 [2024-11-18 19:26:05.377334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.377429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.377553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.377581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.377721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.377803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.377829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.377975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.378249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.378480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.378746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.378864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.378958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.379209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.379462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.379793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.379895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.380027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.380112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.380139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.380310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.380414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.380438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.380519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.380667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.380693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.380843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.381126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.381381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.381577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.381789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.381911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.382139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.382422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.382693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.382809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.382965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.383235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.383503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.383725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.383836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.384004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.384278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.384529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.937 qpair failed and we were unable to recover it. 00:27:46.937 [2024-11-18 19:26:05.384789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.937 [2024-11-18 19:26:05.384881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.384908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.385024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.385237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.385545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.385785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.385977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.386112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.386252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.386277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.386395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.386523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.386551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.386686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.386815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.386843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.386991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.387222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.387460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.387699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.387847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.388013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.388243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.388474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.388684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.388828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.388980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.389109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.389137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.389276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.389391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.389415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.389553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.389720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.389749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.389902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.390163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.390411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.390647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.390880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.390980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.391107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.391338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.391616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.391866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.391987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.392015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.392111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.392200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.392229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.938 qpair failed and we were unable to recover it. 00:27:46.938 [2024-11-18 19:26:05.392342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.938 [2024-11-18 19:26:05.392479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.392506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.392673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.392802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.392827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.392990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.393223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.393485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.393683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.393886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.393981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.394093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.394370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.394653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.394844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.394941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.395229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.395487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.395737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.395914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.396034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.396309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.396604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.396869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.396997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.397163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.397381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.397684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.397823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.397995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.398236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.398460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.939 qpair failed and we were unable to recover it. 00:27:46.939 [2024-11-18 19:26:05.398809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.939 [2024-11-18 19:26:05.398958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.399064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.399338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.399621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.399915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.399999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.400164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.400406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.400665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.400830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.400959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.401205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.401457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.401785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.401920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.402031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.402293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.402546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.402845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.402977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.403117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.403352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.403581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.403793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.403920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.404029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.404296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.404570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.404833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.404998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.405129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.405403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.405698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.405848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.405986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.406126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.406151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.406293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.406383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.406409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.940 qpair failed and we were unable to recover it. 00:27:46.940 [2024-11-18 19:26:05.406520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.940 [2024-11-18 19:26:05.406622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.406651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.406749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.406875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.406902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.407056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.407278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.407553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.407839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.407991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.408087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.408247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.408271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.408354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.408463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.408488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.408646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.408800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.408828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.408977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.409261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.409554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.409795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.409917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.410036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.410273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.410522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.410787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.410925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.411060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.411310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.411563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.411762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.411865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.411961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.412210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.412491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.412787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.412920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.413039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.413304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.413558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.413747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.413905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.941 qpair failed and we were unable to recover it. 00:27:46.941 [2024-11-18 19:26:05.414034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.941 [2024-11-18 19:26:05.414164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.414206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.414354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.414497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.414525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.414658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.414746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.414771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.414916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.415118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.415321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.415543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.415734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.415849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.416001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.416211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.416452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.416643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.416774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.416925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.417176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.417476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.417730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.417874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.417997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.418242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.418509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.418769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.418904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.419005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.419277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.419548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.419784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.419937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.420062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.420183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.420211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.420333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.420462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.420490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.420631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.420752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.420777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.420883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.421033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.421067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.942 [2024-11-18 19:26:05.421236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.421330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.942 [2024-11-18 19:26:05.421355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.942 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.421433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.421514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.421539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.421629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.421713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.421738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.421858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.421988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.422110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.422370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.422622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.422766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.422911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.423014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.423042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.423140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.423296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.423325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.423434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c9600 is same with the state(5) to be set 00:27:46.943 [2024-11-18 19:26:05.423620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.423790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.423825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.423977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.424277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.424621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.424826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.424971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.425056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.425248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.425513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.425780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.425920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.426007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.426288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.426542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.426801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.426950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.427035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.427303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.427566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.943 qpair failed and we were unable to recover it. 00:27:46.943 [2024-11-18 19:26:05.427847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.943 [2024-11-18 19:26:05.427931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.427958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.428085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.428230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.428255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.428373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.428480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.428505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.428593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.428747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.428774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.428875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.429145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.429426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.429678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.429843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.429966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.430205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.430414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.430686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.430801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.430920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.431194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.431396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.431633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.431859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.431995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.432130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.432227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.432255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.432363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.432491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.432518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.432659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.432774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.432799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.432903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.433167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.433415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.433678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.433791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.433910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.434220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.434470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.434751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.434912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.435033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.435186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.944 [2024-11-18 19:26:05.435211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.944 qpair failed and we were unable to recover it. 00:27:46.944 [2024-11-18 19:26:05.435339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.435422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.435448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.435538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.435675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.435704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.435827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.435912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.435939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.436037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.436280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.436594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.436868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.436991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.437110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.437349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.437624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.437772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.437907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.438220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.438472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.438695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.438840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.438957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.439169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.439430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.439689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.439831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.439958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.440200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.440397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.440641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.440791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.440905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.441132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.441393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.441598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.441771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.441900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.442033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.442062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.442163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.442254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.945 [2024-11-18 19:26:05.442284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.945 qpair failed and we were unable to recover it. 00:27:46.945 [2024-11-18 19:26:05.442377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.442470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.442498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.442612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.442704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.442730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.442839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.442972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.442999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.443165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.443297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.443324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.443445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.443539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.443566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.443686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.443767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.443792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.443906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.444186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.444513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.444747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.444872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.444990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.445261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.445592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.445855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.445961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.446062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.446272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.446542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.446771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.446910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.447025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.447312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.447586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.447785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.447919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.448024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.448284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.448505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.448765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.448897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.449069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.449206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.449235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.449327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.449457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.449485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.946 [2024-11-18 19:26:05.449677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.449792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.946 [2024-11-18 19:26:05.449817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.946 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.449935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.450145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.450385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.450640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.450785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.450873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.451124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.451395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.451699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.451802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.451972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.452326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.452620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.452838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.452971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.453079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.453279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.453530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.453745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.453851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.453934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.454204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.454574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.454838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.454980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.455111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.455329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.455553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.455780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.455947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.456089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.456234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.456259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.456365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.456445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.456473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.456601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.456764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.456789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.456878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.457024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.457049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.947 qpair failed and we were unable to recover it. 00:27:46.947 [2024-11-18 19:26:05.457186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.457305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.947 [2024-11-18 19:26:05.457333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.457453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.457580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.457616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.457723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.457836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.457862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.457945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.458240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.458460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.458735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.458871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.458955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.459263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.459537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.459775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.459914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.459997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.460208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.460463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.460738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.460908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.461063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.461300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.461571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.461807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.461939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.462069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.462300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.462542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.462783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.462939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.463059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.463172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.463196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.463293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.463436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.463463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.948 [2024-11-18 19:26:05.463551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.463656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.948 [2024-11-18 19:26:05.463684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.948 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.463822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.463920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.463945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.464056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.464308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.464603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.464828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.464987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.465119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.465395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.465594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.465850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.465972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.466114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.466334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.466533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.466779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.466921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.467051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.467139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.467168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.467339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.467484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.467509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.467639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.467791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.467816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.467948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.468232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.468474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.468718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.468837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.468968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.469243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.469457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.469722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.469848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.470015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.470252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.470533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.470788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.470926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.949 qpair failed and we were unable to recover it. 00:27:46.949 [2024-11-18 19:26:05.471024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.949 [2024-11-18 19:26:05.471134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.471290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.471573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.471835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.471992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.472088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.472250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.472278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.472414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.472559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.472585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.472688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.472797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.472823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.472964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.473258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.473476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.473709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.473870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.473955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.474168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.474403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.474656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.474767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.474926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.475212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.475478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.475732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.475896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.476041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.476196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.476223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.476385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.476491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.476517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.476655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.476751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.476781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.476938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.477178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.477444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.477738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.477901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.478026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.478171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.478196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.478296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.478383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.478411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.478509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.478597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.950 [2024-11-18 19:26:05.478632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.950 qpair failed and we were unable to recover it. 00:27:46.950 [2024-11-18 19:26:05.478749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.478867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.478893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.479035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.479252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.479548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.479834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.479963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.480121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.480377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.480604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.480913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.480995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.481160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.481390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.481684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.481849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.481944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.482222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.482468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.482792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.482908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.483026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.483170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.483199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.483322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.483459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.483489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.483661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.483752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.483778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.483915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.484238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.484492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.484721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.484893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.485025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.485323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.485596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.485868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.485998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.486028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.486165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.486284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.486310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.951 qpair failed and we were unable to recover it. 00:27:46.951 [2024-11-18 19:26:05.486420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.486503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.951 [2024-11-18 19:26:05.486530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.486624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.486716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.486742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.486867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.486999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.487184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.487532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.487802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.487925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.488070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.488371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.488624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.488844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.488976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.489101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.489390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.489629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.489813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.489941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.490203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.490411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.490663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.490889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.490996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.491155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.491471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.491702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.491836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.491974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.492277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.492558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.492773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.492927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.493086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.493252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.493282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.493387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.493504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.493529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.952 qpair failed and we were unable to recover it. 00:27:46.952 [2024-11-18 19:26:05.493619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.493734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.952 [2024-11-18 19:26:05.493759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.493899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.494228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.494527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.494794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.494921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.495024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.495271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.495505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.495752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.495869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.496015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.496270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.496543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.496820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.496942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.497063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.497332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.497632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.497863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.497985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.498070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.498356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.498590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:46.953 [2024-11-18 19:26:05.498868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.498984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.953 [2024-11-18 19:26:05.499019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:46.953 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.499125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.499240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.499279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.499429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.499529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.499557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.499691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.499796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.499821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.499913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.500163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.500398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.500637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.500766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.500854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.501154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.501399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.501634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.501867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.501992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.502020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.502148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.502272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.502300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.239 qpair failed and we were unable to recover it. 00:27:47.239 [2024-11-18 19:26:05.502410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.239 [2024-11-18 19:26:05.502490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.502516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.502631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.502751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.502777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.502860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.503156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.503423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.503718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.503857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.503978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.504257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.504526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.504784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.504923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.505004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.505245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.505552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.505804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.505964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.506090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.506180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.506208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.506342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.506488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.506515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.506659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.506780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.506805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.506944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.507233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.507508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.507773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.507916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.508011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.508127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.508152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.508330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.508429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.240 [2024-11-18 19:26:05.508458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.240 qpair failed and we were unable to recover it. 00:27:47.240 [2024-11-18 19:26:05.508593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.508724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.508751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.508875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.508960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.508985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.509079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.509348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.509598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.509851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.509976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.510129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.510362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.510614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.510853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.510981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.511114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.511365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.511574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.511811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.511957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.512059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.512149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.512177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.512345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.512483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.512511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.512653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.512749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.512774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.512909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.513155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.513445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.513737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.513850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.513989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.514144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.514173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.514278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.514373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.514401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.241 qpair failed and we were unable to recover it. 00:27:47.241 [2024-11-18 19:26:05.514532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.514645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.241 [2024-11-18 19:26:05.514689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.514779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.514870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.514912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.515023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.515308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.515526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.515801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.515909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.516068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.516163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.516193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.516290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.516418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.516446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.516612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.516736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.516762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.516909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.517160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.517423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.517723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.517879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.517965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.518233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.518507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.518736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.518885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.519028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.519237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.519482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.519784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.519909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.520038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.520162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.520190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.520315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.520412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.520455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.520624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.520759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.520784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.242 [2024-11-18 19:26:05.520916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.521007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.242 [2024-11-18 19:26:05.521035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.242 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.521151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.521252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.521280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.521385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.521501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.521526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.521638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.521765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.521794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.521889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.522150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.522407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.522626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.522760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.522855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.523171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.523442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.523742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.523859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.523998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.524240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.524496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.524765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.524879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.525002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.525245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.525528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.525809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.525977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.526088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.526164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.526189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.526349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.526438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.526466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.526569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.526740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.526766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.526882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.527171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.527432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.243 qpair failed and we were unable to recover it. 00:27:47.243 [2024-11-18 19:26:05.527755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.243 [2024-11-18 19:26:05.527844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.527870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.527981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.528294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.528529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.528760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.528897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.528999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.529318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.529569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.529856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.529977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.530088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.530282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.530553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.530818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.530966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.531043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.531295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.531531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.531761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.531924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.532017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.532112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.532139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.532276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.532353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.532378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.244 qpair failed and we were unable to recover it. 00:27:47.244 [2024-11-18 19:26:05.532470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.532639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.244 [2024-11-18 19:26:05.532682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.532800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.532929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.532957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.533072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.533281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.533504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.533800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.533900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.533997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.534255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.534523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.534805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.534949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.535059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.535321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.535573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.535840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.535980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.536112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.536347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.536619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.536779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.536909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.537182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.537466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.537699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.537839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.537947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.538248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.538536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.538812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.538948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.539068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.539211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.539236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.245 qpair failed and we were unable to recover it. 00:27:47.245 [2024-11-18 19:26:05.539426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.245 [2024-11-18 19:26:05.539560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.539588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.539723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.539814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.539839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.539962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.540250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.540530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.540829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.540950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.541070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.541258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.541524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.541805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.541919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.542010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.542241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.542568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.542826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.542976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.543112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.543265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.543297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.543425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.543538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.543563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.543673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.543836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.543864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.544007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.544274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.544566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.544794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.544957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.545122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.545216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.545241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.545371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.545498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.545526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.545627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.545743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.545771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.545879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.546022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.546047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.246 qpair failed and we were unable to recover it. 00:27:47.246 [2024-11-18 19:26:05.546192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.246 [2024-11-18 19:26:05.546323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.546351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.546449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.546537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.546565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.546691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.546772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.546797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.546896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.547124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.547360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.547587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.547855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.547985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.548130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.548366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.548571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.548882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.548999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.549095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.549236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.549265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.549357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.549455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.549484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.549643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.549765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.549791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.549907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.550162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.550460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.550683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.550847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.550946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.551208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.551428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.551734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.551918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.247 qpair failed and we were unable to recover it. 00:27:47.247 [2024-11-18 19:26:05.552056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.247 [2024-11-18 19:26:05.552167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.552296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.552565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.552822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.552924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.553004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.553206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.553428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.553619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.553842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.553955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.554069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.554306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.554549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.554756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.554858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.554960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.555197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.555407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.555638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.555838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.555966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.556129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.556356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.556581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.556847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.556988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.557125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.557223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.557251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.248 qpair failed and we were unable to recover it. 00:27:47.248 [2024-11-18 19:26:05.557381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.248 [2024-11-18 19:26:05.557505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.557532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.557673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.557791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.557816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.557949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.558224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.558504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.558742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.558859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.558960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.559156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.559387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.559644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.559849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.559995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.560116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.560318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.560527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.560741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.560850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.560977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.561232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.561434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.561662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.561808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.561933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.562160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.562421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.562665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.562865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.562991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.563016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.249 [2024-11-18 19:26:05.563115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.563200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.249 [2024-11-18 19:26:05.563226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.249 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.563331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.563418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.563443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.563541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.563666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.563692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.563778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.563885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.563917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.564016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.564238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.564492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.564743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.564850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.564967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.565189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.565389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.565573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.565807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.565958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.566039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.566282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.566511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.566746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.566891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.567005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.567231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.567431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.250 [2024-11-18 19:26:05.567684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.250 [2024-11-18 19:26:05.567819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.250 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.567910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.567995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.568163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.568399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.568602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.568802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.568906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.569057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.569257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.569491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.569764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.569884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.569966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.570201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.570434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.570719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.570835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.570955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.571148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.571379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.571605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.571840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.571988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.572099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.572338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.572624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.572869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.572991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.251 qpair failed and we were unable to recover it. 00:27:47.251 [2024-11-18 19:26:05.573115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.573202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.251 [2024-11-18 19:26:05.573228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.573311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.573394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.573419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.573566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.573662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.573688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.573782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.573937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.573962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.574082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.574356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.574613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.574852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.574980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.575124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.575329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.575548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.575830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.575976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.576106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.576303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.576499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.576780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.576892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.577009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.577228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.577441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.577657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.577798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.577926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.578249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.578482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.578746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.578895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.252 [2024-11-18 19:26:05.578998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.579141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.252 [2024-11-18 19:26:05.579167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.252 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.579293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.579406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.579432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.579542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.579661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.579688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.579786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.579868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.579892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.579977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.580173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.580408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.580624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.580819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.580927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.581041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.581252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.581474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.581689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.581840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.581954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.582202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.582502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.582811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.582974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.583062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.583305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.583560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.583751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.583913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.584010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.584237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.584543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.584774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.584951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.253 [2024-11-18 19:26:05.585047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.585139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.253 [2024-11-18 19:26:05.585164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.253 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.585307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.585411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.585436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.585561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.585718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.585743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.585855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.585947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.585971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.586088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.586294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.586521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.586801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.586940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.587065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.587207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.587231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.587317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.587411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.587443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.587555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.587760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.587787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.587918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.588173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.588448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.588825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.588956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.589057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.589323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.589590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.589849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.589964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.590060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.590292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.590501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.590727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.590873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.590991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.591220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.591481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.254 [2024-11-18 19:26:05.591717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.254 [2024-11-18 19:26:05.591834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.254 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.591925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.592171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.592404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.592623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.592854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.592973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.593066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.593298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.593586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.593822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.593959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.594046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.594286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.594533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.594761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.594871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.594951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.595211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.595444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.595681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.595885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.595983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.596065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.596154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.596179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.596319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.596441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.255 [2024-11-18 19:26:05.596465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.255 qpair failed and we were unable to recover it. 00:27:47.255 [2024-11-18 19:26:05.596551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.596649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.596674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.596765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.596860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.596886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.597000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.597264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.597544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.597821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.597972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.598064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.598303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.598557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.598823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.598922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.599040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.599295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.599531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.599742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.599863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.599960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.600190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.600463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.600715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.600829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.600979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.601227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.601440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.601682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.601875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.601983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.602007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.602092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.602184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.602210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.602300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.602413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.256 [2024-11-18 19:26:05.602448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.256 qpair failed and we were unable to recover it. 00:27:47.256 [2024-11-18 19:26:05.602565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.602737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.602764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.602879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.602989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.603135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.603384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.603583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.603737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.603881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.604207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.604446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.604735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.604870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.604985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.605203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.605493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.605723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.605856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.605939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.606133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.606385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.606652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.606798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.606919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.607202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.607461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.607693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.607851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.608001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.608263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.608501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.608763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.608872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.608992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.609283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.609511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.609847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.609966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.610093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.610207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.610232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.257 qpair failed and we were unable to recover it. 00:27:47.257 [2024-11-18 19:26:05.610353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.610440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.257 [2024-11-18 19:26:05.610465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.610616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.610695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.610719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.610816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.610938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.610963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.611075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.611278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.611505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.611745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.611875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.612021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.612273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.612503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.612704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.612824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.612953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.613179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.613421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.613681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.613830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.613923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.614131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.614338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.614516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.614736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.614835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.614960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.615156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.615460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.615693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.615858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.615953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.616240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.616443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.616682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.616850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.616955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.617203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.617413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.258 qpair failed and we were unable to recover it. 00:27:47.258 [2024-11-18 19:26:05.617680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.258 [2024-11-18 19:26:05.617763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.617789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.617912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.617997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.618135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.618357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.618579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.618863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.618981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.619122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.619327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.619512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.619760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.619900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.620002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.620297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.620567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.620851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.620996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.621113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.621360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.621624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.621829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.621963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.622090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.622237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.622262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.622391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.622512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.622537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.622679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.622791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.622822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.622949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.623189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.623452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.623706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.623846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.623968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.624052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.624077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.624166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.624264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.259 [2024-11-18 19:26:05.624289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.259 qpair failed and we were unable to recover it. 00:27:47.259 [2024-11-18 19:26:05.624366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.624493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.624518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.624636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.624753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.624778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.624913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.625166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.625390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.625583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.625851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.625965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.626103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.626338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.626616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.626870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.626987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.627134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.627400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.627605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.627866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.627985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.628098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.628320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.628627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.628775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.628901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.629019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.629044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.260 [2024-11-18 19:26:05.629162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.629251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.260 [2024-11-18 19:26:05.629277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.260 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.629402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.629484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.629508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.629627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.629719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.629743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.629861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.629939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.629963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.630057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.630343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.630544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.630768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.630869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.630989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.631311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.631603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.631845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.631955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.632073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.632302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.632522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.632747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.632859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.632957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.633172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.633362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.633584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.633831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.633938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.261 [2024-11-18 19:26:05.634019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.634099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.261 [2024-11-18 19:26:05.634123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.261 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.634212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.634330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.634356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.634480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.634587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.634637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.634733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.634841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.634866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.634957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.635067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.635097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.635214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.635343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.635368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.635480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.635560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.635584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Write completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 Read completed with error (sct=0, sc=8) 00:27:47.262 starting I/O failed 00:27:47.262 [2024-11-18 19:26:05.635929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:47.262 [2024-11-18 19:26:05.636031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.636183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.636212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.636307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.636473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.636517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.636669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.636752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.636783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.636912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.637176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.637417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.637675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.637814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.637902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.638048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.638073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.638166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.638247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.638273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.262 qpair failed and we were unable to recover it. 00:27:47.262 [2024-11-18 19:26:05.638383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.638504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.262 [2024-11-18 19:26:05.638529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.638642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.638766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.638791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.638878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.639184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.639458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.639670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.639817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.639937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.640204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.640456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.640695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.640850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.640974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.641244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.641536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.641824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.641965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.642172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.642439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.642732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.642965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.643084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.643199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.643233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.643377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.643504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.643531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.643675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.643787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.643812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.643933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.644017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.644043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.644134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.644253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.644279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.263 qpair failed and we were unable to recover it. 00:27:47.263 [2024-11-18 19:26:05.644408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.263 [2024-11-18 19:26:05.644555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.644581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.644675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.644791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.644817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.644902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.645193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.645413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.645669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.645813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.645947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.646217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.646510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.646769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.646917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.647065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.647322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.647563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.647845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.647964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.648058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.648300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.648548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.648784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.648904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.648989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.649200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.649427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.649733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.649847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.649986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.650107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.650134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.264 qpair failed and we were unable to recover it. 00:27:47.264 [2024-11-18 19:26:05.650257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.264 [2024-11-18 19:26:05.650363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.650396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.650520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.650651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.650676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.650767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.650905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.650929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.651070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.651338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.651605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.651844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.651959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.652096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.652373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.652653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.652801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.652910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.653163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.653429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.653749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.653864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.654025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.654266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.654570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.654793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.654937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.655069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.655302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.655598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.655809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.655914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.656032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.656193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.656225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.656404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.656532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.265 [2024-11-18 19:26:05.656561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.265 qpair failed and we were unable to recover it. 00:27:47.265 [2024-11-18 19:26:05.656748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.656832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.656857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.656974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.657262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.657512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.657786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.657945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.658058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.658330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.658623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.658856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.658969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.659097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.659361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.659619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.659862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.659979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.660137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.660485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.660740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.660927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.661032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.661160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.661188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.661394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.661521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.661549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.661717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.661811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.661837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.661946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.662086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.266 [2024-11-18 19:26:05.662111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.266 qpair failed and we were unable to recover it. 00:27:47.266 [2024-11-18 19:26:05.662203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.662345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.662388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.662539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.662686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.662711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.662826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.662949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.662973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.663075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.663311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.663568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.663878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.663999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.664108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.664304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.664537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.664777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.664899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.664995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.665257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.665532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.665751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.665863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.665975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.666204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.666477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.666701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.666825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.666934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.667182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.667428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.267 [2024-11-18 19:26:05.667673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.267 [2024-11-18 19:26:05.667782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.267 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.667898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.668195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.668393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.668664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.668882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.668999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.669139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.669385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.669721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.669877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.669963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.670250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.670530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.670781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.670884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.671000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.671244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.671479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.671708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.671829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.671924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.672150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.672409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.672682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.672900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.672999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.673113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.673344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.673564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.268 qpair failed and we were unable to recover it. 00:27:47.268 [2024-11-18 19:26:05.673778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.268 [2024-11-18 19:26:05.673858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.673882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.674009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.674244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.674455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.674677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.674903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.674986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.675129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.675336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.675572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.675804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.675921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.676008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.676293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.676485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.676784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.676906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.677014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.677268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.677573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.677770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.677880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.677991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.678070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.678095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.678184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.678905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.678936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.679101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.679365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.679633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.679870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.679978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.680066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.680144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.680168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.680296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.680413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.269 [2024-11-18 19:26:05.680438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.269 qpair failed and we were unable to recover it. 00:27:47.269 [2024-11-18 19:26:05.680523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.680637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.680662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.680759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.680843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.680868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.680955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.681149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.681410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.681671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.681876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.681987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.682081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.682309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.682512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.682828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.682999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.683157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.683349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.683374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.683487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.683585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.683617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.683705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.683788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.683814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.683911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.684204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.684743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.684859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.684970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.685235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.685506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.685723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.685831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.685928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.686043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.686086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.686213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.686354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.270 [2024-11-18 19:26:05.686382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.270 qpair failed and we were unable to recover it. 00:27:47.270 [2024-11-18 19:26:05.686515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.686653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.686688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.686788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.686877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.686919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.687132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.687247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.687275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.687374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.687464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.687492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.687621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.687739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.687765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.687882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.688164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.688421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.688698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.688851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.688960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.689248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.689556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.689770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.689939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.690076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.690173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.690202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.690379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.690492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.690534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.690626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.690756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.690781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.690869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.691216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.691463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.271 qpair failed and we were unable to recover it. 00:27:47.271 [2024-11-18 19:26:05.691751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.271 [2024-11-18 19:26:05.691866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.691957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.692241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.692542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.692811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.692943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.693076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.693299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.693561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.693829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.693973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.694136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.694407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.694702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.694824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.694967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.695112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.695141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.695286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.695385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.695413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.695534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.695655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.695698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.695899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.696220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.696500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.696754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.696921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.697019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.697221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.697553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.697787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.697930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.698029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.698147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.698175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.272 qpair failed and we were unable to recover it. 00:27:47.272 [2024-11-18 19:26:05.698315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.272 [2024-11-18 19:26:05.698455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.698483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.698649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.698763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.698788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.698864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.699274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.699576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.699816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.699990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.700149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.700438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.700769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.700898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.701072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.701205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.701231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.701372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.701506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.701535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.701646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.701779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.701806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.701956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.702255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.702506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.702778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.702883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.703008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.703294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.703547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.703790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.703910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.704033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.704117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.704142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.704233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.704330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.704355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.273 qpair failed and we were unable to recover it. 00:27:47.273 [2024-11-18 19:26:05.704466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.273 [2024-11-18 19:26:05.704572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.704597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.704711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.704804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.704830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.704965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.705226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.705431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.705697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.705846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.705992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.706274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.706551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.706769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.706935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.707082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.707338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.707534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.707768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.707990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.708107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.708226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.708250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.708364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.708482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.708507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.708600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.708743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.708770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.708901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.709196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.709490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.709764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.709902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.710011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.710142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.710167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.274 qpair failed and we were unable to recover it. 00:27:47.274 [2024-11-18 19:26:05.710286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.274 [2024-11-18 19:26:05.710377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.710402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.710493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.710576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.710602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.710714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.710834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.710859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.710941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.711187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.711405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.711595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.711845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.711963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.712056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.712282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.712489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.712739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.712857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.713005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.713214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.713444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.713734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.713849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.713937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.714219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.714446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.714710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.714863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.714953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.715197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.715453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.715742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.715849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.715942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.716092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.716117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.716213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.716298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.716324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.275 [2024-11-18 19:26:05.716418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.716496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.275 [2024-11-18 19:26:05.716520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.275 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.716639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.716731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.716756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.716853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.716980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.717098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.717293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.717516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.717765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.717935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.718029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.718235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.718498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.718742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.718860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.718955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.719181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.719396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.719612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.719864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.719968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.720086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.720270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.720464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.720706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.720857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.720972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.721210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.721459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.721693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.721801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.721925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.722018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.722044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.722124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.722210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.276 [2024-11-18 19:26:05.722237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.276 qpair failed and we were unable to recover it. 00:27:47.276 [2024-11-18 19:26:05.722322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.722441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.722466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.722552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.722671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.722697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.722787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.722865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.722894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.722985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.723263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.723492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.723752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.723862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.723971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.724198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.724464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.724683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.724821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.724942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.725151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.725378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.725645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.725797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.725916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.726153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.726386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.726619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.726841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.726955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.277 qpair failed and we were unable to recover it. 00:27:47.277 [2024-11-18 19:26:05.727074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.727187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.277 [2024-11-18 19:26:05.727212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.727290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.727401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.727426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.727553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.727680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.727711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.727798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.727887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.727913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.727990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.728201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.728456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.728745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.728863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.728965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.729160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.729381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.729603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.729823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.729934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.730025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.730262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.730455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.730694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.730808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.730912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.731209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.731490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.731738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.731876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.732016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.732204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.732441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.732702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.732895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.732993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.733018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.733116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.733232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.278 [2024-11-18 19:26:05.733257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.278 qpair failed and we were unable to recover it. 00:27:47.278 [2024-11-18 19:26:05.733348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.733422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.733447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.733529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.733644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.733671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.733787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.733873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.733898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.734013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.734199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.734462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.734683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.734862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.734984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.735189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.735434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.735681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.735822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.735944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.736145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.736394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.736618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.736849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.736991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.737166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.737419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.737645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.737889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.737999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.738116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.738330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.738561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.279 qpair failed and we were unable to recover it. 00:27:47.279 [2024-11-18 19:26:05.738777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.279 [2024-11-18 19:26:05.738927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.739038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.739256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.739467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.739704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.739841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.739926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.740187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.740392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.740613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.740861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.740973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.741097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.741290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.741515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.741719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.741834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.741927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.742194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.742424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.742688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.742795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.742942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.743170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.743434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.743742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.743891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.743979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.744074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.744100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.280 qpair failed and we were unable to recover it. 00:27:47.280 [2024-11-18 19:26:05.744226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.280 [2024-11-18 19:26:05.744348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.744373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.744468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.744589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.744623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.744747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.744836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.744863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.744984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.745176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.745454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.745676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.745819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.745937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.746141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.746333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.746605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.746872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.746990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.747085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.747322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.747578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.747819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.747934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.748061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.748339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.748561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.748809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.748921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.749012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.749262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.749510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.749780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.749900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.749995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.750102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.750127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.750251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.750339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.750364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.281 qpair failed and we were unable to recover it. 00:27:47.281 [2024-11-18 19:26:05.750456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.281 [2024-11-18 19:26:05.750537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.750561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.750689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.750774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.750799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.750883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.750997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.751115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.751372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.751617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.751841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.751941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.752060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.752268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.752526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.752733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.752898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.752987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.753223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.753411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.753654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.753846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.753962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.754048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.754307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.754569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.754768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.754877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.754999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.755286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.755526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.755794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.755930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.282 [2024-11-18 19:26:05.756013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.756098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.282 [2024-11-18 19:26:05.756123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.282 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.756205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.756414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.756668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.756868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.756985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.757101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.757336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.757535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.757790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.757938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.758036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.758321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.758563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.758785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.758953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.759038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.759287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.759519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.759727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.759870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.759963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.760224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.760427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.760696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.760837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.760932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.761143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.761404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.283 [2024-11-18 19:26:05.761655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.283 [2024-11-18 19:26:05.761767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.283 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.761922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.762148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.762378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.762602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.762841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.762959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.763050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.763294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.763586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.763829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.763932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.764015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.764286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.764543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.764747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.764889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.765016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.765243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.765480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.765767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.765882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.765973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.766232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.766482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.766691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.766841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.766926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.767125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.767388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.767590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.767885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.767997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.768022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.284 qpair failed and we were unable to recover it. 00:27:47.284 [2024-11-18 19:26:05.768138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.284 [2024-11-18 19:26:05.768229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.768254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.768365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.768470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.768495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.768590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.768743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.768769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.768905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.769134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.769386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.769621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.769822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.769965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.770089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.770329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.770625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.770866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.770982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.771127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.771348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.771548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.771745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.771890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.771972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.772197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.772405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.772604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.772846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.772995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.773093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.773325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.773588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.773883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.773998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.774114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.774204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.774230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.774347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.774462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.774489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.285 qpair failed and we were unable to recover it. 00:27:47.285 [2024-11-18 19:26:05.774585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.285 [2024-11-18 19:26:05.774711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.774737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.774822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.774903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.774928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.775025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.775228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.775422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.775647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.775844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.775984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.776061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.776265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.776496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.776739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.776881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.777027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.777257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.777487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.777701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.777857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.777939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.778133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.778366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.778571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.778821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.778964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.779091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.779323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.779583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.779850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.779986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.780077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.780308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.780506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.780769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.780904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.780995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.781203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.781436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.781678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.781828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.286 qpair failed and we were unable to recover it. 00:27:47.286 [2024-11-18 19:26:05.781950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.286 [2024-11-18 19:26:05.782032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.782189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.782444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.782823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.782929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.783180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.783444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.783661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.783890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.783998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.784123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.784329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.784555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.784824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.784945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.785032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.785259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.785497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.785763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.785876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.785962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.786163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.786390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.786577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.786885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.786980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.787005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.787131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.787226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.787252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.787341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.787457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.787482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.287 qpair failed and we were unable to recover it. 00:27:47.287 [2024-11-18 19:26:05.787613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.287 [2024-11-18 19:26:05.787707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.787733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.787815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.787930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.787956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.788079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.788360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.788595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.788804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.788947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.789098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.789331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.789569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.789833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.789965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.790109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.790375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.790637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.790827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.790961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.791053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.791279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.791503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.791745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.791854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.791952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.792243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.792468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.792742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.792910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.793031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.793257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.793521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.793723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.793864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.794010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.794241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.794533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.794731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.288 [2024-11-18 19:26:05.794841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.288 qpair failed and we were unable to recover it. 00:27:47.288 [2024-11-18 19:26:05.794939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.795167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.795381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.795629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.795870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.795984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.796094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.796350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.796614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.796913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.796999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.797118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.797313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.797561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.797807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.797924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.798043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.798267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.798487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.798739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.798882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.798972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.799267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.799529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.799738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.799873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.800024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.800207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.800438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.800663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.800833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.800980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.801194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.801385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.801656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.801853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.801958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.802046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.802167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.802192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.289 [2024-11-18 19:26:05.802306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.802399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.289 [2024-11-18 19:26:05.802424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.289 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.802524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.802637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.802663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.802784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.802892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.802916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.803007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.803250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.803444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.803675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.803820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.803956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.804225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.804432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.804676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.804842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.804930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.805188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.805420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.805707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.805850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.805966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.806222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.806432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.806667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.806889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.806999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.807117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.807332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.807554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.807768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.807880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.807961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.808253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.808482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.808709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.808821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.808939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.809202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.809416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.290 qpair failed and we were unable to recover it. 00:27:47.290 [2024-11-18 19:26:05.809660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.290 [2024-11-18 19:26:05.809803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.809897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.810145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.810331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.810583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.810831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.810938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.811026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.811264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.811563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.811765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.811885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.811988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.812202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.812445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.812681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.812799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.812925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.813120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.813343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.813538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.813749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.813863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.813954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.814220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.814450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.814688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.814824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.814915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.815028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.815055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.815138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.815225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.815250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.291 qpair failed and we were unable to recover it. 00:27:47.291 [2024-11-18 19:26:05.815367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.815476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.291 [2024-11-18 19:26:05.815501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.815634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.815733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.815765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.815892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.816146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.816483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.816722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.816841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.816941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.817144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.817407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.817694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.817849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.817982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.818259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.818521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.818819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.818959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.819059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.819272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.819514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.819755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.819883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.820010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.820099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.820127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.820261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.820383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.820409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.820533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.820659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.576 [2024-11-18 19:26:05.820688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.576 qpair failed and we were unable to recover it. 00:27:47.576 [2024-11-18 19:26:05.820790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.820929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.820965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.821081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.821400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.821668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.821875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.821984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.822106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.822327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.822558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.822835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.822989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.823106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.823379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.823651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.823868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.823989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.824135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.824330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.824599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.824864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.824989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.825091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.825359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.825576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.825858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.825985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.826137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.826265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.826291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.826398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.826496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.826522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.826631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.826750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.826775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.826879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.827161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.827429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.827682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.827796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.577 qpair failed and we were unable to recover it. 00:27:47.577 [2024-11-18 19:26:05.827893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.577 [2024-11-18 19:26:05.828008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.828185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.828463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.828734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.828852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.828972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.829215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.829472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.829753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.829893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.830061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.830328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.830586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.830819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.830963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.831069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.831219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.831245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.831394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.831517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.831550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.831699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.831789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.831818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.831949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.832230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.832429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.832738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.832865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.832968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.833215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.833468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.833738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.833854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.833954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.834222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.834447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.834732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.834863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.834981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.835103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.835128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.835277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.835407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.578 [2024-11-18 19:26:05.835434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.578 qpair failed and we were unable to recover it. 00:27:47.578 [2024-11-18 19:26:05.835550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.835636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.835662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.835790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.835915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.835946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.836038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.836287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.836565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.836826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.836971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.837125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.837373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.837605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.837843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.837991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.838127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.838346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.838582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.838841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.838963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.839058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.839305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.839556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.839817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.839959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.840073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.840196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.840222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.840324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.840471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.840503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.840597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.840730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.840759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.840886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.841177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.841437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.841733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.841886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.842106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.842375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.842599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.579 qpair failed and we were unable to recover it. 00:27:47.579 [2024-11-18 19:26:05.842838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.842980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.579 [2024-11-18 19:26:05.843005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.843092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.843289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.843539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.843810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.843948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.844034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.844263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.844480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.844748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.844847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.844939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.845139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.845424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.845653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.845886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.845988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.846080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.846396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.846626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.846847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.846960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.847070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.847313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.847570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.847815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.847958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.848073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.848189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.848215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.848324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.848435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.848460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.580 qpair failed and we were unable to recover it. 00:27:47.580 [2024-11-18 19:26:05.848585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.848712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.580 [2024-11-18 19:26:05.848739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.848857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.848941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.848966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.849081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.849350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.849582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.849828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.849960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.850060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.850310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.850637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.850876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.850995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.851129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.851350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.851645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.851852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.851990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.852112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.852342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.852567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.852793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.852937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.853049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.853256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.853502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.853711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.853845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.853958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.854147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.854173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.854288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.854433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.854458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.854621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.854812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.854837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.854983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.855205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.855456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.855722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.855898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.581 qpair failed and we were unable to recover it. 00:27:47.581 [2024-11-18 19:26:05.855981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.581 [2024-11-18 19:26:05.856098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.856239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.856478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.856743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.856848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.856970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.857223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.857445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.857630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.857857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.857965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.858044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.858289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.858505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.858738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.858901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.859024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.859246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.859525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.859778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.859883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.859996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.860182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.860422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.860724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.860864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.860982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.861196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.861489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.861753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.861858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.861971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.862274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.862550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.582 [2024-11-18 19:26:05.862788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.582 [2024-11-18 19:26:05.862888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.582 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.863033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.863259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.863526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.863772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.863904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.864003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.864233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.864480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.864726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.864862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.864987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.865176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.865437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.865701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.865818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.865940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.866166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.866389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.866677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.866900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.866981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.867156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.867389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.867641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.867877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.867986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.868126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.868400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.868699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.868833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.868925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.869222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.869479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.869713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.869817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.583 qpair failed and we were unable to recover it. 00:27:47.583 [2024-11-18 19:26:05.869935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.870016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.583 [2024-11-18 19:26:05.870040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.870158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.870275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.870300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.870423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.870529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.870554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.870673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.870791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.870815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.870911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.871157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.871376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.871679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.871887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.871997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.872111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.872364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.872583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.872845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.872975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.873119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.873386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.873638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.873877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.873994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.874143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.874447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.874693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.874837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.874950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.875186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.875456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.875715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.875883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.876003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.876227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.876468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.876776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.876923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.877036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.877142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.877167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.584 qpair failed and we were unable to recover it. 00:27:47.584 [2024-11-18 19:26:05.877255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.584 [2024-11-18 19:26:05.877379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.877426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.877515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.877630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.877669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.877782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.877897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.877923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.878034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.878286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.878479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.878755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.878873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.879016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.879295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.879555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.879774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.879904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.880034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.880301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.880539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.880795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.880929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.881038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.881264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.881580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.881895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.881986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.882134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.882430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.882672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.882845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.882994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.883104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.883128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.883248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.883333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.883358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.883475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.883557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.585 [2024-11-18 19:26:05.883583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.585 qpair failed and we were unable to recover it. 00:27:47.585 [2024-11-18 19:26:05.883690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.883816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.883842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.883965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.884272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.884519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.884757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.884892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.885005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.885268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.885513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.885773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.885885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.885974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.886217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.886470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.886738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.886855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.887001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.887203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.887448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.887694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.887806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.887946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.888171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.888456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.888716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.888826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.888909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.889137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.889355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.889620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.889758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.889885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.890198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.890423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.586 [2024-11-18 19:26:05.890639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.586 [2024-11-18 19:26:05.890740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.586 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.890855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.890973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.890999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.891086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.891320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.891571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.891803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.891935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.892015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.892237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.892508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.892762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.892894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.892985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.893247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.893485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.893739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.893850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.893973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.894186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.894406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.894651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.894872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.894978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.895089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.895299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.895592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.895857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.895978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.896122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.896353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.896589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.896854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.896960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.897059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.897143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.897167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.897256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.897371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.897395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.587 qpair failed and we were unable to recover it. 00:27:47.587 [2024-11-18 19:26:05.897512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.587 [2024-11-18 19:26:05.897614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.897640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.897737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.897851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.897875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.897964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.898159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.898427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.898734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.898866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.898959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.899215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.899481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.899742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.899853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.900002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.900266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.900454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.900704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.900834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.900944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.901126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.901344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.901587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.901870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.901987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.902114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.902372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.902577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.902790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.902922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.903010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.903249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.903436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.903723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.903863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.903979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.904059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.904084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.904198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.904336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.588 [2024-11-18 19:26:05.904360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.588 qpair failed and we were unable to recover it. 00:27:47.588 [2024-11-18 19:26:05.904472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.904584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.904617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.904745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.904825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.904850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.904977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.905172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.905411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.905663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.905829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.905952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.906187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.906417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.906665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.906809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.906930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.907166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.907431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.907724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.907842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.907972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.908230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.908498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.908768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.908920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.909047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.909331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.909573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.909830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.909978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.910105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.910360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.910614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.910867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.910976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.911108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.911232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.911257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.911358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.911441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.911466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.911590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.911690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.589 [2024-11-18 19:26:05.911716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.589 qpair failed and we were unable to recover it. 00:27:47.589 [2024-11-18 19:26:05.911835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.911943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.911969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.912067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.912311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.912531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.912767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.912920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.913043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.913290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.913504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.913734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.913901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.914028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.914257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.914482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.914826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.914977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.915073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.915220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.915250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.915377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.915527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.915553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.915684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.915782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.915808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.915939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.916218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.916465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.916745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.916894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.916993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.917211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.917467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.917764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.917935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.918087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.918236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.918263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.590 qpair failed and we were unable to recover it. 00:27:47.590 [2024-11-18 19:26:05.918388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.590 [2024-11-18 19:26:05.918541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.918567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.918696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.918815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.918841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.918956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.919250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.919574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.919854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.919976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.920126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.920349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.920591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.920878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.920989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.921111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.921381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.921617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.921821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.921965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.922088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.922326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.922556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.922790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.922962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.923061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.923340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.923586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.923849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.923955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.924054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.924320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.924553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.924801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.924924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.925044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.925130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.925157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.925287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.925438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.925463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.591 [2024-11-18 19:26:05.925558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.925738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.591 [2024-11-18 19:26:05.925768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.591 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.925875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.925997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.926120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.926353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.926628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.926861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.926980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.927096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.927328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.927559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.927820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.927956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.928073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.928354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.928602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.928855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.928977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.929096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.929299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.929585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.929837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.929985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.930076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.930298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.930531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.930813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.930978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.931097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.931298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.931533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.931752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.931874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.932000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.932240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.932448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.592 qpair failed and we were unable to recover it. 00:27:47.592 [2024-11-18 19:26:05.932717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.592 [2024-11-18 19:26:05.932807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.932834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.932927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.933239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.933442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.933720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.933841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.933969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.934174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.934369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.934628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.934874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.934983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.935128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.935389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.935775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.935898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.936015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.936271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.936463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.936698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.936904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.936987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.937102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.937338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.937564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.937801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.937953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.938069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.938318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.938527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.938807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.938932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.939032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.939119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.939144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.939237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.939352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.939377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.593 [2024-11-18 19:26:05.939489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.939574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.593 [2024-11-18 19:26:05.939600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.593 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.939690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.939775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.939800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.939956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.940215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.940443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.940739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.940898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.941015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.941246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.941447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.941669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.941840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.941927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.942173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.942390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.942682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.942801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.942892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.943138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.943382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.943619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.943876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.943993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.944109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.944325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.944526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.944766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.944879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.944965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.945039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.945064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.945182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.945274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.594 [2024-11-18 19:26:05.945303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.594 qpair failed and we were unable to recover it. 00:27:47.594 [2024-11-18 19:26:05.945406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.945486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.945511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.945625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.945725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.945751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.945867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.945973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.945998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.946088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.946336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.946525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.946737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.946851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.946968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.947226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.947459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.947678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.947792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.947892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.948134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.948423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.948694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.948843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.948958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.949181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.949409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.949674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.949877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.949989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.950077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.950352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.950559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.950794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.950939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.951032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.951298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.951533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.951765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.951919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.595 qpair failed and we were unable to recover it. 00:27:47.595 [2024-11-18 19:26:05.952042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.952122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.595 [2024-11-18 19:26:05.952148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.952273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.952369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.952394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.952485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.952601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.952632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.952719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.952837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.952864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.952978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.953216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.953502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.953781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.953892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.953979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.954179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.954426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.954702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.954904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.954989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.955133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.955402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.955649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.955796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.955943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.956154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.956362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.956604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.956883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.956995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.957108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.957347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.957570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.957812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.957949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.958040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.958236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.958488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.958709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.596 [2024-11-18 19:26:05.958898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.596 qpair failed and we were unable to recover it. 00:27:47.596 [2024-11-18 19:26:05.959024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.959273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.959527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.959772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.959942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.960048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.960169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.960198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.960372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.960500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.960528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.960665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.960772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.960798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.960945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.961242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.961528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.961781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.961902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.962061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.962188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.962215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.962327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.962437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.962462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.962597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.962729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.962757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.962920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.963146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.963377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.963673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.963791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.963876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.964202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.964470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.964737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.964890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.965000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.965296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.965531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.965792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.965922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.966065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.966158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.966186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.966298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.966426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.966453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.597 qpair failed and we were unable to recover it. 00:27:47.597 [2024-11-18 19:26:05.966577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.966747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.597 [2024-11-18 19:26:05.966773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.966899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.967201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.967483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.967745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.967899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.968038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.968245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.968524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.968793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.968903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.969018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.969254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.969490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.969747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.969853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.969953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.970175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.970398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.970675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.970823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.970915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.971181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.971466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.971709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.971903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.971987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.972128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.972364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.972603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.972834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.972945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.973036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.973179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.973205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.973290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.973413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.973439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.973552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.973644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.598 [2024-11-18 19:26:05.973671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.598 qpair failed and we were unable to recover it. 00:27:47.598 [2024-11-18 19:26:05.973764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.973880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.973906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.974017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.974253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.974488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.974736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.974850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.974943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.975164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.975453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.975667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.975873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.975983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.976103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.976328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.976513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.976722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.976827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.976917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.977180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.977367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.977602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.977877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.977998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.978118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.978301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.978499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.978718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.978839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.978920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.979038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.979063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.599 [2024-11-18 19:26:05.979165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.979258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.599 [2024-11-18 19:26:05.979283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.599 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.979376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.979462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.979487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.979579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.979680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.979707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.979798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.979917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.979943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.980064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.980288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.980523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.980737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.980848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.980966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.981206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.981498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.981741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.981887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.982007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.982262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.982466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.982769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.982879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.982971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.983179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.983426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.983676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.983811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.983904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.984171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.984375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.984592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.984868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.984986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.985099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.985294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.985531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.985768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.985881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.600 qpair failed and we were unable to recover it. 00:27:47.600 [2024-11-18 19:26:05.985963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.600 [2024-11-18 19:26:05.986049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.986163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.986428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.986629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.986884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.986995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.987138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.987387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.987677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.987893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.987977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.988089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.988342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.988577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.988816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.988933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.989032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.989276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.989507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.989747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.989861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.989956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.990182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.990379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.990620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.990827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.990940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.991088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.991280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.991476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.991727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.991843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.991926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.992010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.992035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.992159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.992254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.992281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.601 [2024-11-18 19:26:05.992401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.992483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.601 [2024-11-18 19:26:05.992508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.601 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.992601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.992715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.992740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.992853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.992933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.992958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.993110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.993361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.993593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.993862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.993975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.994087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.994284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.994498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.994735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.994845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.994936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.995191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.995408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.995596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.995849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.995984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.996108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.996317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.996555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.996780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.996886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.996998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.997199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.997459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.997666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.997803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.997924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.998151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.998420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.998619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.998856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.998998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.602 qpair failed and we were unable to recover it. 00:27:47.602 [2024-11-18 19:26:05.999085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.602 [2024-11-18 19:26:05.999161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:05.999305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:05.999524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:05.999716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:05.999837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:05.999922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.000115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.000356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.000659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.000887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.000994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.001165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.001393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.001585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.001787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.001930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.002018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.002246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.002441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.002725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.002932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.003116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.003245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.003273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.003402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.003558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.003587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.003726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.003878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.003907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.004074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.004337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.004596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.004825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.004971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.005066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.005179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.603 [2024-11-18 19:26:06.005204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.603 qpair failed and we were unable to recover it. 00:27:47.603 [2024-11-18 19:26:06.005292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.005383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.005408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.005520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.005628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.005654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.005755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.005869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.005895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.005985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.006169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.006374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.006627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.006885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.006990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.007126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.007333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.007520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.007758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.007901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.008025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.008222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.008461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.008822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.008942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.009087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.009211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.009253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.009394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.009497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.009540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.009686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.009779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.009804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.009918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.010145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.010333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.010623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.010881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.010998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.011153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.011385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.011677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.011876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.011980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.604 qpair failed and we were unable to recover it. 00:27:47.604 [2024-11-18 19:26:06.012096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.604 [2024-11-18 19:26:06.012170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.012316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.012547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.012762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.012897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.013015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.013245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.013562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.013843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.013977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.014120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.014230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.014255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.014336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.014479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.014504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.014630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.014753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.014780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.014885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.015141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.015347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.015613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.015764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.015888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.016122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.016358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.016633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.016909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.016992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.017143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.017433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.017658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.017802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.017896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.018116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.018379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.018680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.018913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.018996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.019021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.605 qpair failed and we were unable to recover it. 00:27:47.605 [2024-11-18 19:26:06.019139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.605 [2024-11-18 19:26:06.019254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.019279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.019397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.019517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.019541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.019659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.019779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.019804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.019891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.020122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.020358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.020619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.020767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.020919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.021183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.021441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.021741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.021897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.022020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.022249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.022453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.022777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.022941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.023126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.023250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.023278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.023499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.023642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.023674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.023780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.023897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.023925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.024022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.024263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.024482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.024751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.024866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.024990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.025227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.025431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.025802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.025913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.025997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.026142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.026172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.026284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.026401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.026426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.606 qpair failed and we were unable to recover it. 00:27:47.606 [2024-11-18 19:26:06.026540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.026678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.606 [2024-11-18 19:26:06.026704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.026863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.026952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.026979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.027096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.027182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.027209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.027308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.027395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.027421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.027589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.027756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.027783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.027912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.028177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.028403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.028668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.028835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.028986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.029193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.029417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.029726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.029931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.030096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.030347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.030622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.030846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.030988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.031111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.031198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.031223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.031337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.031479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.031504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.031661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.031779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.031804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.031968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.032176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.032457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.032760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.032948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.033137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.033325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.033354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.033519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.033652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.033679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.033799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.033908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.033933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.034060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.034181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.034207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.034327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.034408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.034433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.607 qpair failed and we were unable to recover it. 00:27:47.607 [2024-11-18 19:26:06.034527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.607 [2024-11-18 19:26:06.034613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.034639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.034725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.034810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.034836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.034953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.035202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.035453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.035746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.035880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.036024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.036234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.036489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.036785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.036907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.037034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.037302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.037536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.037796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.037901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.038046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.038305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.038530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.038797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.038928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.039077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.039291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.039598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.039904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.039982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.040153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.040337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.040600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.608 qpair failed and we were unable to recover it. 00:27:47.608 [2024-11-18 19:26:06.040837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.608 [2024-11-18 19:26:06.040920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.040945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.041072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.041269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.041507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.041750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.041887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.041981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.042249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.042484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.042807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.042946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.043041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.043279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.043555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.043752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.043862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.043956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.044219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.044517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.044812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.044961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.045098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.045287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.045329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.045414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.045559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.045585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.045707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.045809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.045842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.045976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.046237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.046526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.046774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.046930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.047070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.047199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.047226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.047405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.047540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.047568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.047715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.047806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.047831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.047929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.048032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.048062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.609 [2024-11-18 19:26:06.048169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.048304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.609 [2024-11-18 19:26:06.048331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.609 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.048492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.048647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.048689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.048797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.048883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.048926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.049032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.049197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.049225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.049348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.049498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.049526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.049669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.049754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.049779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.049925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.050115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.050370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.050604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.050843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.050982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.051140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.051461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.051732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.051892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.051992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.052318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.052630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.052897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.052999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.053193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.053480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.053758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.053913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.054020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.054237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.054466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.054765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.054865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.054975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.055247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.055558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.055802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.055911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.610 qpair failed and we were unable to recover it. 00:27:47.610 [2024-11-18 19:26:06.055994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.056069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.610 [2024-11-18 19:26:06.056110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.056309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.056404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.056432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.056555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.056676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.056702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.056793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.056885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.056928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.057042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.057290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.057573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.057848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.057991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.058124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.058382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.058635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.058905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.058994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.059124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.059439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.059732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.059870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.060014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.060271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.060535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.060848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.060984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.061100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.061327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.061559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.061812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.061951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.062121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.062210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.062238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.062365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.062459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.062487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.062654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.062770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.062796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.062907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.063135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.063417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.611 qpair failed and we were unable to recover it. 00:27:47.611 [2024-11-18 19:26:06.063696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.611 [2024-11-18 19:26:06.063785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.063811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.063908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.064175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.064383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.064700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.064840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.064924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.065191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.065447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.065737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.065861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.065991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.066229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.066473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.066814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.066926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.067044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.067259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.067484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.067711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.067842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.067971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.068212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.068553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.068814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.068954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.069145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.069262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.069288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.069428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.069529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.069557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.069689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.069810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.069836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.069942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.070214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.070503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.070734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.070892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.612 [2024-11-18 19:26:06.070992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.071107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.612 [2024-11-18 19:26:06.071135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.612 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.071260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.071372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.071397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.071528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.071649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.071678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.071842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.071976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.072133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.072408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.072734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.072886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.073058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.073327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.073567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.073805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.073909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.074026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.074135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.074160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.074289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.074446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.074473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.074639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.074775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.074804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.074904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.075194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.075537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.075748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.075872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.075993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.076221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.076508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.076850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.076969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.077090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.077201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.077226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.077326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.077449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.077479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.077629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.077800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.077829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.613 [2024-11-18 19:26:06.078019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.078114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.613 [2024-11-18 19:26:06.078140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.613 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.078229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.078339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.078365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.078486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.078615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.078660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.078786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.078948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.078973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.079099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.079217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.079243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.079337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.079457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.079483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.079590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.079765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.079795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.079937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.080095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.080120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.080240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.080365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.080390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.080521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.080653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.080683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.080843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.081167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.081411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.081687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.081877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.082059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.082156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.082186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.082353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.082470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.082496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.082592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.082725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.082766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.082908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.083128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.083156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.083323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.083444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.083470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.083600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.083729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.083758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.083883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.084180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.084446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.084732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.084888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.085031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.085152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.085180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.085321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.085408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.085433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.085524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.085662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.085692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.085883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.086012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.086040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.086172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.086295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.086322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.614 qpair failed and we were unable to recover it. 00:27:47.614 [2024-11-18 19:26:06.086470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.614 [2024-11-18 19:26:06.086555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.086581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.086732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.086907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.086935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.087093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.087216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.087245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.087353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.087437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.087463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.087581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.087735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.087764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.087875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.088068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.088098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.088202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.088357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.088382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.088534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.088693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.088723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.088880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.089190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.089441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.089717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.089898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.090057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.090283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.090312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.090426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.090541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.090567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.090717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.090862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.090891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.091010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.091227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.091255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.091372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.091451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.091476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.091565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.091658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.091684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.091824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.092169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.092403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.092736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.092935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.093033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.093396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.093654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.093857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.093975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.094089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.094336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.615 [2024-11-18 19:26:06.094560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.615 [2024-11-18 19:26:06.094684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.615 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.094780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.094897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.094929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.095049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.095345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.095619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.095827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.095975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.096063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.096339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.096561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.096809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.096976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.097064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.097156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.097183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.097298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.097457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.097491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.097588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.097737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.097763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.097921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.098143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.098421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.098680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.098853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.098946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.099175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.099400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.099623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.099764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.099877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.100151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.100444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.100663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.100835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.100931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.101220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.101532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.101841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.101991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.616 qpair failed and we were unable to recover it. 00:27:47.616 [2024-11-18 19:26:06.102086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.616 [2024-11-18 19:26:06.102240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.102265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.102386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.102529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.102554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.102676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.102794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.102820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.102924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.103191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.103476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.103726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.103894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.104041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.104307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.104584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.104903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.104983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.105131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.105400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.105653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.105769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.105889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.106140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.106460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.106754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.106904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.106994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.107260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.107496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.107765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.107910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.108038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.108122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.108148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.108305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.108407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.108437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.617 [2024-11-18 19:26:06.108597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.108704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.617 [2024-11-18 19:26:06.108729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.617 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.108844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.108960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.108985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.109103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.109358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.109583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.109841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.109983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.110135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.110388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.110739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.110948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.111114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.111257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.111285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.111440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.111547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.111590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.111736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.111855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.111881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.112029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.112235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.112468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.112658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.112830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.112926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.113126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.113339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.113621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.113833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.113982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.114073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.114309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.114537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.114818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.114989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.115116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.115243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.115269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.115422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.115544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.115569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.115702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.115797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.115825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.115946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.116063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.116090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.116199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.116330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.116359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.618 [2024-11-18 19:26:06.116448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.116537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.618 [2024-11-18 19:26:06.116564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.618 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.116711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.116805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.116830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.116936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.117184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.117410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.117669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.117891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.117974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.118147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.118385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.118653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.118798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.118918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.119236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.119518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.119729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.119907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.120034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.120276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.120570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.120809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.120955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.121043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.121291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.121558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.121807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.121914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.121995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.122216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.122479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.122710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.122851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.122973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.123211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.123480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.123774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.123923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.124011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.124152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.124178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.619 [2024-11-18 19:26:06.124301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.124415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.619 [2024-11-18 19:26:06.124440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.619 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.124558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.124717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.124747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.124925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.125195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.125457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.125726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.125871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.125964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.126224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.126492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.126733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.126873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.126967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.127244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.127504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.127734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.127879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.127971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.128217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.128481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.128736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.128848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.128968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.129246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.129571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.129831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.129982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.130208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.130475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.130748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.130909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.131006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.131269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.131485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.131724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.131863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.131951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.132064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.132088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.132207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.132296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.132321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.620 qpair failed and we were unable to recover it. 00:27:47.620 [2024-11-18 19:26:06.132412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.132522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.620 [2024-11-18 19:26:06.132547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.132644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.132730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.132754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.132842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.132961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.132986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.133072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.133189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.133213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.133329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.133443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.133468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.133591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.133731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.133758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.133890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.134128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.134358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.134639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.134756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.134904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.135211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.135432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.135692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.135887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.136016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.136306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.136564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.136826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.136942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.137098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.137362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.137588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.137827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.137967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.138049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.138274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.138540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.138804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.138914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.139071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.139327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.139564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.621 qpair failed and we were unable to recover it. 00:27:47.621 [2024-11-18 19:26:06.139775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.621 [2024-11-18 19:26:06.139919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.139943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.140078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.140212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.140236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.140392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.140485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.140510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.140597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.140713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.140738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.140886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.141194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.141436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.141639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.141897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.141991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.142145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.142371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.142605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.142902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.142979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.143118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.143319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.143545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.143806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.143922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.144012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.144257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.144503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.144735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.144839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.144953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.145048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.145075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.622 [2024-11-18 19:26:06.145225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.145336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.622 [2024-11-18 19:26:06.145363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.622 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.145482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.145565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.145591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.145750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.145835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.145860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.145978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.146211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.146441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.146722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.146856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.146955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.147182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.147465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.147702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.147824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.147921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.148198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.148453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.148712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.148881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.149001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.149117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.149142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.149264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.149411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.149437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.149565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.149736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.149786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.149928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.150223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.150430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.150716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.150865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.151021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.151300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.151535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.151854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.151959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.152114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.152419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.152673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.623 [2024-11-18 19:26:06.152872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.623 qpair failed and we were unable to recover it. 00:27:47.623 [2024-11-18 19:26:06.153015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.153232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.153260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.624 qpair failed and we were unable to recover it. 00:27:47.624 [2024-11-18 19:26:06.153397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.153536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.153561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.624 qpair failed and we were unable to recover it. 00:27:47.624 [2024-11-18 19:26:06.153677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.153791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.153834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.624 qpair failed and we were unable to recover it. 00:27:47.624 [2024-11-18 19:26:06.153960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.154134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.624 [2024-11-18 19:26:06.154161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.624 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.154292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.154372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.154397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.154475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.154551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.154576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.154692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.154849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.154877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.154998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.155299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.155586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.155857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.155993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.156105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.156218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.156243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.156335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.156425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.156451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.156549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.156676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.156705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.156825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.157137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.157383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.157638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.157759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.157907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.158141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.158388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.158613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.158835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.158968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.159082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.159337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.159594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.906 qpair failed and we were unable to recover it. 00:27:47.906 [2024-11-18 19:26:06.159866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.906 [2024-11-18 19:26:06.159947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.159972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.160091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.160205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.160230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.160320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.160466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.160491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.160612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.160715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.160743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.160874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.161182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.161443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.161667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.161873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.162006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.162275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.162505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.162801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.162980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.163161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.163422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.163674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.163927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.164124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.164220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.164248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.164348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.164426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.164452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.164579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.164714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.164743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.164893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.165205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.165514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.165759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.165959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.166106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.166356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.166561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.166856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.166983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.167142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.167425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.907 qpair failed and we were unable to recover it. 00:27:47.907 [2024-11-18 19:26:06.167669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.907 [2024-11-18 19:26:06.167888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.168044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.168219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.168248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.168410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.168578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.168666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.168875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.168903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.169155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.169332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.169360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.169522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.169658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.169687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.169834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.169961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.169988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.170189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.170349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.170374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.170465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.170581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.170612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.170754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.170860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.170902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.171009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.171184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.171212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.171381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.171476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.171504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.171594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.171735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.171764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.171902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.172075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.172103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.172237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.172360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.172387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.172478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.172593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.172642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.172822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.173065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.173120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.173265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.173418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.173443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.173561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.173700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.173729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.173875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.174213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.174522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.174827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.174985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.175124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.175365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.175618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.175855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.175977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.176057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.176141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.176166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.908 [2024-11-18 19:26:06.176260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.176367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.908 [2024-11-18 19:26:06.176392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.908 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.176520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.176634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.176661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.176754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.176865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.176890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.177010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.177270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.177559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.177824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.177998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.178085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.178323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.178615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.178867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.178997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.179110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.179343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.179605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.179869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.179973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.180063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.180314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.180579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.180882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.180998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.181140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.181405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.181632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.181887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.181992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.182141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.182411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.182650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.182757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.182904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.183044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.183074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.183164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.183280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.183305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.909 qpair failed and we were unable to recover it. 00:27:47.909 [2024-11-18 19:26:06.183399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.909 [2024-11-18 19:26:06.183487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.183512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.183638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.183722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.183747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.183865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.183974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.183999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.184119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.184235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.184262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.184409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.184520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.184546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.184670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.184814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.184840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.184925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.185218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.185489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.185755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.185876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.185996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.186230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.186474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.186706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.186851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.186941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.187187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.187448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.187783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.187894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.188014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.188279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.188545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.188787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.188929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.189048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.189138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.189163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.189257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.189366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.189391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.910 qpair failed and we were unable to recover it. 00:27:47.910 [2024-11-18 19:26:06.189504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.910 [2024-11-18 19:26:06.189625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.189651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.189766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.189879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.189904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.189992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.190237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.190472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.190715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.190850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.190932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.191182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.191465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.191682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.191812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.191953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.192244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.192447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.192748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.192889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.192981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.193249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.193482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.193805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.193946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.194039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.194307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.194530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.194849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.194989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.195105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.195342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.195569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.195872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.195983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.196099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.196214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.196238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.196385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.196463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.196487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.196582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.196664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.911 [2024-11-18 19:26:06.196689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.911 qpair failed and we were unable to recover it. 00:27:47.911 [2024-11-18 19:26:06.196839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.196948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.196973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.197091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.197318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.197515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.197765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.197905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.197991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.198265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.198534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.198787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.198938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.199058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.199209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.199234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.199319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.199441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.199466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.199576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.199743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.199770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.199929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.200192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.200418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.200665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.200892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.200996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.201084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.201229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.201254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.201372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.201495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.201522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.201672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.201763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.201788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.201945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.202207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.202469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.202720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.202860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.202948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.203209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.203477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.203750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.203882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.912 qpair failed and we were unable to recover it. 00:27:47.912 [2024-11-18 19:26:06.204001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.912 [2024-11-18 19:26:06.204095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.204241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.204501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.204772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.204885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.205029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.205300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.205572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.205849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.205988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.206106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.206335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.206588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.206834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.206971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.207051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.207165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.207190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.207306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.207447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.207472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.207600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.207725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.207750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.207895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.208213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.208473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.208763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.208914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.209023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.209131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.209156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.209307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.209403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.209428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.913 [2024-11-18 19:26:06.209540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.209654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.913 [2024-11-18 19:26:06.209680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.913 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.209793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.209903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.209928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.210011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.210328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.210590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.210832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.210965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.211077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.211302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.211595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.211912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.211995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.212161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.212429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.212709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.212852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.213000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.213267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.213507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.213742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.213887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.213971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.214187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.214470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.214705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.214877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.214976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.215226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.215519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.215791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.215934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.216028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.216302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.216514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.914 [2024-11-18 19:26:06.216745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.914 [2024-11-18 19:26:06.216876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.914 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.216962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.217186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.217377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.217627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.217914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.217995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.218141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.218428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.218672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.218780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.218890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.219152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.219409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.219639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.219874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.219979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.220069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.220275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.220556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.220832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.220999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.221107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.221352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.221604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.221846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.221991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.222132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.222412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.915 [2024-11-18 19:26:06.222632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.915 [2024-11-18 19:26:06.222746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.915 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.222895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.223120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.223387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.223657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.223801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.223892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.224119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.224362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.224613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.224839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.224944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.225041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.225328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.225579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.225809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.225926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.226015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.226265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.226490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.226741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.226843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.226962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.227174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.227420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.227637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.916 qpair failed and we were unable to recover it. 00:27:47.916 [2024-11-18 19:26:06.227824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.916 [2024-11-18 19:26:06.227939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.227964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.228056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.228284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.228516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.228770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.228907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.229026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.229246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.229467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.229808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.229928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.230026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.230293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.230517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.230770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.230880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.230958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.231237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.231431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.231772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.231910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.232038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.232331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.232580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.232790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.232897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.233015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.233234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.233455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.233710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.233876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.233994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.234220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.234483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.234745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.917 [2024-11-18 19:26:06.234891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.917 qpair failed and we were unable to recover it. 00:27:47.917 [2024-11-18 19:26:06.234984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.235227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.235477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.235722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.235895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.236014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.236276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.236538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.236762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.236868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.237013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.237223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.237447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.237671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.237791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.237911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.238143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.238409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.238657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.238764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.238915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.239174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.239402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.239668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.239806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.239930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.240140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.240428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.240706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.240805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.240898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.241004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.241028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.241164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.241260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.241288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.918 [2024-11-18 19:26:06.241381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.241523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.918 [2024-11-18 19:26:06.241549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.918 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.241694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.241835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.241879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.242017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.242196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.242240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.242339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.242456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.242481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.242577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.242747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.242791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.242910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.243152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.243364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.243601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.243745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.243872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.244164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.244364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.244594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.244833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.244941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.245039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.245282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.245551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.245768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.245876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.246012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.246271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.246525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.246764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.246954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.247110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.247196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.247223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.247360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.247490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.919 [2024-11-18 19:26:06.247519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.919 qpair failed and we were unable to recover it. 00:27:47.919 [2024-11-18 19:26:06.247693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.247808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.247832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.248014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.248263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.248498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.248782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.248914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.249048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.249307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.249555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.249864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.249979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.250123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.250250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.250277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.250436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.250529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.250558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.250699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.250812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.250836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.250985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.251260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.251511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.251790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.251901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.252014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.252308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.252571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.252831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.252987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.253106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.253218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.253243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.253411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.253534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.253561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.253721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.253838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.253865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.254011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.254100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.254126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.920 qpair failed and we were unable to recover it. 00:27:47.920 [2024-11-18 19:26:06.254265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.920 [2024-11-18 19:26:06.254389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.254416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.254518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.254621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.254670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.254784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.254902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.254927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.255050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.255266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.255580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.255844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.255980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.256074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.256172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.256201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.256318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.256464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.256493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.256657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.256768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.256794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.256887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.257149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.257488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.257766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.257927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.258069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.258313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.258583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.258870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.258986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.259098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.259239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.259265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.259406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.259488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.259516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.259647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.259760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.259785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.259919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.260210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.260554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.260845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.260957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.261119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.261219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.261248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.921 qpair failed and we were unable to recover it. 00:27:47.921 [2024-11-18 19:26:06.261401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.921 [2024-11-18 19:26:06.261525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.261555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.261690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.261836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.261862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.261997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.262319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.262625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.262843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.262951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.263113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.263363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.263662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.263876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.263995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.264148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.264392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.264676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.264847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.264987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.265272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.265487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.265766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.265885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.265985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.266247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.266552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.266763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.266890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.266990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.267098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.267123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.267210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.267355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.267383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.267502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.267596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.922 [2024-11-18 19:26:06.267631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.922 qpair failed and we were unable to recover it. 00:27:47.922 [2024-11-18 19:26:06.267742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.267823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.267847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.267934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.268252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.268510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.268752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.268916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.269050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.269308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.269584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.269888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.269985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.270126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.270431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.270786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.270985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.271164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.271283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.271309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.271457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.271586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.271624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.271718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.271816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.271845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.271976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.272210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.272507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.272765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.272879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.273008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.273312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.273550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.273810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.273924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.274022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.274175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.274203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.274342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.274458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.274484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.274628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.274757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.274784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.274874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.275006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.275034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.275175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.275259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.275284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.923 [2024-11-18 19:26:06.275429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.275589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.923 [2024-11-18 19:26:06.275622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.923 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.275749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.275880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.275908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.276043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.276135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.276161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.276277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.276417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.276442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.276578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.276723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.276752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.276894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.277165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.277479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.277763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.277871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.277977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.278246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.278527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.278732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.278871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.278983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.279229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.279503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.279835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.279982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.280156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.280244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.280269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.280385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.280508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.280536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.280662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.280815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.280844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.280962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.281250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.281523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.281841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.281983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.282129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.282280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.282309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.282442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.282619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.282646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.282772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.282919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.282943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.283075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.283227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.283256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.924 qpair failed and we were unable to recover it. 00:27:47.924 [2024-11-18 19:26:06.283381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.283508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.924 [2024-11-18 19:26:06.283536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.283639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.283725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.283750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.283868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.283949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.283972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.284148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.284235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.284260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.284371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.284512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.284536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.284684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.284833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.284861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.284987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.285273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.285559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.285834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.285975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.286116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.286312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.286573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.286833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.286963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.287063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.287345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.287592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.287803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.287988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.288098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.288229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.288254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.288369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.288481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.288506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.288693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.288837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.288863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.288951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.289212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.289438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.925 qpair failed and we were unable to recover it. 00:27:47.925 [2024-11-18 19:26:06.289711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.925 [2024-11-18 19:26:06.289867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.289973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.290222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.290513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.290858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.290965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.291098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.291265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.291290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.291403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.291488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.291514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.291662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.291778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.291859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.292149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.292401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.292642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.292784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.292923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.293171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.293438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.293732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.293883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.294028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.294317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.294567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.294839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.294983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.295116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.295207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.295234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.295363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.295489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.295519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.295658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.295753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.295778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.295867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.296154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.296475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.296763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.296882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.297011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.297164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.297192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.297308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.297426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.297451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.926 qpair failed and we were unable to recover it. 00:27:47.926 [2024-11-18 19:26:06.297623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.926 [2024-11-18 19:26:06.297745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.297773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.297871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.297962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.297989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.298090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.298202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.298228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.298393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.298509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.298541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.298709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.298828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.298856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.298965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.299161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.299406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.299656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.299883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.299967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.300132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.300408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.300725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.300875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.300968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.301253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.301538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.301814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.301998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.302107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.302213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.302238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.302360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.302477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.302505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.302635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.302762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.302792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.302962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.303277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.303595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.303862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.303980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.304153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.304406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.304659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.304806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.304941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.305057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.305085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.927 [2024-11-18 19:26:06.305175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.305304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.927 [2024-11-18 19:26:06.305332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.927 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.305453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.305570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.305595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.305731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.305860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.305887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.305985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.306294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.306522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.306816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.306969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.307137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.307223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.307249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.307362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.307492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.307520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.307622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.307754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.307783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.307925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.308141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.308388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.308738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.308882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.309025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.309181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.309209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.309329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.309460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.309487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.309612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.309705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.309731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.309874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.310133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.310348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.310659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.310780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.310949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.311217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.311546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.311859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.311981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.312126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.312264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.312289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.312433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.312584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.312637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.312800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.312893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.312921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.313093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.313208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.313233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.928 qpair failed and we were unable to recover it. 00:27:47.928 [2024-11-18 19:26:06.313404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.928 [2024-11-18 19:26:06.313531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.313558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.313687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.313810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.313835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.313928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.314200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.314478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.314800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.314947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.315081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.315383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.315663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.315864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.315998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.316111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.316411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.316654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.316866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.316979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.317095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.317174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.317199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.317312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.317426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.317453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.317605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.317713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.317739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.317880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.318164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.318391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.318647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.318796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.318921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.319182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.319417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.319628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.319860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.319995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.320107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.320216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.320240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.320337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.320476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.320501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.320584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.320717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.929 [2024-11-18 19:26:06.320744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.929 qpair failed and we were unable to recover it. 00:27:47.929 [2024-11-18 19:26:06.320863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.320945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.320970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.321096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.321220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.321247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.321400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.321516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.321543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.321685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.321800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.321825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.321977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.322260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.322552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.322878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.322991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.323118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.323354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.323654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.323800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.323963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.324243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.324512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.324739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.324931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.325040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.325317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.325534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.325846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.325955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.326128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.326267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.326295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.326420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.326552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.326593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.326686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.326795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.326820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.326964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.327104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.327144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.327273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.327400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.327430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.327569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.327688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.930 [2024-11-18 19:26:06.327714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.930 qpair failed and we were unable to recover it. 00:27:47.930 [2024-11-18 19:26:06.327805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.327973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.328125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.328500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.328788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.328956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.329096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.329217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.329246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.329423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.329549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.329575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.329714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.329813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.329842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.330011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.330243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.330271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.330416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.330534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.330560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.330736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.330913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.330984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.331170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.331272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.331302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.331473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.331568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.331595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.331765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.331873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.331902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.332074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.332299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.332328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.332473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.332591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.332624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.332761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.332859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.332889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.333050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.333358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.333576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.333869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.333970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.334126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.334381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.334657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.334805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.334946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.335219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.335454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.335683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.335901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.336082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.336214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.336239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.931 qpair failed and we were unable to recover it. 00:27:47.931 [2024-11-18 19:26:06.336353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.931 [2024-11-18 19:26:06.336482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.336507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.336601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.336723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.336749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.336862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.336974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.337091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.337315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.337519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.337783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.337923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.338042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.338276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.338502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.338717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.338853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.338970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.339241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.339492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.339737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.339878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.340025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.340291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.340626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.340857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.340973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.341066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.341285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.341553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.341821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.341954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.342076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.342339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.342578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.342826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.342938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.343034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.343153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.343179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.343292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.343371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.932 [2024-11-18 19:26:06.343397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.932 qpair failed and we were unable to recover it. 00:27:47.932 [2024-11-18 19:26:06.343482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.343572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.343599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.343720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.343837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.343862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.344015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.344268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.344478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.344719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.344839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.344989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.345138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.345191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.345339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.345486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.345510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.345654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.345838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.345881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.345995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.346307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.346599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.346866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.346985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.347009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.347120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.347262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.347287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.347421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.347568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.347593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.347741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.347940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.348145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.348426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.348761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.348896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.348989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.349216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.349472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.349711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.349857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.349979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.350266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.350484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.350722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.350863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.351018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.351128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.351153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.933 qpair failed and we were unable to recover it. 00:27:47.933 [2024-11-18 19:26:06.351302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.351445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.933 [2024-11-18 19:26:06.351469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.351591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.351752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.351778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.351897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.352174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.352411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.352697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.352842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.352959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.353222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.353456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.353719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.353890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.353980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.354242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.354465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.354735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.354868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.354961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.355195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.355422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.355662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.355889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.355997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.356124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.356366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.356595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.356876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.356996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.357023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.357114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.357228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.357253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.934 [2024-11-18 19:26:06.357379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.357522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.934 [2024-11-18 19:26:06.357548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.934 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.357689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.357850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.357878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.358035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.358170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.358196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.358345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.358432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.358457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.358588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.358778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.358822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.358981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.359242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.359512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.359773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.359924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.360043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.360369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.360618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.360865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.360981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.361135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.361394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.361621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.361866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.361980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.362121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.362339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.362616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.362857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.362980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.363005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.363120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.363206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.363232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.363355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.365749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.365777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.365908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.366266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.366577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.366870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.366982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.367097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.367217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.367243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.367333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.367427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.367454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.935 qpair failed and we were unable to recover it. 00:27:47.935 [2024-11-18 19:26:06.367587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.935 [2024-11-18 19:26:06.367714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.367742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.367889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.368115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.368369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.368625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.368786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.368936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.369053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.369080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.369215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.369349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.369375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.369525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.369654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.369684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.369868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.370199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.370466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.370757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.370961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.371088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.371335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.371562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.371858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.371981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.372098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.372339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.372572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.372836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.372991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.373140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.373257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.373283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.373395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.373518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.373544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.373715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.373838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.373868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.374032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.374201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.374227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.374314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.374426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.374451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.374573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.374707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.374736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.374923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.375062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.375107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.375228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.375354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.375380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.936 [2024-11-18 19:26:06.375498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.375619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.936 [2024-11-18 19:26:06.375646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.936 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.375767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.375899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.375927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.376055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.376189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.376216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.376336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.376451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.376478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.376615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.376730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.376758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.376881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.377160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.377437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.377740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.377887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.378041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.378191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.378217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.378336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.378450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.378475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.378597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.378724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.378750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.378875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.379119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.379365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.379598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.379742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.379888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.380126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.380356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.380597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.380786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.380942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.381190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.381420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.381782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.381969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.382054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.382164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.382190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.382341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.382459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.382485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.382638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.382784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.382810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.382958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.383067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.383094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.937 [2024-11-18 19:26:06.383222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.383371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.937 [2024-11-18 19:26:06.383398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.937 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.383526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.383642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.383670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.383847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.384202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.384483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.384756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.384981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.385103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.385243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.385271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.385395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.385510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.385537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.385633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.385789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.385816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.385968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.386150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.386177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.386324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.386450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.386483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.386580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.386764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.386807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.386917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.387064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.387108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.387224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.387367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.387394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.387539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.387697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.387728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.387857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.388175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.388436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.388736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.388908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.389031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.389280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.389544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.389835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.389996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.390177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.390446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.390706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.390904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.391050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.391190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.391217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.391362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.391484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.391512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.391635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.391770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.391813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.938 qpair failed and we were unable to recover it. 00:27:47.938 [2024-11-18 19:26:06.391958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.938 [2024-11-18 19:26:06.392079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.392245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.392491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.392781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.392951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.393030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.393306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.393526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.393737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.393885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.393997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.394261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.394557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.394848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.394969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.395113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.395373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.395676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.395825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.395970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.396222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.396424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.396711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.396864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.397003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.397263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.397485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.397772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.397929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.398076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.398173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.398201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.398287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.398399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.398425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.939 qpair failed and we were unable to recover it. 00:27:47.939 [2024-11-18 19:26:06.398544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.939 [2024-11-18 19:26:06.398677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.398703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.398798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.398950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.398977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.399125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.399238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.399265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.399379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.399500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.399527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.399605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.399759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.399786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.399936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.400249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.400541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.400799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.400987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.401156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.401395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.401616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.401796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.401912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.402151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.402441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.402751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.402857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.402979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.403099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.403125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.403287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.403432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.403461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.403551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.403707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.403753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.403902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.404250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.404472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.404744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.404907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.405032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.405268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.405489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.405793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.405962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.406061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.406202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.406229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.406384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.406527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.940 [2024-11-18 19:26:06.406553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.940 qpair failed and we were unable to recover it. 00:27:47.940 [2024-11-18 19:26:06.406721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.406865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.406894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.407047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.407182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.407208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.407295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.407439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.407467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.407620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.407759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.407788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.407952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.408277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.408510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.408813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.408995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.409156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.409403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.409709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.409899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.409999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.410277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.410538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.410782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.410934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.411018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.411258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.411514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.411792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.411973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.412093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.412338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.412572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.412871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.412987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.413108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.413335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.413642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.413858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.413964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.414052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.414169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.414195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.941 qpair failed and we were unable to recover it. 00:27:47.941 [2024-11-18 19:26:06.414309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.414436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.941 [2024-11-18 19:26:06.414463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.414625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.414754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.414782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.414904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.415185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.415478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.415793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.415946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.416101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.416243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.416269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.416410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.416492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.416518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.416684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.416840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.416890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.417043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.417292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.417558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.417827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.417993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.418115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.418238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.418265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.418349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.418456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.418483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.418629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.418804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.418852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.418984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.419292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.419519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.419764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.419911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.420054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.420329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.420558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.420824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.420969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.421062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.421203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.421231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.421348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.421457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.421484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.421605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.421814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.421861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.421996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.422161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.422188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.422333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.422413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.942 [2024-11-18 19:26:06.422441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.942 qpair failed and we were unable to recover it. 00:27:47.942 [2024-11-18 19:26:06.422564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.422653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.422681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.422813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.422934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.422964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.423138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.423249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.423276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.423398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.423506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.423533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.423653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.423775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.423802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.423925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.424202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.424489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.424801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.424914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.425032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.425318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.425547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.425795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.425967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.426113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.426342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.426534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.426802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.426915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.427029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.427313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.427568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.427870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.427979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.428127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.428361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.428671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.428781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.428914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.429179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.429447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.943 qpair failed and we were unable to recover it. 00:27:47.943 [2024-11-18 19:26:06.429667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.943 [2024-11-18 19:26:06.429805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.429920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.430153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.430420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.430723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.430906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.431029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.431291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.431557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.431810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.431920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.432064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.432267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.432537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.432806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.432918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.433013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.433255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.433552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.433845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.433971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.434112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.434405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.434642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.434903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.434996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.435144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.435354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.435618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.435849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.435978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.436065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.436184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.436210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.436305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.436389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.944 [2024-11-18 19:26:06.436416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.944 qpair failed and we were unable to recover it. 00:27:47.944 [2024-11-18 19:26:06.436506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.436648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.436677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.436766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.436850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.436877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.436988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.437256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.437548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.437836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.437991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.438095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.438360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.438562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.438800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.438937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.439028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.439257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.439521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.439789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.439965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.440086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.440353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.440581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.440850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.440997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.441100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.441353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.441578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.441886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.441976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.442147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.442379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.442601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.442874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.442994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.443020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.443144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.443289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.443315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.443414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.443506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.443533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.945 qpair failed and we were unable to recover it. 00:27:47.945 [2024-11-18 19:26:06.443674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.945 [2024-11-18 19:26:06.443807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.443834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.443953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.444186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.444436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.444657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.444879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.444989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.445133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.445401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.445650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.445823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.445916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.446178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.446436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.446688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.446829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.446948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.447183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.447473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.447759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.447908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.448029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.448289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.448526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.448793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.448905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.449311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.449566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.449839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.449987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.450133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.450358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.450620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.450856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.946 [2024-11-18 19:26:06.450972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.946 qpair failed and we were unable to recover it. 00:27:47.946 [2024-11-18 19:26:06.451066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.451148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.451174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.451324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.451444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.451471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.451618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.451763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.451790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.451956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.452298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.452582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.452833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.452997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.453133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.453390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.453643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.453782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.453923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.454238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.454475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.454723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.454835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.454990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.455236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.455494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.455734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.455856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.455970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.456198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.456453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.456836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.456966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.457123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.457395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.457648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.457911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.457992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.458142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.458402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.947 qpair failed and we were unable to recover it. 00:27:47.947 [2024-11-18 19:26:06.458752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.947 [2024-11-18 19:26:06.458897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.459017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.459245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.459541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.459840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.459951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.460114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.460277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.460304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.460427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.460549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.460576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.460728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.460862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.460889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.460983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.461213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.461474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.461743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.461892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.462006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.462257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.462524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.462797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.462949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.463091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.463237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.463264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.463385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.463524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.463552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.463635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.463799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.463845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.463983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.464119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.464147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.464302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.464421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.464448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.464567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.464698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.464727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.464873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.465187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.465453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.948 [2024-11-18 19:26:06.465742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.948 [2024-11-18 19:26:06.465913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.948 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.466054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.466217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.466245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.466388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.466507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.466534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.466668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.466850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.466893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.467066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.467346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.467566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.467826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.467967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.468062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.468175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.468201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.468333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.468439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.468466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.468586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.468724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.468752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.468897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.469138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.469419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.469671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.469810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.469895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.470178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.470439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.470715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.470838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.470968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.471241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.471507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.471734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.471944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.472090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.472329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.472530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.472786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.472956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.473077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.473223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.473250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.473343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.473488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.473519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.473648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.473801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.473848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.473995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.474135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.949 [2024-11-18 19:26:06.474162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.949 qpair failed and we were unable to recover it. 00:27:47.949 [2024-11-18 19:26:06.474285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.474406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.474433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.474520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.474650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.474681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.474809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.474942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.474969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.475082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.475341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.475572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.475859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.475977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.476126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.476328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.476554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.476824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.476937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.477058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.477272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.477517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.477853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.477998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.478115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.478234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.478261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.478385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.478495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.478522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.478735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.478873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.478904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.478997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.479260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.479482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.479781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.479944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.480089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.480177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.480205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.480326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.480442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.480469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.480594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.480747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.480795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.480945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.481206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.481401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.481693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.481841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.481949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.482058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.482086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.950 [2024-11-18 19:26:06.482203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.482369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.950 [2024-11-18 19:26:06.482399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.950 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.482550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.482668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.482697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.482811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.482930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.482956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.483046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.483337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.483569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.483865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.483983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.484157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.484411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.484601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.484878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.484990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.485142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.485412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:47.951 [2024-11-18 19:26:06.485698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.951 [2024-11-18 19:26:06.485869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:47.951 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.486013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.486153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.486193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.486348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.486517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.486569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.486726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.486862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.486892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.487021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.487232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.487487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.231 [2024-11-18 19:26:06.487804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.231 [2024-11-18 19:26:06.487930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.231 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.488059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.488185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.488215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.488347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.488447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.488474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.488593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.488701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.488731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.488905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.489161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.489456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.489700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.489825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.489931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.490220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.490473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.490821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.490981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.491139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.491268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.491298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.491427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.491559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.491590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.491745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.491830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.491875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.491997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.492281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.492569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.492823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.492997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.493117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.493431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.493767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.493911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.494061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.494225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.494255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.494410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.494567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.494597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.494747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.494871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.494898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.494986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.495241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.495486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.232 qpair failed and we were unable to recover it. 00:27:48.232 [2024-11-18 19:26:06.495790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.232 [2024-11-18 19:26:06.495903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.495929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.496042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.496289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.496548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.496783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.496958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.497058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.497294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.497534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.497803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.497976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.498112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.498236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.498266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.498404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.498509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.498538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.498643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.498798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.498828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.498967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.499275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.499531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.499816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.499988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.500156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.500275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.500303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.500443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.500548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.500575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.500694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.500811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.500838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.500988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.501110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.501138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.501292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.501435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.501461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.501777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.501804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.233 [2024-11-18 19:26:06.501939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.502095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.233 [2024-11-18 19:26:06.502125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.233 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.502263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.502426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.502452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.502601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.502698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.502724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.502837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.502934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.502978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.503112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.503279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.503306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.503452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.503598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.503634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.503780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.503897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.503924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.504075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.504183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.504213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.504337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.504463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.504492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.504652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.504771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.504798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.504888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.505003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.505031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.505202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.505358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.505387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.505518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.505678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.505736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.505894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.506163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.506385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.506640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.506788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.506898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.507213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.507480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.507738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.507891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.507997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.508270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.508520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.508758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.508894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.509028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.509117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.509148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.234 [2024-11-18 19:26:06.509294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.509378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.234 [2024-11-18 19:26:06.509404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.234 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.509490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.509632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.509660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.509747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.509879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.509906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.510001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.510246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.510472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.510769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.510906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.511038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.511337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.511619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.511878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.511977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.512161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.512462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.512771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.512940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.513109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.513347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.513638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.513861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.513983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.514145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.514418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.514724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.514871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.515045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.515174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.515204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.515334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.515428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.515466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.515616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.515745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.515777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.515897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.516129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.516358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.516651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.516843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.235 [2024-11-18 19:26:06.516982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.517101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.235 [2024-11-18 19:26:06.517128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.235 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.517297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.517421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.517450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.517560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.517702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.517732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.517829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.517957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.517985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.518126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.518211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.518242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.518388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.518507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.518536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.518674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.518772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.518801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.518924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.519190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.519432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.519738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.519884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.520015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.520283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.520550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.520867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.520989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.521110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.521421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.521677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.521818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.521909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.522164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.522473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.522789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.522945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.523074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.523203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.523235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.236 qpair failed and we were unable to recover it. 00:27:48.236 [2024-11-18 19:26:06.523358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.523512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.236 [2024-11-18 19:26:06.523541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.523656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.523776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.523809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.523901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.524175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.524439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.524756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.524928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.525060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.525200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.525226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.525340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.525461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.525504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.525653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.525807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.525835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.525963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.526232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.526474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.526780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.526967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.527108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.527249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.527277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.527438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.527600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.527640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.527740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.527911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.527941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.528032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.528181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.528210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.528317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.528430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.528456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.528591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.528737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.528767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.528900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.529138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.529457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.529787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.529943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.530085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.530215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.530245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.530377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.530495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.530524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.530629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.530773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.530800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.530928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.531049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.531079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.531236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.531331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.531360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.237 qpair failed and we were unable to recover it. 00:27:48.237 [2024-11-18 19:26:06.531481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.531569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.237 [2024-11-18 19:26:06.531598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.531723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.531807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.531835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.531914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.532275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.532549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.532822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.532974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.533059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.533169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.533195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.533365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.533492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.533522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.533639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.533767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.533797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.533948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.534242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.534507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.534798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.534958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.535067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.535150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.535176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.535277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.535453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.535482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.535619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.535743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.535773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.535912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.536232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.536500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.536765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.536945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.537113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.537255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.537281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.537395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.537516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.537542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.537641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.537810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.537835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.538004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.538299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.538572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.538863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.538999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.539024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.539115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.539223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.539249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.238 [2024-11-18 19:26:06.539340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.539457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.238 [2024-11-18 19:26:06.539483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.238 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.539569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.539660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.539686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.539805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.539893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.539919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.540043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.540339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.540621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.540855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.540990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.541126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.541243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.541272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.541404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.541527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.541555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.541699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.541853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.541879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.542031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.542252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.542506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.542786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.542920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.543031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.543250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.543505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.543798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.543912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.544055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.544329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.544568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.544809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.544965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.545136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.545262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.545290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.545446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.545570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.545600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.545748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.545849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.545877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.546008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.546154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.546181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.546350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.546475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.546502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.546634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.546763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.546790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.546900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.547021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.547049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.239 qpair failed and we were unable to recover it. 00:27:48.239 [2024-11-18 19:26:06.547186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.239 [2024-11-18 19:26:06.547302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.547327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.547440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.547551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.547577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.547693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.547868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.547896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.548015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.548296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.548528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.548815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.548976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.549132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.549362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.549594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.549805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.549937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.550249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.550556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.550790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.550941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.551189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.551366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.551394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.551521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.551614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.551656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.551817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.551965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.551991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.552115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.552262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.552291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.552398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.552522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.552551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.552687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.552790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.552816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.552942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.553170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.553430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.553735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.553853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.553987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.554283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.554549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.554825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.554959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.555003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.555099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.555208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.240 [2024-11-18 19:26:06.555234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.240 qpair failed and we were unable to recover it. 00:27:48.240 [2024-11-18 19:26:06.555319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.555481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.555522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.555656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.555820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.555846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.555958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.556171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.556432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.556672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.556811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.556902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.557157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.557350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.557636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.557806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.557915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.558207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.558422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.558643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.558799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.558921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.559225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.559460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.559747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.559918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.560032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.560153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.560183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.560280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.560420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.560445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.560619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.560747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.560775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.560883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.561183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.561454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.241 [2024-11-18 19:26:06.561742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.241 [2024-11-18 19:26:06.561929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.241 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.562067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.562291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.562547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.562805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.562927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.563047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.563187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.563216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.563327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.563451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.563481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.563589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.563733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.563759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.563915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.564192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.564450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.564699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.564819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.564912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.565179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.565435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.565687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.565829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.565923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.566224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.566489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.566770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.566883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.566995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.567201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.567469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.567771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.567905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.568041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.568336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.568620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.568875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.568983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.569105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.569226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.569254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.242 qpair failed and we were unable to recover it. 00:27:48.242 [2024-11-18 19:26:06.569412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.242 [2024-11-18 19:26:06.569536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.569564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.569731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.569862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.569890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.569994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.570252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.570486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.570745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.570851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.571004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.571241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.571524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.571807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.571973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.572129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.572294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.572323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.572444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.572605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.572640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.572739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.572843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.572872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.572997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.573278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.573562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.573827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.573975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.574121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.574225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.574255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.574368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.574487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.574514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.574648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.574806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.574835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.574969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.575256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.575533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.575724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.575843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.575984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.576269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.576513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.576731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.243 [2024-11-18 19:26:06.576835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.243 qpair failed and we were unable to recover it. 00:27:48.243 [2024-11-18 19:26:06.576938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.577186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.577446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.577741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.577925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.578058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.578178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.578207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.578337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.578459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.578488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.578669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.578810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.578835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.578961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.579238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.579493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.579802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.579972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.580065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.580318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.580530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.580789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.580932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.581081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.581246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.581274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.581406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.581559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.581588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.581688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.581819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.581847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.581971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.582205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.582445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.582753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.582906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.583012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.583244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.583503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.583794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.583951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.584092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.584213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.584239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.584330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.584424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.584449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.244 [2024-11-18 19:26:06.584546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.584670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.244 [2024-11-18 19:26:06.584697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.244 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.584810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.584909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.584938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.585064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.585198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.585225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.585381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.585513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.585539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.585667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.585786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.585812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.585948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.586192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.586487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.586698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.586867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.586978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.587073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.587101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.587254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.587341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.587366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.587533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.587666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.587695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.587851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.588162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.588490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.588701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.588850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.588957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.589210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.589490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.589783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.589904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.590023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.590179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.590207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.590338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.590464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.590492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.590635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.590754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.590780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.590873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.591020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.591046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.591185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.591282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.591312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.245 [2024-11-18 19:26:06.591420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.591546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.245 [2024-11-18 19:26:06.591574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.245 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.591701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.591819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.591845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.592007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.592340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.592587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.592855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.592974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.593106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.593425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.593636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.593868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.593999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.594133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.594271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.594298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.594433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.594563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.594592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.594701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.594841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.594868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.594998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.595115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.595142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.595315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.595442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.595472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.595591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.595738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.595769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.595898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.596217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.596543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.596802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.596987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.597081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.597198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.597224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.597345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.597465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.597490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.597589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.597752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.597780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.597912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.598211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.598484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.598789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.598950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.599073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.599160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.599189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.599295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.599425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.599452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.246 qpair failed and we were unable to recover it. 00:27:48.246 [2024-11-18 19:26:06.599585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.246 [2024-11-18 19:26:06.599711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.599737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.599863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.599963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.599990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.600150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.600277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.600305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.600442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.600568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.600596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.600772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.600890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.600916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.601051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.601200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.601228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.601353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.601506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.601539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.601668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.601793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.601821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.601951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.602243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.602534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.602786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.602907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.603036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.603342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.603561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.603850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.603979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.604142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.604390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.604688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.604875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.605006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.605295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.605545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.605839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.605989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.606073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.606201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.606229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.606362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.606507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.606532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.606650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.606747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.606775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.606928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.607135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.607168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.607302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.607433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.607460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.247 [2024-11-18 19:26:06.607636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.607747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.247 [2024-11-18 19:26:06.607772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.247 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.607920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.608212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.608428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.608658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.608797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.608947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.609219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.609477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.609740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.609890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.610015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.610170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.610199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.610294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.610423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.610452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.610621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.610777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.610806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.610924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.611158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.611469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.611780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.611899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.612069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.612314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.612567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.612837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.612995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.613126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.613251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.613277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.613420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.613544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.613573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.613712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.613807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.613838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.613972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.614272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.614501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.614774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.614920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.615030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.615149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.615178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.615296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.615413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.615438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.248 qpair failed and we were unable to recover it. 00:27:48.248 [2024-11-18 19:26:06.615591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.248 [2024-11-18 19:26:06.615750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.615779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.615939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.616282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.616571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.616857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.616973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.617154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.617455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.617674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.617789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.617874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.618232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.618500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.618827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.618969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.619136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.619375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.619616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.619773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.619942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.620191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.620409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.620665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.620839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.620949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.621215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.621454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.621705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.621827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.621968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.622231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.622529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.622833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.622966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.623106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.623221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.623246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.249 [2024-11-18 19:26:06.623389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.623518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.249 [2024-11-18 19:26:06.623546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.249 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.623676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.623841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.623871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.624042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.624295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.624537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.624821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.624988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.625147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.625322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.625350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.625488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.625630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.625657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.625778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.625867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.625896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.626056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.626165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.626191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.626335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.626464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.626491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.626627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.626713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.626743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.626911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.627225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.627461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.627740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.627857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.627966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.628203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.628487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.628774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.628919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.629065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.629277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.629563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.629828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.629963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.630101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.630253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.630280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.250 qpair failed and we were unable to recover it. 00:27:48.250 [2024-11-18 19:26:06.630414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.250 [2024-11-18 19:26:06.630571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.630598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.630751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.630840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.630869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.631012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.631306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.631546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.631795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.631926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.632055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.632171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.632198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.632360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.632497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.632522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.632644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.632771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.632799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.632924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.633217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.633436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.633728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.633896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.634025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.634121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.634149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.634260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.634398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.634423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.634591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.634724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.634753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.634887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.635168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.635473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.635787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.635946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.636063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.636356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.636636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.636873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.636989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.637109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.637364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.637619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.637825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.637967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.251 [2024-11-18 19:26:06.638111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.638229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.251 [2024-11-18 19:26:06.638257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.251 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.638416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.638545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.638575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.638724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.638840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.638867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.639013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.639173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.639199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.639322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.639447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.639476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.639648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.639755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.639786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.639923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.640218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.640505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.640758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.640971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.641139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.641251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.641276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.641426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.641530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.641555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.641639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.641731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.641759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.641847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.642016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.642045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.642189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.642308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.642335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.642506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.642622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.642651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.642779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.643169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.643414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.643718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.643905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.644077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.644188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.644216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.644317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.644446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.644489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.644650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.644744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.644771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.644917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.645153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.645454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.645753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.645867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.645986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.646136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.646164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.646291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.646416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.646445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.252 qpair failed and we were unable to recover it. 00:27:48.252 [2024-11-18 19:26:06.646602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.252 [2024-11-18 19:26:06.646764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.646798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.646967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.647228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.647485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.647782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.647916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.648028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.648294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.648575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.648847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.648983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.649129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.649360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.649593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.649843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.649975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.650103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.650338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.650631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.650863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.650999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.651148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.651247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.651272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.651380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.651510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.651538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.651646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.651766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.651795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.651917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.652188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.652504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.652793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.652917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.653040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.653371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.653662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.653852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.653989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.253 [2024-11-18 19:26:06.654079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.654191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.253 [2024-11-18 19:26:06.654219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.253 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.654389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.654505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.654530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.654670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.654769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.654803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.654937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.655163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.655476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.655793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.655952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.656085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.656235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.656264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.656384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.656481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.656509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.656635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.656747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.656773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.656880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.657172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.657439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.657757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.657902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.658068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.658283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.658537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.658794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.658935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.659084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.659363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.659631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.659894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.659976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.660160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.660472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.660779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.660950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.661038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.661263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.661512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.661720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.661925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.254 qpair failed and we were unable to recover it. 00:27:48.254 [2024-11-18 19:26:06.662046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.254 [2024-11-18 19:26:06.662189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.662215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.662357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.662484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.662513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.662636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.662739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.662767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.662903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.663165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.663379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.663676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.663829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.663957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.664227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.664547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.664867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.664980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.665106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.665192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.665235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.665340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.665447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.665473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.665618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.665741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.665769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.665885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.666223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.666483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.666760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.666875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.667035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.667204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.667232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.667387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.667491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.667521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.667676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.667817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.667844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.667956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.668113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.668142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.668262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.668386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.668414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.668542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.668692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.255 [2024-11-18 19:26:06.668719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.255 qpair failed and we were unable to recover it. 00:27:48.255 [2024-11-18 19:26:06.668872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.668954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.668981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.669129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.669283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.669309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.669467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.669563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.669593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.669740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.669841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.669866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.669954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.670198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.670509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.670764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.670932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.671072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.671316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.671594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.671846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.671974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.672109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.672250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.672276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.672375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.672506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.672535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.672657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.672820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.672845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.672987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.673116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.673141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.673281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.673423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.673464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.673602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.673733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.673764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.673885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.674215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.674487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.674700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.674838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.675057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.675212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.675241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.675395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.675547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.675576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.675696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.675813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.675838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.675979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.676236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.676517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.256 qpair failed and we were unable to recover it. 00:27:48.256 [2024-11-18 19:26:06.676826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.256 [2024-11-18 19:26:06.676996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.677141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.677236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.677264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.677431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.677570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.677596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.677719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.677812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.677838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.677983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.678097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.678123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.678300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.678416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.678441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.678603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.678712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.678737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.678883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.679202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.679432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.679700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.679879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.680048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.680348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.680633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.680891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.680999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.681100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.681227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.681256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.681401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.681543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.681569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.681705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.681811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.681835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.681970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.682097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.682126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.682245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.682361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.682389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.682563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.682674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.682700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.682871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.683129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.683370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.683660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.683895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.683982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.684126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.684351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.684586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.257 [2024-11-18 19:26:06.684772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.257 qpair failed and we were unable to recover it. 00:27:48.257 [2024-11-18 19:26:06.684917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.685202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.685524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.685810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.685929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.686097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.686352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.686619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.686869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.686988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.687126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.687263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.687292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.687421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.687545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.687574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.687732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.687851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.687877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.687964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.688206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.688489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.688778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.688927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.689035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.689157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.689183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.689325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.689482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.689511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.689670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.689772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.689802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.689956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.690208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.690420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.690652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.690763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.690906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.691202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.691497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.691796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.691954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.692518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.692676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.692705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.692828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.692918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.692944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.258 [2024-11-18 19:26:06.693086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.693183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.258 [2024-11-18 19:26:06.693213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.258 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.693308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.693462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.693492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.693626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.693721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.693749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.693855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.693970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.693997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.694113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.694348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.694603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.694854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.694972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.695056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.695321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.695579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.695872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.695979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.696061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.696212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.696238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.696368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.696463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.696492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.696598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.696731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.696760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.696921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.697206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.697501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.697765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.697926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.698045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.698157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.698182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.698340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.698468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.698496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.698637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.698771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.698799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.698924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.699246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.699454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.699738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.259 [2024-11-18 19:26:06.699888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.259 qpair failed and we were unable to recover it. 00:27:48.259 [2024-11-18 19:26:06.699984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.700261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.700502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.700776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.700962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.701067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.701346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.701577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.701822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.701958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.702110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.702219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.702248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.702410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.702564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.702593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.702763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.702885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.702909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.703437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.703598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.703652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.703802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.703923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.703948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.704073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.704280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.704526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.704794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.704913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.705050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.705162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.705187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.705275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.705414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.705442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.705571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.705734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.705761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.705885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.706124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.706373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.706657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.706798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.706927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.707125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.707378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.707683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.707804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.260 qpair failed and we were unable to recover it. 00:27:48.260 [2024-11-18 19:26:06.707943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.708098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.260 [2024-11-18 19:26:06.708126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.708272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.708389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.708415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.708572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.708699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.708727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.708847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.708976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.709124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.709383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.709630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.709877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.709981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.710138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.710371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.710632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.710825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.710949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.711109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.711369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.711620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.711853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.711979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.712131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.712462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.712761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.712867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.712987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.713274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.713506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.713793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.713906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.714061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.714197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.714224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.714352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.714480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.714509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.714699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.714809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.714835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.714927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.715004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.715030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.715125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.715263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.715289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.715390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.715484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.261 [2024-11-18 19:26:06.715537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.261 qpair failed and we were unable to recover it. 00:27:48.261 [2024-11-18 19:26:06.715638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.715717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.715742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.715834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.715911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.715936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.716029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.716123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.716150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.716279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.716441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.716470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.716636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.716779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.716805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.716931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.717169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.717467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.717765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.717878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.717974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.718170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.718467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.718804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.718956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.719111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.719195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.719222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.719385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.719516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.719545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.719716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.719806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.719833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.719982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.720233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.720505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.720771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.720907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.721012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.721170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.721199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.721340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.721456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.721484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.721624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.721769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.721796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.721919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.722155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.722410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.722635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.722778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.722870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.723012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.723041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.262 [2024-11-18 19:26:06.723159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.723283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.262 [2024-11-18 19:26:06.723324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.262 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.723445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.723555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.723581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.723708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.723801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.723828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.723986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.724140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.724169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.724301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.724395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.724424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.724592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.724719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.724745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.724892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.725156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.725386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.725691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.725833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.725917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.726206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.726514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.726799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.726920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.727038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.727304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.727509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.727793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.727931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.728114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.728414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.728679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.728882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.728993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.729111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.729343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.729578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.729833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.729951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.730114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.730280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.730309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.730463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.730553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.730583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.730750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.730842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.730870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.263 qpair failed and we were unable to recover it. 00:27:48.263 [2024-11-18 19:26:06.730970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.263 [2024-11-18 19:26:06.731115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.731150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.731294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.731411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.731439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.731540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.731713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.731740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.731859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.731990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.732160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.732410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.732743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.732946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.733117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.733253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.733279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.733374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.733458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.733483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.733621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.733746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.733772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.733862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.734202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.734545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.734828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.734955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.735088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.735213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.735243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.735340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.735510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.735539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.735712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.735830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.735860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.735993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.736251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.736515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.736777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.736944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.737080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.737201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.737232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.737393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.737511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.737535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.737709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.737839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.737867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.737991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.738145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.738170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.264 qpair failed and we were unable to recover it. 00:27:48.264 [2024-11-18 19:26:06.738279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.264 [2024-11-18 19:26:06.738379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.738408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.738500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.738620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.738669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.738796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.738918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.738943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.739062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.739275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.739547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.739804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.739983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.740107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.740232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.740258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.740395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.740488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.740516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.740677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.740795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.740820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.740927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.741079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.741107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.741264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.741408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.741468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.741618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.741770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.741796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.741961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.742273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.742505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.742717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.742899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.743040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.743316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.743617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.743831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.743999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.744170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.744286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.744312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.744407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.744552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.744581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.744746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.744835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.744863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.744976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.745260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.745515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.745809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.745944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.265 [2024-11-18 19:26:06.746037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.746180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.265 [2024-11-18 19:26:06.746206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.265 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.746318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.746428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.746457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.746589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.746735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.746760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.746846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.746963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.746988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.747114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.747260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.747288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.747376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.747501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.747529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.747654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.747746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.747772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.747886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.748185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.748482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.748740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.748857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.749027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.749317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.749621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.749871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.749972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.750014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.750196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.750334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.750359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.750478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.750657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.750685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.750816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.750984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.751110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.751337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.751638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.751793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.751882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.752240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.752497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.752792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.752926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.753068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.753308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.753563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.753768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.266 [2024-11-18 19:26:06.753888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.266 qpair failed and we were unable to recover it. 00:27:48.266 [2024-11-18 19:26:06.754000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.754233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.754432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.754715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.754873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.755033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.755158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.755187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.755293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.755421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.755447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.755548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.755675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.755704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.755830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.756167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.756421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.756699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.756905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.757031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.757135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.757178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.757309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.757418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.757443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.757534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.757619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.757661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.757831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.758164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.758440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.758707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.758849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.758977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.759152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.759180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.759311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.759393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.759417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.759564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.759700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.759728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.759891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.760072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.760119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.760292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.760414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.760438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.760579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.760687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.760715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.760836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.761272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.761535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.761823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.761970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.267 qpair failed and we were unable to recover it. 00:27:48.267 [2024-11-18 19:26:06.762103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.762215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.267 [2024-11-18 19:26:06.762240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.762391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.762474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.762498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.762634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.762784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.762808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.762925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.763177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.763406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.763656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.763803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.763914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.764134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.764168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.764342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.764450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.764474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.764562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.764708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.764738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.764849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.765159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.765467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.765720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.765936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.766096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.766269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.766298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.766405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.766520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.766546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.766697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.766809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.766834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.766966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.767262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.767458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.767732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.767945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.768108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.768281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.768309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.768452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.768599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.768631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.768779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.768907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.768937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.769103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.769237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.769266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.268 [2024-11-18 19:26:06.769409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.769553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.268 [2024-11-18 19:26:06.769578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.268 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.769710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.769838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.769871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.770002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.770257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.770529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.770852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.770976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.771122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.771339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.771567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.771860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.771985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.772102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.772359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.772568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.772833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.772947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.773067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.773311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.773570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.773808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.773927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.774061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.774283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.774520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.774737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.774848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.774987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.775196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.775443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.775710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.775891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.776017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.776205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.776489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.269 qpair failed and we were unable to recover it. 00:27:48.269 [2024-11-18 19:26:06.776747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.269 [2024-11-18 19:26:06.776828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.776854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.777002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.777266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.777521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.777826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.777936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.778016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.778247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.778545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.778795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.778944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.779065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.779212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.779238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.779359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.779487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.779513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.779637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.779751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.779777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.779859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.780191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.780408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.780619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.780844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.780984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.781140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.781291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.781316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.781469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.781590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.781621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.781740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.781841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.781866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.782012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.782303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.782528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.782824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.782945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.783062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.783179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.783205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.783299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.783412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.783438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.783595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.783723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.783750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.783871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.784028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.784053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.270 qpair failed and we were unable to recover it. 00:27:48.270 [2024-11-18 19:26:06.784164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.270 [2024-11-18 19:26:06.784247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.784272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.784418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.784536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.784563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.784700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.784848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.784873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.785014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.785268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.785503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.785739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.785852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.785983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.786238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.786440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.786681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.786829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.786950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.787203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.787401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.787626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.787771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.787903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.788172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.788390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.788720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.788923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.789020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.789140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.789166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.789288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.789439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.789465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.789586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.789776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.789802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.789945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.790246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.790511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.790810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.790965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.791096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.791179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.791204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.791327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.791420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.791446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.271 qpair failed and we were unable to recover it. 00:27:48.271 [2024-11-18 19:26:06.791533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.791681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.271 [2024-11-18 19:26:06.791707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.791824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.791915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.791940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.792063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.792332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.792554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.792807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.792972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.793094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.793175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.793201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.793326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.793442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.793467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.793589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.793728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.793771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.793878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.794121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.794419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.794679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.794832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.794987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.795137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.795162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.795299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.795424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.795449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.795603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.795734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.795759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.795906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.796197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.796499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.796796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.796941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.797077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.797325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.797577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.797843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.797954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.798067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.798321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.798646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.798912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.798993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.799018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.799134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.799244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.272 [2024-11-18 19:26:06.799270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.272 qpair failed and we were unable to recover it. 00:27:48.272 [2024-11-18 19:26:06.799394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.799519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.799545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.799671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.799792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.799818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.799940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.800197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.800495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.800739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.800850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.800976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.801269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.801477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.801739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.801873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.802003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.802258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.802549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.802833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.802992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.803017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.803215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.803358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.803392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.803539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.803679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.803723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.803862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.804173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.804393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.804639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.804750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.805737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.805893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.805921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.806044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.806200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.806226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.806427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.806569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.806595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.806727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.806876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.806919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.273 [2024-11-18 19:26:06.807043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.807133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.273 [2024-11-18 19:26:06.807159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.273 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.807279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.807359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.807384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.807532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.807667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.807693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.807813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.807899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.807936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.808030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.808238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.808490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.808750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.808895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.809019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.809101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.809128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.809262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.809398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.809436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.809585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.809756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.809803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.809944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.810238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.810527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.810810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.810968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.811126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.811262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.811302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.811444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.811540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.811568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.811681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.811801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.811828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.811923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.812214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.812492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.274 [2024-11-18 19:26:06.812805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.274 [2024-11-18 19:26:06.812969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.274 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.813083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.813260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.813300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.813464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.813643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.813690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.813895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.814180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.814425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.814710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.814856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.814971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.815279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.815511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.815810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.815998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.816113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.816238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.816266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.816381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.816468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.816495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.554 qpair failed and we were unable to recover it. 00:27:48.554 [2024-11-18 19:26:06.816612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.554 [2024-11-18 19:26:06.816749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.816777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.816903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.817182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.817540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.817841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.817960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.818085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.818204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.818234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.818356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.818479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.818506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.818628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.818747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.818774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.818916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.819195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.819463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.819648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14c9600 (9): Bad file descriptor 00:27:48.555 [2024-11-18 19:26:06.819803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.819975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.820117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.820407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.820734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.820932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.821065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.821191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.821220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.821410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.821563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.821592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.821709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.821824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.821851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.822001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.822288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.822549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.822884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.822981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.823015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.823169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.823289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.555 [2024-11-18 19:26:06.823318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.555 qpair failed and we were unable to recover it. 00:27:48.555 [2024-11-18 19:26:06.823422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.823540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.823568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.823683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.823768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.823795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.823917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.823993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.824159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.824459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.824750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.824893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.825053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.825210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.825238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.825368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.825520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.825548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.825674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.825817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.825848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.826016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.826171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.826200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.826320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.826470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.826498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.826631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.826774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.826800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.826971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.827090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.827119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.827223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.827387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.827415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.827591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.827720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.827748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.827878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.828160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.828511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.828806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.828994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.829101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.829268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.829311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.829465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.829626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.829669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.829760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.829874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.829900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.830017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.830172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.830200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.830333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.830473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.830500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.830632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.830739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.830764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.830856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.831007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.831032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.831153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.831236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.831261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.556 qpair failed and we were unable to recover it. 00:27:48.556 [2024-11-18 19:26:06.831427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.831558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.556 [2024-11-18 19:26:06.831585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.831739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.831854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.831881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.832026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.832277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.832588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.832838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.832974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.833131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.833427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.833667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.833775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.833929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.834231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.834540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.834791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.834931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.835020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.835174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.835202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.835323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.835460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.835488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.835665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.835752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.835777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.835888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.836180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.836467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.836722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.836832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.836948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.837185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.837488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.837762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.837895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.838004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.838145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.838174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.557 qpair failed and we were unable to recover it. 00:27:48.557 [2024-11-18 19:26:06.838346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.557 [2024-11-18 19:26:06.838496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.838521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.838659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.838754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.838780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.838895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.839195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.839443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.839734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.839851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.839962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.840234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.840508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.840803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.840973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.841115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.841235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.841261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.841427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.841557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.841613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.841736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.841843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.841871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.842012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.842243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.842551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.842864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.842984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.843145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.843366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.843706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.843869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.844026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.844308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.844580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.558 [2024-11-18 19:26:06.844857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.844995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.558 [2024-11-18 19:26:06.845022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.558 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.845126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.845249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.845277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.845373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.845515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.845540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.845676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.845798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.845825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.845949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.846230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.846466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.846765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.846884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.847015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.847128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.847154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.847332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.847469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.847497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.847632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.847792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.847817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.847963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.848269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.848533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.848844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.848996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.849146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.849258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.849283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.849388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.849541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.849569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.849743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.849828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.559 [2024-11-18 19:26:06.849854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.559 qpair failed and we were unable to recover it. 00:27:48.559 [2024-11-18 19:26:06.850004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.850121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.850149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.850243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.850408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.850436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.850555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.850744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.850771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.850933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.851221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.851585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.851841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.851981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.852104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.852203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.852232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.852373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.852454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.852480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.852592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.852751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.852778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.852914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.853189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.853430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.853709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.853876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.853981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.854217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.854401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.854689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.854839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.854946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.855198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.855462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.855797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.855967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.856060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.856153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.856180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.856328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.856442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.856466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.856585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.856718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.560 [2024-11-18 19:26:06.856746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.560 qpair failed and we were unable to recover it. 00:27:48.560 [2024-11-18 19:26:06.856866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.856983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.857122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.857353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.857589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.857741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.857870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.858179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.858517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.858826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.858967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.859085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.859189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.859214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.859311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.859390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.859416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.859562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.859675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.859702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.859874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.860168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.860495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.860751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.860914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.861075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.861223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.861251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.861387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.861532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.861557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.861750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.861876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.861903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.862032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.862151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.862178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.862323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.862401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.862425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.862556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.862712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.862741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.862908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.863231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.863526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.561 qpair failed and we were unable to recover it. 00:27:48.561 [2024-11-18 19:26:06.863779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.561 [2024-11-18 19:26:06.863914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.864032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.864125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.864150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.864316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.864493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.864519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.864624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.864750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.864795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.864936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.865251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.865491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.865756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.865893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.865998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.866248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.866525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.866763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.866893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.867020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.867256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.867468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.867798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.867917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.868066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.868159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.868183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.868331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.868414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.868457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.868624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.868755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.868782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.868917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.869173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.869376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.869692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.869837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.562 qpair failed and we were unable to recover it. 00:27:48.562 [2024-11-18 19:26:06.869947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.562 [2024-11-18 19:26:06.870061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.870088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.870217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.870367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.870395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.870532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.870674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.870700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.870850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.871133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.871395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.871689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.871802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.871929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.872231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.872453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.872731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.872880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.872995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.873261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.873486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.873817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.873985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.874157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.874403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.874627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.874838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.874991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.875174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.875427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.875747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.875896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.875990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.876082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.876111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.876252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.876388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.563 [2024-11-18 19:26:06.876418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.563 qpair failed and we were unable to recover it. 00:27:48.563 [2024-11-18 19:26:06.876549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.876670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.876698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.876783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.876861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.876901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.877017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.877305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.877623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.877873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.877988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.878149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.878301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.878329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.878459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.878619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.878648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.878790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.878935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.878959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.879090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.879296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.879619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.879850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.879987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.880125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.880386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.880591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.880797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.880912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.881001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.881236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.881490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.881820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.881955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.882117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.882274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.882302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.882398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.882519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.882546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.882691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.882776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.882806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.882903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.883009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.883034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.564 qpair failed and we were unable to recover it. 00:27:48.564 [2024-11-18 19:26:06.883142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.564 [2024-11-18 19:26:06.883219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.883243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.883354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.883434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.883461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.883603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.883746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.883771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.883869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.883964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.884120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.884379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.884601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.884809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.884956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.885231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.885532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.885780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.885914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.886044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.886333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.886580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.886824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.886962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.887085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.887202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.887226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.887374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.887454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.887479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.887580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.887720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.887749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.887879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.888197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.888487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.888731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.888849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.565 qpair failed and we were unable to recover it. 00:27:48.565 [2024-11-18 19:26:06.889003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.889118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.565 [2024-11-18 19:26:06.889143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.889281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.889440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.889469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.889593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.889766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.889794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.889944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.890223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.890466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.890766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.890920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.891066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.891224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.891252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.891384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.891514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.891542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.891716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.891856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.891881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.891975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.892230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.892468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.892732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.892884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.893007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.893249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.893442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.893726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.893871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.894021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.894261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.894591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.894836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.894986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.895156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.895282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.895310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.895412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.895530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.895557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.566 qpair failed and we were unable to recover it. 00:27:48.566 [2024-11-18 19:26:06.895693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.895806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.566 [2024-11-18 19:26:06.895831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.895965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.896121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.896149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.896304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.896428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.896457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.896601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.896734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.896761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.896942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.897224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.897494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.897805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.897953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.898046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.898146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.898175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.898318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.898430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.898455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.898621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.898755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.898784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.898908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.899192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.899428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.899700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.899834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.899978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.900100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.900125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.900303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.900429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.900457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.900623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.900794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.900820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.900916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.901180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.901396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.901707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.901823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.901935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.902169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.902485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.567 qpair failed and we were unable to recover it. 00:27:48.567 [2024-11-18 19:26:06.902767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.567 [2024-11-18 19:26:06.902929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.903032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.903147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.903175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.903339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.903482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.903523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.903673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.903776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.903801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.903918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.904207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.904485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.904812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.904992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.905099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.905304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.905552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.905805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.905927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.906017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.906301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.906527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.906781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.906937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.907023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.907237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.907454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.907779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.907981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.908102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.908220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.908245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.908401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.908525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.908571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.908701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.908817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.908843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.908929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.909043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.909069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.568 qpair failed and we were unable to recover it. 00:27:48.568 [2024-11-18 19:26:06.909245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.909416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.568 [2024-11-18 19:26:06.909441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.909561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.909728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.909754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.909852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.909939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.909963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.910063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.910325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.910603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.910837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.910971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.911119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.911389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.911619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.911840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.911954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.912062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.912277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.912534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.912781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.912952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.913091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.913311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.913656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.913892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.913988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.914138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.914371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.914704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.914887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.915034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.915142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.915167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.915260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.915401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.569 [2024-11-18 19:26:06.915427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.569 qpair failed and we were unable to recover it. 00:27:48.569 [2024-11-18 19:26:06.915566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.915712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.915738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.915855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.915964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.915992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.916142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.916380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.916613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.916828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.916957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.917052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.917342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.917605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.917812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.917979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.918119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.918444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.918773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.918887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.918996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.919116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.919145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.919290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.919401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.919428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.919535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.919661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.919692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.919852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.920157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.920414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.920640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.570 [2024-11-18 19:26:06.920772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.570 qpair failed and we were unable to recover it. 00:27:48.570 [2024-11-18 19:26:06.920854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.920970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.920995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.921115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.921281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.921314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.921470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.921639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.921665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.921758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.921870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.921896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.922038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.922310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.922579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.922888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.922980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.923129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.923479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.923735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.923893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.924035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.924268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.924488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.924690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.924877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.924996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.925203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.925497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.925809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.925953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.926122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.926218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.926245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.926363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.926449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.926478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.926605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.926726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.926755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.926926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.927018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.927047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.571 qpair failed and we were unable to recover it. 00:27:48.571 [2024-11-18 19:26:06.927137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.571 [2024-11-18 19:26:06.927291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.927320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.927454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.927562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.927588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.927732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.927832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.927860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.927984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.928227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.928557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.928813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.928970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.929080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.929199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.929225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.929368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.929475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.929508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.929647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.929780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.929808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.929949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.930233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.930532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.930792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.930922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.931046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.931310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.931618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.931850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.931979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.932079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.932204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.932233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.932374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.932493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.932520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.932663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.932787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.932816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.932977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.933109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.933139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.933284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.933406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.933432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.933555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.933692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.933723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.572 qpair failed and we were unable to recover it. 00:27:48.572 [2024-11-18 19:26:06.933852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.572 [2024-11-18 19:26:06.934008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.934172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.934437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.934734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.934913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.935091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.935203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.935229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.935330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.935440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.935466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.935564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.935729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.935757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.935929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.936156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.936497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.936789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.936909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.937033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.937180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.937208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.937344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.937461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.937490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.937668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.937811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.937836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.937994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.938140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.938167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.938305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.938460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.938489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.938629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.938713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.938738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.938871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.939136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.939386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.939635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.939831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.939988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.940077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.940105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.940270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.940353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.940378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.573 qpair failed and we were unable to recover it. 00:27:48.573 [2024-11-18 19:26:06.940510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.573 [2024-11-18 19:26:06.940642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.940671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.940796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.940949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.940978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.941142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.941258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.941284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.941466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.941613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.941640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.941820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.941981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.942121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.942413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.942742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.942932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.943089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.943174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.943199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.943320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.943487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.943516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.943687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.943797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.943823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.943905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.944201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.944459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.944708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.944877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.945041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.945169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.945199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.945330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.945454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.945483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.945639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.945757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.945782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.945953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.946230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.946551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.946808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.946951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.574 [2024-11-18 19:26:06.947084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.947216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.574 [2024-11-18 19:26:06.947244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.574 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.947375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.947491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.947517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.947685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.947778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.947808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.947958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.948222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.948559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.948785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.948964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.949107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.949246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.949272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.949389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.949523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.949551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.949719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.949798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.949823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.949975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.950207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.950477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.950707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.950838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.950956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.951221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.951563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.951803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.951959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.952065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.952191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.952219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.952363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.952477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.952502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.952675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.952819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.952844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.952961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.953187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.953410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.953673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.953814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.953897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.954139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.954397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.954663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.954780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.575 qpair failed and we were unable to recover it. 00:27:48.575 [2024-11-18 19:26:06.954913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.575 [2024-11-18 19:26:06.955019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.955171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.955405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.955673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.955804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.955919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.956202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.956480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.956746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.956879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.957006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.957310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.957505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.957764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.957904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.958040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.958307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.958601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.958876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.958972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.959104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.959429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.959758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.959909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.960017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.960174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.960203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.960346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.960463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.960489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.960659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.960792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.960822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.960954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.961119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.961148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.961265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.961381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.576 [2024-11-18 19:26:06.961408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.576 qpair failed and we were unable to recover it. 00:27:48.576 [2024-11-18 19:26:06.961540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.961696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.961725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.961832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.961982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.962095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.962356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.962620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.962773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.962943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.963191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.963529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.963792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.963922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.964016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.964232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.964511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.964813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.964975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.965102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.965230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.965258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.965423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.965542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.965567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.965721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.965845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.965872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.966027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.966289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.966580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.966845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.966980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.967066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.967346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.967531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.967735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.967837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.967999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.968279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.968572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.968817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.968993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.577 qpair failed and we were unable to recover it. 00:27:48.577 [2024-11-18 19:26:06.969138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.577 [2024-11-18 19:26:06.969268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.969296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.969435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.969521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.969548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.969712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.969840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.969868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.969998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.970314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.970584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.970855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.970981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.971101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.971244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.971270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.971371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.971453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.971481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.971600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.971747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.971781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.971925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.972188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.972403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.972673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.972817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.972984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.973144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.973172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.973329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.973452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.973481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.973594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.973725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.973752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.973895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.974155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.974422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.974694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.974816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.974938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.975248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.975557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.975870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.975976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.976095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.976345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.976593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.578 qpair failed and we were unable to recover it. 00:27:48.578 [2024-11-18 19:26:06.976896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.976976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.578 [2024-11-18 19:26:06.977001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.977147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.977273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.977302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.977414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.977531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.977559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.977672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.977790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.977816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.977916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.978173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.978483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.978782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.978937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.979050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.979338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.979559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.979826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.979976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.980143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.980268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.980293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.980432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.980558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.980588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.980698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.980826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.980854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.981000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.981215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.981530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.981832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.981936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.982100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.982216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.982245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.982376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.982472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.982501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.982670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.982796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.982822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.983008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.983159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.983188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.983360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.983472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.983497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.983612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.983758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.983784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.983906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.984186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.984439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.984689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.579 [2024-11-18 19:26:06.984808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.579 qpair failed and we were unable to recover it. 00:27:48.579 [2024-11-18 19:26:06.984921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.985149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.985451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.985737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.985915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.986049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.986139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.986165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.986315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.986446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.986474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.986601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.986729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.986757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.986903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.987242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.987512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.987823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.987961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.988088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.988363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.988667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.988892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.988997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.989149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.989482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.989703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.989806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.989980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.990206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.990473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.990785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.990938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.991056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.991175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.991201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.991338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.991459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.991487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.580 [2024-11-18 19:26:06.991622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.991721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.580 [2024-11-18 19:26:06.991765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.580 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.991910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.992181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.992447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.992714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.992852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.992992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.993263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.993529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.993829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.993991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.994124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.994416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.994697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.994851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.994987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.995257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.995553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.995796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.995956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.996071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.996305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.996560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.996817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.996993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.997175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.997460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.997736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.997872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.998013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.998258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.998529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.998723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.998891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.999029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.999146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.999174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.581 [2024-11-18 19:26:06.999292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.999369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.581 [2024-11-18 19:26:06.999395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.581 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:06.999475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:06.999617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:06.999647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:06.999791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:06.999901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:06.999928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.000073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.000217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.000259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.000419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.000546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.000574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.000720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.000840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.000865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.000978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.001098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.001124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.001227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.001391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.001420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.001572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.001733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.001760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.001881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.002190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.002461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.002744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.002890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.003015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.003252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.003557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.003763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.003905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.004028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.004269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.004491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.004848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.004974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.005144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.005413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.005687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.005832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.005925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.006130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.006411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.006696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.006871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.006965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.007051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.007094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.582 qpair failed and we were unable to recover it. 00:27:48.582 [2024-11-18 19:26:07.007255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.582 [2024-11-18 19:26:07.007407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.007435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.007576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.007706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.007731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.007823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.007907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.007937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.008053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.008344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.008593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.008877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.008992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.009151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.009454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.009814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.009934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.010081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.010362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.010627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.010837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.010981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.011132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.011387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.011633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.011857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.011993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.012144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.012447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.012719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.012865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.012977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.013288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.013548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.013839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.013992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.014154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.014378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.014675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.014817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.583 qpair failed and we were unable to recover it. 00:27:48.583 [2024-11-18 19:26:07.014935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.015023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.583 [2024-11-18 19:26:07.015051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.015226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.015377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.015405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.015559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.015699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.015727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.015890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.016150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.016438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.016673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.016779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.016922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.017213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.017506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.017794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.017953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.018051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.018330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.018595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.018882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.018986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.019129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.019369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.019703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.019872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.020059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.020178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.020204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.020371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.020490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.020517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.020641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.020768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.020796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.020904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.021191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.021426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.021753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.021917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.022024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.022338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.022591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.022866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.022999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.023119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.023258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.023285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.023371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.023479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.023504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.584 qpair failed and we were unable to recover it. 00:27:48.584 [2024-11-18 19:26:07.023624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.584 [2024-11-18 19:26:07.023737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.023763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.023891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.023981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.024008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.024156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.024251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.024278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.024432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.024556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.024584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.024770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.024956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.025149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.025425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.025733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.025905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.026021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.026303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.026538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.026830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.026968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.027088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.027183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.027210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.027359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.027505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.027531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.027667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.027795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.027822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.027920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.028161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.028426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.028740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.028842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.028944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.029196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.029502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.029754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.029926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.030010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.030250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.030497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.585 qpair failed and we were unable to recover it. 00:27:48.585 [2024-11-18 19:26:07.030797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.585 [2024-11-18 19:26:07.030949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.030975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.031118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.031265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.031291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.031404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.031516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.031542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.031685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.031792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.031818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.031930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.032196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.032451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.032727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.032860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.033043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.033338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.033541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.033863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.033991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.034110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.034385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.034625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.034798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.034935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.035225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.035553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.035834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.035983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.036133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.036442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.036702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.036871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.037018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.037239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.037513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.037799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.037920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.038024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.038269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.038572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.038872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.038997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.039025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.039129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.039249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.586 [2024-11-18 19:26:07.039276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.586 qpair failed and we were unable to recover it. 00:27:48.586 [2024-11-18 19:26:07.039437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.039525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.039553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.039730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.039837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.039862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.039997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.040201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.040467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.040704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.040842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.040938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.041193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.041525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.041826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.041968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.042137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.042249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.042275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.042405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.042534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.042563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.042684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.042802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.042828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.042912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.043176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.043490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.043816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.043926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.044035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.044352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.044664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.044855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.044979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.045091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.045476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.045762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.045914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.046064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.046230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.046259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.046391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.046516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.046547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.046685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.046804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.046830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.046975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.047099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.047129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.047312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.047440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.047469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.047613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.047753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.047779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.047919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.048079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.048107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.048241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.048388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.048417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.587 [2024-11-18 19:26:07.048554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.048689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.587 [2024-11-18 19:26:07.048716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.587 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.048831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.048911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.048955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.049104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.049349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.049640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.049860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.049977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.050117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.050370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.050649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.050789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.050877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.051034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.051062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.051183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.051334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.051363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.051555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.051699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.051726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.051843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.052010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.052039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.052166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.052305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.052331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.052577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.052766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.052793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.052926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.053209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.053489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.053742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.053930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.054059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.054224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.054251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.054393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.054502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.054528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.054648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.054764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.054806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.054937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.055222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.055450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.055767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.055955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.056077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.056198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.056227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.056350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.056508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.056536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.056671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.056812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.056841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.057026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.057310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.057603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.057831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.057972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.058060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.058166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.588 [2024-11-18 19:26:07.058192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.588 qpair failed and we were unable to recover it. 00:27:48.588 [2024-11-18 19:26:07.058313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.058479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.058508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.058620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.058736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.058761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.058894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.058984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.059148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.059452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.059747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.059917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.060026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.060153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.060182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.060328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.060455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.060481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.060664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.060808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.060833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.061002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.061226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.061465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.061762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.061885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.062056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.062197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.062223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.062394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.062523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.062564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.062717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.062823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.062951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.063204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.063459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.063690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.063834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.063995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.064086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.064114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.064236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.064366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.064394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.064547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.064704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.064730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.064913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.065173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.065437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.065687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.065892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.065999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.066147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.066225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.066250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.589 qpair failed and we were unable to recover it. 00:27:48.589 [2024-11-18 19:26:07.066337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.066507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.589 [2024-11-18 19:26:07.066534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.066700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.066828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.066856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.066977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.067205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.067484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.067779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.067925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.068057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.068161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.068189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.068310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.068434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.068463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.068632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.068727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.068753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.068872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.069178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.069452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.069734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.069875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.069979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.070228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.070486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.070802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.070926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.071092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.071174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.071201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.071339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.071489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.071515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.071602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.071731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.071773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.071929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.072196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.072507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.072800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.072980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.073125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.073220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.073252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.073418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.073548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.073575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.073683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.073831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.073857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.073992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.074251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.074518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.074819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.074976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.075074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.075198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.075227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.075337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.075445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.075478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.075620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.075746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.590 [2024-11-18 19:26:07.075774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.590 qpair failed and we were unable to recover it. 00:27:48.590 [2024-11-18 19:26:07.075915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.076177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.076465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.076778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.076940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.077053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.077293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.077527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.077781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.077925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.078037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.078237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.078473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.078769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.078936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.079098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.079230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.079257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.079395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.079540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.079565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.079677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.079788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.079813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.079913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.080217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.080531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.080805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.080987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.081099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.081245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.081271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.081426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.081586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.081619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.081745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.081861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.081888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.082032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.082329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.082622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.082877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.082990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.083171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.083495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.083830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.083988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.084117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.084239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.084267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.084384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.084486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.084513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.084654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.084766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.084792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.084901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.085032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.085058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.591 qpair failed and we were unable to recover it. 00:27:48.591 [2024-11-18 19:26:07.085172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.085247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.591 [2024-11-18 19:26:07.085272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.085426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.085545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.085571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.085680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.085788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.085813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.085946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.086241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.086444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.086720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.086884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.087022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.087161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.087187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.087323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.087430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.087463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.087590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.087720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.087749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.087901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.088216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.088503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.088759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.088928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.089078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.089209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.089238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.089366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.089492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.089522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.089666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.089781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.089806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.089891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.090152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.090400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.090688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.090843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.090977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.091252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.091533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.091888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.091966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.092114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.092350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.092575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.092784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.092896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.093199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.093479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.093775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.093948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.094068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.094160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.094184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.094269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.094430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.094458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.094574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.094731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.094757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.094926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.095041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.095070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.592 qpair failed and we were unable to recover it. 00:27:48.592 [2024-11-18 19:26:07.095206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.592 [2024-11-18 19:26:07.095357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.095385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.095546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.095654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.095682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.095824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.095949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.095976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.096091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.096245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.096270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.096430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.096553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.096581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.096742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.096901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.096930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.097076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.097356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.097565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.097839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.097963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.098098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.098193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.098219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.098381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.098508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.098536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.098677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.098806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.098830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.098959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.099223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.099433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.099721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.099828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.099910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.100178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.100416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.100766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.100911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.100994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.101250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.101461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.101714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.101856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.101981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.102250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.102474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.102713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.102824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.102943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.103173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.103430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.593 qpair failed and we were unable to recover it. 00:27:48.593 [2024-11-18 19:26:07.103669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.593 [2024-11-18 19:26:07.103812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.103933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.104164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.104413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.104668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.104808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.104930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.105132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.105390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.105649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.105873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.105979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.106098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.106215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.106239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.106328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.106455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.106482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.106621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.106750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.106774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.106906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.107160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.107451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.107763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.107910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.108031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.108245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.108492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.108788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.108899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.109024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.109254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.109502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.109733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.109869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.109999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.110251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.110485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.110756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.110867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.111037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.111188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.111236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.111379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.111484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.111510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.111632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.111775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.111801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.111890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.112169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.112397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.112682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.112844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.594 qpair failed and we were unable to recover it. 00:27:48.594 [2024-11-18 19:26:07.112948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.113096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.594 [2024-11-18 19:26:07.113124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.113255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.113383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.113412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.113582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.113702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.113727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.113813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.113924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.113949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.114063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.114144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.114170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.114308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.114422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.114450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.114578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.114730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.114757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.114938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.115220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.115474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.115761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.115954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.116130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.116233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.116264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.116441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.116553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.116579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.116706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.116825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.116854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.117030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.117225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.117273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.117420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.117502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.117528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.117666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.117824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.117875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.118052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.118201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.118245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.118332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.118456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.118482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.118590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.118735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.118763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.118864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.119223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.119476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.119725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.119854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.119955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.120226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.120496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.120783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.120940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.121066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.121306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.121547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.121798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.121964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.122069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.122386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.122643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.122898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.122991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.123021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.595 qpair failed and we were unable to recover it. 00:27:48.595 [2024-11-18 19:26:07.123126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.123248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.595 [2024-11-18 19:26:07.123276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.123413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.123528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.123557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.123726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.123847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.123874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.124019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.124145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.124174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.124285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.124410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.124436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.124559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.124720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.124747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.124872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.125222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.125481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.125814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.125980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.126092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.126224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.126250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.126339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.126462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.126488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.126598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.126779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.126808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.126923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.127238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.127475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.127780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.127962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.128124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.128353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.128578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.128893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.128989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.129105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.129341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.129570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.129866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.129982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.130133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.130340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.130570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.130806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.130948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.131040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.131162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.131188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.131331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.131460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.131488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.131628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.131820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.131868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.132040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.132157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.596 [2024-11-18 19:26:07.132185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.596 qpair failed and we were unable to recover it. 00:27:48.596 [2024-11-18 19:26:07.132308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.132396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.132423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.132593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.132747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.132776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.132936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.133183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.133398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.133643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.133887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.133996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.134111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.134191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.134239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.134372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.134547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.134573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.134693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.134797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.134825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.134976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.135305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.135555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.135842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.135990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.136120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.136237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.136265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.597 [2024-11-18 19:26:07.136461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.136598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.597 [2024-11-18 19:26:07.136641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.597 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.136765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.136849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.136875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.136955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.137207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.137441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.137709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.137876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.138002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.138128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.138155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.138256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.138374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.138416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.880 qpair failed and we were unable to recover it. 00:27:48.880 [2024-11-18 19:26:07.138534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.138643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.880 [2024-11-18 19:26:07.138670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.138752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.138893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.138922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.139054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.139184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.139212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.139383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.139517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.139542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.139668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.139751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.139776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.140028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.140276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.140504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.140763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.140886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.141007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.141251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.141566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.141787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.141953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.142111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.142211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.142238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.142331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.142453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.142481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.142602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.142741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.142765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.142913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.143132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.143376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.143672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.143779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.143909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.144191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.144452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.144707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.144823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.144967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.145267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.145540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.145816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.145997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.146049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.146168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.146297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.146324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.881 qpair failed and we were unable to recover it. 00:27:48.881 [2024-11-18 19:26:07.146479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.881 [2024-11-18 19:26:07.146577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.146605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.146782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.146866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.146890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.147026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.147309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.147594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.147868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.147973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.148093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.148319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.148571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.148877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.148988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.149112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.149421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.149711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.149882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.149998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.150227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.150450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.150644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.150807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.150898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.151178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.151455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.151739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.151881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.151982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.152096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.152124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.152236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3564181 Killed "${NVMF_APP[@]}" "$@" 00:27:48.882 [2024-11-18 19:26:07.152320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.152344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.152443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.152603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 19:26:07 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:48.882 [2024-11-18 19:26:07.152658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.152757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 19:26:07 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:48.882 [2024-11-18 19:26:07.152852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.152880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 19:26:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:48.882 [2024-11-18 19:26:07.152977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.153055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.153079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 19:26:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:48.882 [2024-11-18 19:26:07.153162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 19:26:07 -- common/autotest_common.sh@10 -- # set +x 00:27:48.882 [2024-11-18 19:26:07.153255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.153282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.882 qpair failed and we were unable to recover it. 00:27:48.882 [2024-11-18 19:26:07.153455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.153538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.882 [2024-11-18 19:26:07.153563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.153698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.153837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.153862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.154030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.154242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.154500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.154791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.154946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.155080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.155221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.155246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.155354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.155470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.155494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.155594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.155714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.155741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.155900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.156165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.156382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 19:26:07 -- nvmf/common.sh@469 -- # nvmfpid=3564881 00:27:48.883 [2024-11-18 19:26:07.156640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 19:26:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:48.883 [2024-11-18 19:26:07.156735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.156762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 19:26:07 -- nvmf/common.sh@470 -- # waitforlisten 3564881 00:27:48.883 [2024-11-18 19:26:07.156876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 19:26:07 -- common/autotest_common.sh@829 -- # '[' -z 3564881 ']' 00:27:48.883 [2024-11-18 19:26:07.156987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.157013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 19:26:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:48.883 [2024-11-18 19:26:07.157152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 19:26:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:48.883 [2024-11-18 19:26:07.157281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.157310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 19:26:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:48.883 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:48.883 [2024-11-18 19:26:07.157408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 19:26:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:48.883 [2024-11-18 19:26:07.157532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.157560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 19:26:07 -- common/autotest_common.sh@10 -- # set +x 00:27:48.883 [2024-11-18 19:26:07.157675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.157784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.157810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.157920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.158240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.158547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.158845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.158971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.159064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.159305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.159580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.159841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.159994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.160088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.160169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.160194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.883 [2024-11-18 19:26:07.160313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.160399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.883 [2024-11-18 19:26:07.160425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.883 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.160524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.160637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.160673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.160762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.160858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.160883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.161020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.161239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.161461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.161723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.161908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.162295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.162445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.162472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.162595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.162692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.162717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.162805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.162943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.162972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.163079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.163376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.163645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.163874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.163977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.164153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.164410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.164664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.164823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.164981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.165246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.165487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.165782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.165900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.166035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.166152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.166180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.166300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.166453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.166481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.166660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.166761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.166786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.166905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.167224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.167523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.167732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.167895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.168037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.168157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.168183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.884 qpair failed and we were unable to recover it. 00:27:48.884 [2024-11-18 19:26:07.168282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.168398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.884 [2024-11-18 19:26:07.168425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.168527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.168640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.168670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.168779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.168900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.168928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.169050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.169289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.169538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.169855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.169994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.170148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.170426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.170689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.170801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.170925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.171232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.171504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.171706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.171826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.171946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.172269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.172475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.172724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.172850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.172967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.173194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.173500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.173818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.173931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.174068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.174193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.174221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.174385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.174509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.174538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.174678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.174817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.885 [2024-11-18 19:26:07.174842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.885 qpair failed and we were unable to recover it. 00:27:48.885 [2024-11-18 19:26:07.174989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.175114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.175147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.175274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.175434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.175458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.175594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.175743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.175768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.175903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.176200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.176439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.176678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.176853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.177044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.177299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.177539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.177782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.177908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.178030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.178318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.178581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.178865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.178986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.179156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.179390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.179642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.179883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.179997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.180145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.180380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.180591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.180852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.180970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.181082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.181283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.181504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.181727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.181837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.181964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.182047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.182072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.886 [2024-11-18 19:26:07.182165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.182315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.886 [2024-11-18 19:26:07.182340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.886 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.182460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.182558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.182583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.182701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.182821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.182852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.182967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.183242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.183469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.183758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.183879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.183979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.184232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.184429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.184745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.184887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.185003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.185271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.185496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.185746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.185886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.185977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.186205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.186442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.186720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.186836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.186927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.187147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.187384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.187657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.187844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.187994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.188141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.188234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.188261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.188385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.188496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.188521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.188671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.188785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.188811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.188974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.189091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.189117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.189241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.189329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.189355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.887 qpair failed and we were unable to recover it. 00:27:48.887 [2024-11-18 19:26:07.189506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.887 [2024-11-18 19:26:07.189586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.189622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.189761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.189878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.189912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.190032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.190243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.190518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.190783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.190956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.191076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.191277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.191545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.191760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.191876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.191977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.192199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.192454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.192762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.192878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.192981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.193235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.193495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.193720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.193864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.193962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.194168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.194427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.194662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.194781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.194896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.195164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.195393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.195632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.195773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.195890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.196003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.196028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.196141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.196256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.196282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.888 [2024-11-18 19:26:07.196398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.196476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.888 [2024-11-18 19:26:07.196502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.888 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.196623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.196646] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:48.889 [2024-11-18 19:26:07.196718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.196723] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:48.889 [2024-11-18 19:26:07.196755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.196898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.197179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.197368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.197569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.197845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.197977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.198064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.198363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.198618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.198860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.198986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.199073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.199362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.199620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.199876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.199996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.200109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.200349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.200620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.200857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.200977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.201125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.201387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.201594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.201823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.201967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.202049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.202135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.202162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.889 [2024-11-18 19:26:07.202311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.202425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.889 [2024-11-18 19:26:07.202451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.889 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.202544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.202671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.202697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.202812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.202939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.202965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.203068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.203318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.203560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.203818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.203934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.204049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.204273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.204498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.204737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.204909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.205029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.205265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.205500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.205762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.205904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.206027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.206243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.206502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.206731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.206869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.206969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.207281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.207560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.207790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.207912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.208031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.208249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.208478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.208711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.208829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.208943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.209028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.209055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.209138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.209241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.209267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.890 qpair failed and we were unable to recover it. 00:27:48.890 [2024-11-18 19:26:07.209353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.890 [2024-11-18 19:26:07.209494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.209520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.209604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.209733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.209760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.209873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.209983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.210129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.210369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.210585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.210818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.210961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.211079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.211285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.211510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.211783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.211891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.211981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.212238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.212462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.212721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.212861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.212952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.213188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.213453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.213788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.213956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.214044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.214274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.214541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.214799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.214938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.215064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.215301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.215555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.215772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.215911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.215990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.216068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.216094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.216220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.216333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.216359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.891 qpair failed and we were unable to recover it. 00:27:48.891 [2024-11-18 19:26:07.216435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.891 [2024-11-18 19:26:07.216557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.216584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.216721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.216850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.216876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.217001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.217295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.217556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.217763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.217882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.218001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.218237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.218506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.218729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.218898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.219022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.219256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.219481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.219790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.219913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.220040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.220335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.220561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.220802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.220934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.221080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.221333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.221577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.221817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.221962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.222083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.222289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.222557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.222863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.222976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.223130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.223362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.223580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.892 [2024-11-18 19:26:07.223699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.892 qpair failed and we were unable to recover it. 00:27:48.892 [2024-11-18 19:26:07.223814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.223901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.223927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.224010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.224246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.224506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.224773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.224920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.225001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.225227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.225441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.225716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.225862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.225972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.226234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.226496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.226730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.226875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.226965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.227187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.227389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.227617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.227880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.227997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.228085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.228332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.228585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.228800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.228915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.229026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.229236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.229462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.229720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.229893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.229983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.230101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.230127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.230249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.893 [2024-11-18 19:26:07.230369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.230395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.893 qpair failed and we were unable to recover it. 00:27:48.893 [2024-11-18 19:26:07.230514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.893 [2024-11-18 19:26:07.230632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.230659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.230774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.230864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.230889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.230989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.231214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.231399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.231624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.231827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.231944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.232041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.232286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.232531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.232788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.232900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.233028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.233229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.233454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.233664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.233802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.233898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.234182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.234434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.234672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.234870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.234994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.235112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.235332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.235527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.235750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.235851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.235965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.236114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.236140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.236233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.236374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.894 [2024-11-18 19:26:07.236399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.894 qpair failed and we were unable to recover it. 00:27:48.894 [2024-11-18 19:26:07.236483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.236639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.236668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.236781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.236910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.236936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.237049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.237283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.237526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.237777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.237905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.238047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.238274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.238570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.238803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.238942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.239063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.239290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.239518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.239745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.239865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.239960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.240202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.240438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.240668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.240883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.240989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.241110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.241311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.241580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.241829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.241948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.242066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.242250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.242504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.242740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.242851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.242968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.243075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.243101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.243247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.243338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.895 [2024-11-18 19:26:07.243363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.895 qpair failed and we were unable to recover it. 00:27:48.895 [2024-11-18 19:26:07.243475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.243550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.243575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.243690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.243800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.243826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.243922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.243997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.244122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.244340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.244587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.244817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.244925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.245044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.245230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.245496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.245762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.245910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.246023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.246249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.246461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.246689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.246835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.246954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.247153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.247373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.247591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.247828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.247969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.248064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.248327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.248535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.248777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.248913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.248992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.249221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.249477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.249689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.249834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.249926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.250009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.896 [2024-11-18 19:26:07.250034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.896 qpair failed and we were unable to recover it. 00:27:48.896 [2024-11-18 19:26:07.250157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.250384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.250614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.250821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.250953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.251044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.251284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.251540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.251753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.251896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.252017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.252257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.252506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.252714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.252890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.253000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.253221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.253489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.253749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.253900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.254000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.254251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.254488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.254784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.254894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.254985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.255208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.255444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.255677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.255777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.255895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.256128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.256376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.256663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.256803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.897 [2024-11-18 19:26:07.256914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.257014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.897 [2024-11-18 19:26:07.257040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.897 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.257142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.257374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.257634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.257841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.257976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.258064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.258291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.258502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.258705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.258820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.258937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.259166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.259354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.259603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.259880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.259997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.260121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.260344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.260603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.260836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.260987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.261068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.261275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.261506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.261776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.261888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.261971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.262210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.262443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.262725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.262868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.262963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.263186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.263448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.898 qpair failed and we were unable to recover it. 00:27:48.898 [2024-11-18 19:26:07.263723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.898 [2024-11-18 19:26:07.263817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.263844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.263929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.264158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.264418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264464] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:48.899 [2024-11-18 19:26:07.264525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.264663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.264849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.264964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.265070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.265326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.265536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.265781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.265901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.266001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.266254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.266469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.266699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.266910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.266995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.267143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.267357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.267603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.267803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.267923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.268032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.268269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.268467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.268710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.268859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.268946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.269058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.269083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.269174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.269254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.269279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.899 [2024-11-18 19:26:07.269391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.269579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.899 [2024-11-18 19:26:07.269605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.899 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.269743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.269839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.269865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.269987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.270204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.270464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.270787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.270906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.270992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.271218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.271443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.271713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.271849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.271953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.272191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.272438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.272694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.272837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.272967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.273190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.273386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.273636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.273785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.273905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.274115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.274361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.274627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.274871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.274988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.275138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.275370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.275589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.275782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.275897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.276013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.276094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.276119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.276204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.276343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.900 [2024-11-18 19:26:07.276367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.900 qpair failed and we were unable to recover it. 00:27:48.900 [2024-11-18 19:26:07.276467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.276554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.276581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.276708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.276809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.276834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.276955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.277147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.277347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.277599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.277762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.277891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.278171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.278399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.278633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.278879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.278993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.279109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.279339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.279564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.279755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.279896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.279988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.280254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.280535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.280750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.280867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.280949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.281215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.281465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.281748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.281900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.281985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.282224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.282515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.282758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.282860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.282947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.283028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.283055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.901 [2024-11-18 19:26:07.283179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.283269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.901 [2024-11-18 19:26:07.283295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.901 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.283383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.283470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.283495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.283619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.283729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.283756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.283839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.283992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.284146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.284368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.284602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.284822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.284932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.285056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.285249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.285493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.285750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.285873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.285988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.286223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.286459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.286711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.286836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.286948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.287210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.287500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.287764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.287897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.287986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.288220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.288455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.288727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.288843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.288960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.289186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.289426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.289670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.289814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.289912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.290037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.290063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.902 [2024-11-18 19:26:07.290153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.290239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.902 [2024-11-18 19:26:07.290265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.902 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.290368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.290484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.290510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.290631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.290720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.290748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.290894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.291156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.291388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.291650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.291885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.291998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.292125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.292358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.292595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.292825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.292959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.293081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.293292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.293514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.293810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.293980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.294096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.294324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.294516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.294746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.294854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.294933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.295189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.295451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.295723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.295857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.295982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.296062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.296087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.296175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.296267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.903 [2024-11-18 19:26:07.296292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.903 qpair failed and we were unable to recover it. 00:27:48.903 [2024-11-18 19:26:07.296393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.296503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.296528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.296620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.296763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.296789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.296902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.296997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.297110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.297336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.297567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.297824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.297961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.298041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.298320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.298514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.298772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.298913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.299015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.299252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.299459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.299728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.299873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.299970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.300189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.300430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.300691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.300805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.300930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.301189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.301420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.301639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.301860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.301970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.302063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.302319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.302505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.302782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.302956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.303048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.303122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.904 [2024-11-18 19:26:07.303146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.904 qpair failed and we were unable to recover it. 00:27:48.904 [2024-11-18 19:26:07.303267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.303352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.303377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.303499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.303591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.303622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.303745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.303854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.303879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.303960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.304192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.304416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.304773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.304942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.305029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.305268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.305523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.305757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.305902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.305996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.306269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.306528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.306773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.306918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.307035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.307254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.307512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.307725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.307831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.307923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.308139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.308339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.308568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.308794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.308942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.309034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.309297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.309538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.309781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.309922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.905 [2024-11-18 19:26:07.310008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.310126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.905 [2024-11-18 19:26:07.310151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.905 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.310262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.310376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.310402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.310525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.310628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.310655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.310747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.310868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.310893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.310985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.311246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.311503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.311722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.311834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.311923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.312166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.312394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.312614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.312877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.312997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.313108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.313225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.313252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.313346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.313472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.313498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.313643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.313755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.313781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.313900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.314122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.314372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.314568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.314807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.314972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.315070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.315338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.315574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.315776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.315889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.316011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.316291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.316526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.316756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.316871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.906 qpair failed and we were unable to recover it. 00:27:48.906 [2024-11-18 19:26:07.316959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.906 [2024-11-18 19:26:07.317067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.317213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.317439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.317702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.317871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.317966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.318262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.318553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.318791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.318908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.319026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.319298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.319560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.319774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.319913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.320032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.320296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.320565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.320798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.320902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.321001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.321190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.321380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.321647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.321788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.321924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.322143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.322356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.322588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.322805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.322918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.323004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.323271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.323548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.907 [2024-11-18 19:26:07.323808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.907 [2024-11-18 19:26:07.323924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.907 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.324008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.324250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.324458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.324701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.324822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.324944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.325201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.325408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.325683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.325837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.325932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.326187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.326414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.326627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.326771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.326870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.327129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.327366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.327643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.327795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.327922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.328190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.328422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.328635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.328844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.328955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.329074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.329368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.329567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.908 qpair failed and we were unable to recover it. 00:27:48.908 [2024-11-18 19:26:07.329826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.908 [2024-11-18 19:26:07.329931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.329957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.330086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.330388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.330622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.330834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.330947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.331042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.331295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.331546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.331763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.331905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.332015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.332252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.332522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.332766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.332906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.332990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.333215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.333438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.333672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.333807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.333928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.334198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.334519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.334786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.334933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.335024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.335264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.335523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.335787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.335965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.336066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.336298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.336534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.909 qpair failed and we were unable to recover it. 00:27:48.909 [2024-11-18 19:26:07.336735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.909 [2024-11-18 19:26:07.336815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.336841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.336932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.337192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.337483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.337746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.337855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.337971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.338233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.338468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.338727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.338871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.338992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.339184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.339427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.339656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.339881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.339993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.340083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.340313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.340517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.340766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.340910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.341061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.341329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.341549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.341847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.341948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.342067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.342277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.342543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.342809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.342961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.343079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.343224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.343249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.343343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.343458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.343483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.343565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.343711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.910 [2024-11-18 19:26:07.343739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.910 qpair failed and we were unable to recover it. 00:27:48.910 [2024-11-18 19:26:07.343824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.343933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.343958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.344070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.344293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.344556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.344794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.344902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.345012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.345235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.345467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.345734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.345856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.345971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.346229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.346447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.346708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.346883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.346968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.347199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.347405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.347597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.347879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.347993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.348104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.348339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.348574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.348806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.348972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.349074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.349356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.349557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.349823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.349944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.350058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.350178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.350204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.350351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.350436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.350461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.350544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.350638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.911 [2024-11-18 19:26:07.350665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.911 qpair failed and we were unable to recover it. 00:27:48.911 [2024-11-18 19:26:07.350785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.350904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.350929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.351047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.351298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.351596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.351862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.351999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.352088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.352287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.352549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.352788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.352956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.353069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.353349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.353579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.353838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.353979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.354102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.354389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.354602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.354852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.354996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.355089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.355354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.355563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.355779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.355919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.356004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.356294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.356507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.356738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.356879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.356968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.357048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.357074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.357163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.357252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.357279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.912 qpair failed and we were unable to recover it. 00:27:48.912 [2024-11-18 19:26:07.357396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.912 [2024-11-18 19:26:07.357494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.357521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.357610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.357721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.357748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.357855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.357974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.358147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.358406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.358623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.358860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.358976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.359129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.359358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.359560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.359793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.359936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.360017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.360257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.360453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.360717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.360822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.360923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.361127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.361371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.361642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.361870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.361993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.362089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.362299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.362508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.362734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.362856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.362998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.363264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.363472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.363696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.363799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.363922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.364029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.364054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.364147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.364258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.364283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.364377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.364488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.913 [2024-11-18 19:26:07.364513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.913 qpair failed and we were unable to recover it. 00:27:48.913 [2024-11-18 19:26:07.364632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.364752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.364777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.364869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.364962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.364988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.365109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.365364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.365602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.365836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.365942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.366028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.366250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.366510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.366775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.366908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.367040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.367311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.367543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.367777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.367893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.368025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.368320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.368553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.368828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.368963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.369065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.369340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.369603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.369823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.369976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.370063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.370293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.370495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.370742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.370883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.371032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.371288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.371529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.371748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.371888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.371972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.372082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.372117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.914 qpair failed and we were unable to recover it. 00:27:48.914 [2024-11-18 19:26:07.372269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.914 [2024-11-18 19:26:07.372375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.372400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.372501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.372594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.372648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.372744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.372834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.372860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.372966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.373179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.373424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.373664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.373897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.373983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.374123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.374368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.374626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.374889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.374975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.375116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.375324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.375570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.375819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.375926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.376026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.376216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.376456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.376675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.376839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.376964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.377197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.377404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.377591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.377788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.377914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.377974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:48.915 [2024-11-18 19:26:07.377994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 wit[2024-11-18 19:26:07.378098] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:48.915 h addr=10.0.0.2, port=4420 00:27:48.915 [2024-11-18 19:26:07.378118] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.378132] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:48.915 [2024-11-18 19:26:07.378195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:48.915 [2024-11-18 19:26:07.378289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:48.915 [2024-11-18 19:26:07.378314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 [2024-11-18 19:26:07.378258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.378217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:48.915 [2024-11-18 19:26:07.378427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.378629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.378832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.378955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.379045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.379130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.379154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.915 qpair failed and we were unable to recover it. 00:27:48.915 [2024-11-18 19:26:07.379267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.915 [2024-11-18 19:26:07.379355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.379380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.379491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.379612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.379645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.379734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.379820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.379844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.379949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.380180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.380408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.380636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.380842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.380955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.381047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.381265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.381497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.381722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.381828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.381927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.382131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.382334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.382544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.382774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.382883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.382968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.383200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.383453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.383664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.383897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.383976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.384084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.384285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.384487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.384725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.384825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.384948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.385212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.385442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.385650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.916 qpair failed and we were unable to recover it. 00:27:48.916 [2024-11-18 19:26:07.385839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.916 [2024-11-18 19:26:07.385931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.385955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.386058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.386303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.386526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.386768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.386874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.387007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.387215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.387438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.387684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.387802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.387889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.388122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.388314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.388505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.388709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.388824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.388935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.389163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.389384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.389592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.389821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.389931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.390028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.390228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.390446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.390678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.390877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.390980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.391111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.391324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.391534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.391772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.391969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.392130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.392362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.392564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.392767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.392886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.393017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.393137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.393162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.393253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.393340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.917 [2024-11-18 19:26:07.393365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.917 qpair failed and we were unable to recover it. 00:27:48.917 [2024-11-18 19:26:07.393490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.393572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.393597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.393720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.393798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.393823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.393918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.394128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.394397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.394597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.394845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.394987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.395098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.395288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.395501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.395739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.395860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.395970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.396196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.396394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.396671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.396812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.396896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.397154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.397436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.397637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.397845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.397978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.398062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.398262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.398450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.398708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.398849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.398947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.399150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.399351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.399557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.399775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.399890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.399984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.400187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.400486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.400717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.918 [2024-11-18 19:26:07.400827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.918 qpair failed and we were unable to recover it. 00:27:48.918 [2024-11-18 19:26:07.400953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.401181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.401376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.401602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.401869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.401987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.402103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.402301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.402529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.402766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.402880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.402984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.403209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.403387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.403599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.403820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.403999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.404144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.404366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.404657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.404859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.404969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.405090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.405283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.405493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.405802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.405939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.406046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.406264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.406473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.406707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.406826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.406948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.407137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.407348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.407556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.407793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.407914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.408008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.408106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.408131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.408216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.408314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.408338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.919 qpair failed and we were unable to recover it. 00:27:48.919 [2024-11-18 19:26:07.408422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.408504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.919 [2024-11-18 19:26:07.408530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.408624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.408725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.408751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.408831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.408951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.408976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.409063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.409270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.409494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.409704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.409825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.409913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.410129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.410330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.410567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.410842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.410961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.411042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.411264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.411461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.411672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.411793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.411882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.412152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.412354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.412591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.412839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.412969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.413059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.413284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.413467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.413683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.413792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.413893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.414147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.414382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.414591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.414831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.414978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.415066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.415149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.415174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.415260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.415373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.415397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.920 qpair failed and we were unable to recover it. 00:27:48.920 [2024-11-18 19:26:07.415481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.920 [2024-11-18 19:26:07.415560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.415586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.415749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.415847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.415875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.416012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.416212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.416419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.416669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.416802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.416904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.417158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.417365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.417563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.417789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.417891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.417972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.418170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.418403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.418613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.418840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.418966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.419048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.419243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.419465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.419706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.419851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.419946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.420154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.420374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.420633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.420843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.420957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.421048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.421294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.421583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.421806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.421918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.422036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.422243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.422485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.422709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.422856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.422953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.423037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.423064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.423153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.423236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.423262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.423347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.423456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.921 [2024-11-18 19:26:07.423481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.921 qpair failed and we were unable to recover it. 00:27:48.921 [2024-11-18 19:26:07.423578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.423688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.423714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.423836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.423927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.423952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.424070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.424299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.424528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.424735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.424859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.424968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.425166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.425364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.425591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.425884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.425992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.426143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.426369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.426603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.426809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.426914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.426997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.427204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.427432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.427673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.427877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.427991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.428087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.428324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.428546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.428782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.428891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.429009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.429249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.429445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.429642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.429856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.429979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.430091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.430295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.430501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.430746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.430856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.430955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.431220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.431432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.431640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.922 [2024-11-18 19:26:07.431865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.922 [2024-11-18 19:26:07.431974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.922 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.432061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.432296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.432496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.432764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.432876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.432955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.433168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.433371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.433613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.433803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.433939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.434027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.434225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.434482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.434713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.434824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.434942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.435133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.435349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.435545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.435742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.435846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.435964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.436229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.436410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.436616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.436848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.436958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.437044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.437261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.437453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.437717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.437824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.437924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.438119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.438310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.438563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.438812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.438985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.439119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.439361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.439551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.439753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.439853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.439951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.440033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.440059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.440145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.440230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.923 [2024-11-18 19:26:07.440256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.923 qpair failed and we were unable to recover it. 00:27:48.923 [2024-11-18 19:26:07.440368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.440515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.440541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.440636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.440725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.440751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.440870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.440957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.440982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.441072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.441298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.441529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.441748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.441854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.441975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.442196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.442400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.442611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.442814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.442920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.443067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.443274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.443501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.443711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.443911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.443991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.444110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.444322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.444510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.444780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.444886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.444981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.445216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.445444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.445689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.445899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.445991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.446113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.446402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.446632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.446824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.446936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.924 qpair failed and we were unable to recover it. 00:27:48.924 [2024-11-18 19:26:07.447019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.924 [2024-11-18 19:26:07.447103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.447255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.447447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.447657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.447859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.447977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.448097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.448291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.448490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.448696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.448882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.448989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.449074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.449287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.449494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.449744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.449848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.449955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.450205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.450394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.450587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.450810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.450920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.451011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.451242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.451474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.451737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.451849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.451943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.452058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.452084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.925 qpair failed and we were unable to recover it. 00:27:48.925 [2024-11-18 19:26:07.452201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.452314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.925 [2024-11-18 19:26:07.452340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.452443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.452551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.452576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.452750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.452830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.452856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.452974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.453178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.453366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.453582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.453803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.453906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.453990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.454220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.454432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.454641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.454834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.454989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.455078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.455319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.455536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.455746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.455857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.455948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.456174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.456378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.456603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.456847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.456954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.457047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.457265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.457517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.457728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.457836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.457949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.458093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.458118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.458204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.458318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.458343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.926 [2024-11-18 19:26:07.458449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.458524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.926 [2024-11-18 19:26:07.458550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.926 qpair failed and we were unable to recover it. 00:27:48.927 [2024-11-18 19:26:07.458681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.927 [2024-11-18 19:26:07.458773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.927 [2024-11-18 19:26:07.458800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.927 qpair failed and we were unable to recover it. 00:27:48.927 [2024-11-18 19:26:07.458881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.927 [2024-11-18 19:26:07.458963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.927 [2024-11-18 19:26:07.458988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.927 qpair failed and we were unable to recover it. 00:27:48.927 [2024-11-18 19:26:07.459113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.927 [2024-11-18 19:26:07.459195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.927 [2024-11-18 19:26:07.459220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:48.927 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.459302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.459390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.459415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.459528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.459619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.459655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.459738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.459823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.459848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.459961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.460266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.460536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.460785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.460892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.461012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.461219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.461448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.461734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.461846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.461932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.462170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.462387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.462580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.462818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.462925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.463016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.463250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.463447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.463683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.463888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.463978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.464095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.464320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.464546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.464751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.212 [2024-11-18 19:26:07.464860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.212 qpair failed and we were unable to recover it. 00:27:49.212 [2024-11-18 19:26:07.464945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.465174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.465397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.465601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.465808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.465910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.466025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.466252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.466472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.466668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.466858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.466960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.467046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.467306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.467532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.467750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.467853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.467973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.468196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.468398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.468594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.468795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.468931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.469017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.469212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.469437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.469676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.469913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.469995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.470115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.470306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.470531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.470741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.213 [2024-11-18 19:26:07.470855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.213 qpair failed and we were unable to recover it. 00:27:49.213 [2024-11-18 19:26:07.470974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.471205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.471410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.471624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.471816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.471930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.472054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.472240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.472428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.472638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.472841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.472948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.473036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.473279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.473470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.473668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.473870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.473986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.474117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.474341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.474536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.474764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.474870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.474951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.475134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.475350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.475579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.475798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.475953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.476040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.476291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.476521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.476723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.476825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.214 qpair failed and we were unable to recover it. 00:27:49.214 [2024-11-18 19:26:07.476938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.214 [2024-11-18 19:26:07.477060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.477168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.477411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.477645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.477831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.477934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.478013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.478209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.478403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.478641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.478868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.478980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.479085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.479276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.479473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.479702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.479886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.479996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.480115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.480347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.480546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.480753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.480858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.480946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.481161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.481355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.481549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.481772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.481947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.482045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.482297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.482527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.482761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.482882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.215 qpair failed and we were unable to recover it. 00:27:49.215 [2024-11-18 19:26:07.483012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.483101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.215 [2024-11-18 19:26:07.483126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.483206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.483457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.483651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.483843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.483948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.484071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.484287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.484538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.484757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.484866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.484953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.485177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.485362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.485548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.485749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.485918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.486004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.486197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.486387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.486590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.486799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.486911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.486993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.487195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.487424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.487658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.487864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.487997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.216 qpair failed and we were unable to recover it. 00:27:49.216 [2024-11-18 19:26:07.488088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.488167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.216 [2024-11-18 19:26:07.488192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.488269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.488495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.488685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.488878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.488992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.489140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.489367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.489571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.489781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.489916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.490004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.490205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.490429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.490618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.490838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.490971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.491058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.491244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.491479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.491733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.491867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.491950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.492183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.492380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.492594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.492794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.492931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.493046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.493277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.493492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.493691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.493794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.493885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.494000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.494025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.217 [2024-11-18 19:26:07.494121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.494208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.217 [2024-11-18 19:26:07.494233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.217 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.494350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.494461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.494487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.494571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.494660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.494685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.494772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.494850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.494876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.494991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.495198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.495375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.495558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.495750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.495863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.495947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.496171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.496402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.496615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.496845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.496953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.497104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.497309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.497526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.497732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.497861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.497945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.498137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.498340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.498566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.498761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.498892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.498990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.499211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.499408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.499598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.499827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.499936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.500048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.500160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.500185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.218 qpair failed and we were unable to recover it. 00:27:49.218 [2024-11-18 19:26:07.500270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.500382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.218 [2024-11-18 19:26:07.500412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.500500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.500587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.500617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.500713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.500798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.500825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.500909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.501173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.501408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.501643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.501846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.501977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.502060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.502273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.502449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.502664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.502885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.502995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.503106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.503326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.503543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.503734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.503842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.503956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.504176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.504428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.504692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.504891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.504993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.505134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.505357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.505578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.505791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.505923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.506012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.506232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.506494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.219 qpair failed and we were unable to recover it. 00:27:49.219 [2024-11-18 19:26:07.506754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.219 [2024-11-18 19:26:07.506840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.506864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.506959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.507181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.507375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.507562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.507768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.507878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.507968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.508156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.508361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.508585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.508804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.508906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.508996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.509216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.509433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.509628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.509853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.509991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.510076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.510270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.510524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.510757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.510894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.510974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.511230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.511445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.511638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.511841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.511950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.512049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.512260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.512441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.512631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.220 [2024-11-18 19:26:07.512770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.220 qpair failed and we were unable to recover it. 00:27:49.220 [2024-11-18 19:26:07.512851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.512931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.512956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.513042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.513319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.513545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.513765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.513872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.513955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.514164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.514385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.514568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.514787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.514896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.514985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.515201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.515430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.515657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.515845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.515957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.516068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.516285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.516513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.516722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.516910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.516994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.517132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.517347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.517548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.517750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.517851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.517966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.518047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.518074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.221 qpair failed and we were unable to recover it. 00:27:49.221 [2024-11-18 19:26:07.518169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.518250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.221 [2024-11-18 19:26:07.518274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.518386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.518500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.518525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.518614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.518698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.518725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.518818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.518895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.518919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.519002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.519192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.519420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.519629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.519849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.519950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.520050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.520306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.520544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.520746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.520860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.520977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.521206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.521416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.521644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.521854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.521958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.522079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.522370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.522602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.522843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.522978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.523097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.523343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.523541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.523796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.523905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.524011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.524207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.524406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.222 qpair failed and we were unable to recover it. 00:27:49.222 [2024-11-18 19:26:07.524633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.222 [2024-11-18 19:26:07.524729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.524755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.524839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.524951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.524976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.525092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.525290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.525514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.525721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.525860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.525951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.526152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.526359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.526546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.526780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.526890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.527007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.527222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.527439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.527674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.527879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.527989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.528106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.528355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.528544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.528764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.528882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.528998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.529197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.529386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.529575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.529795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.529910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.529997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.530190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.530438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.530628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.223 [2024-11-18 19:26:07.530734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.223 qpair failed and we were unable to recover it. 00:27:49.223 [2024-11-18 19:26:07.530820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.530901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.530927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.531006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.531237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.531424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.531648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.531870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.531976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.532091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.532284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.532503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.532727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.532832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.532941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.533174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.533376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.533566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.533773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.533878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.533996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.534217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.534437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.534640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.534874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.534987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.535091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.535285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.535509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.535738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.535853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.535938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.536150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.536343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.536555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.224 [2024-11-18 19:26:07.536764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.224 [2024-11-18 19:26:07.536870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.224 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.536953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.537241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.537442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.537636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.537837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.537944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.538034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.538271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.538507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.538742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.538841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.538930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.539114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.539315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.539536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.539734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.539857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.539938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.540131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.540323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.540547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.540775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.540878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.540999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.541260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.541458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.541733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.541851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.541943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.542063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.542088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.542180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.542297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.542323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.225 qpair failed and we were unable to recover it. 00:27:49.225 [2024-11-18 19:26:07.542440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.225 [2024-11-18 19:26:07.542519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.542544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.542630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.542717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.542743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.542855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.542935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.542960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.543081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.543289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.543512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.543748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.543856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.543963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.544178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.544375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.544621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.544828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.544961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.545040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.545253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.545450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.545653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.545888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.545990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.546074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.546292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.546513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.546719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.546898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.546996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.547136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.547356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.547549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.547727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.547828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.547930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.548009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.548034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.548130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.548240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.226 [2024-11-18 19:26:07.548266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.226 qpair failed and we were unable to recover it. 00:27:49.226 [2024-11-18 19:26:07.548346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.548435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.548460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.548543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.548628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.548654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.548753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.548867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.548892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.548978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.549195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.549451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.549677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.549875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.549983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.550088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.550330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.550555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.550758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.550869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.550949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.551148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.551327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.551548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.551774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.551909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.551997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.552221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.552467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.552697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.552893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.552998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.553091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.553315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.553576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.553794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.553928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.554021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.554127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.554153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.554264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.554348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.554374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.227 qpair failed and we were unable to recover it. 00:27:49.227 [2024-11-18 19:26:07.554461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.227 [2024-11-18 19:26:07.554574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.554600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.554689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.554770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.554795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.555045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.555263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.555489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.555688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.555789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.555905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.556168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.556348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.556585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.556816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.556922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.557004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.557230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.557486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.557708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.557887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.557980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.558180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.558399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.558621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.558764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.558895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.559114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.559331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.559519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.559708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.559902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.559983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.560131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.560356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.560578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.228 [2024-11-18 19:26:07.560774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.228 [2024-11-18 19:26:07.560907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.228 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.560990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.561216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.561445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.561637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.561824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.561930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.562017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.562241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.562460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.562692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.562857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.562938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.563197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.563404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.563595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.563781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.563888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.563972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.564158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.564376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.564561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.564789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.564907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.564985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.565243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.565423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.565628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.565854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.565953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.566045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.566236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.566493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.566686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.229 [2024-11-18 19:26:07.566875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.229 [2024-11-18 19:26:07.566973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.229 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.567092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.567283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.567507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.567720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.567865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.567972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.568160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.568413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.568605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.568826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.568943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.569034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.569255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.569479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.569696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.569908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.569998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.570139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.570360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.570618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.570839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.570996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.571084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.571304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.571539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.571743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.571849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.571931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.572046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.572072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.572161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.572273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.572299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.572389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.572485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.230 [2024-11-18 19:26:07.572512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.230 qpair failed and we were unable to recover it. 00:27:49.230 [2024-11-18 19:26:07.572594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.572702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.572729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.572812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.572895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.572922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.573011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.573275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.573533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.573787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.573899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.573985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.574228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.574424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.574661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.574871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.574983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.575068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.575288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.575496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.575731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.575875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.575962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.576180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.576430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.576704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.576906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.576995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.577108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.577327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.577556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.577825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.577966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.578063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.578301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.578548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.578809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.578909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.231 qpair failed and we were unable to recover it. 00:27:49.231 [2024-11-18 19:26:07.579000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.579107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.231 [2024-11-18 19:26:07.579132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.579216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.579463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.579664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.579858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.579968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.580051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.580237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.580448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.580635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.580867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.580974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.581084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.581279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.581498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.581732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.581843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.581936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.582162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.582385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.582572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.582800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.582902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.583021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.583268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.583470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.583675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.583777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.583895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.584138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.584333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.584553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.584746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.584882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.584993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.585077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.585103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.232 qpair failed and we were unable to recover it. 00:27:49.232 [2024-11-18 19:26:07.585183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.232 [2024-11-18 19:26:07.585271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.585384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.585621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.585829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.585947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.586046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.586279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.586509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.586775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.586915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.587006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.587267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.587492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.587757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.587894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.587984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.588199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.588415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.588613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.588821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.588937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.589076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.589303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.589555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.589750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.589861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.589960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.590158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.590373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.590623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.590851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.590985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.591076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.591169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.591196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.591286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.591370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.591395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.233 [2024-11-18 19:26:07.591504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.591620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.233 [2024-11-18 19:26:07.591646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.233 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.591734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.591820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.591847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.591932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.592168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.592368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.592575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.592837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.592979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.593060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.593288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.593541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.593776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.593910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.594003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.594197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.594423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.594646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.594863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.594985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.595105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.595326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.595556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.595767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.595905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.595985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.596188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.596406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.596598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.596804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.596911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.596993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.597225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.597430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.597670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.597781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.234 qpair failed and we were unable to recover it. 00:27:49.234 [2024-11-18 19:26:07.597927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.598012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.234 [2024-11-18 19:26:07.598038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.598134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.598326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.598509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.598740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.598842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.598923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.599107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.599307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.599522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.599727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.599860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.599952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.600180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.600404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.600630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.600828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.600935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.601021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.601217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.601414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.601597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.601857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.601968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.602071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.602269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.602489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.602690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.602911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.602988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.603013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.603127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.603206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.235 [2024-11-18 19:26:07.603231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.235 qpair failed and we were unable to recover it. 00:27:49.235 [2024-11-18 19:26:07.603373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.603455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.603480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.603567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.603658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.603684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.603770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.603848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.603872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.603955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.604152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.604367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.604622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.604888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.604981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.605127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.605360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.605560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.605773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.605889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.605976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.606210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.606425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.606628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.606852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.606962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.607072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.607278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.607457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.607663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.607857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.607964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.608087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.608288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.608515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.608745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.608855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.608968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.609053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.609079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.609201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.609280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.609305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.236 [2024-11-18 19:26:07.609389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.609474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.236 [2024-11-18 19:26:07.609504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.236 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.609592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.609710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.609737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.609858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.609947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.609974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.610075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.610298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.610498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.610696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.610907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.610997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.611114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.611356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.611585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.611804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.611907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.611997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.612217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.612445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.612639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.612856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.612958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.613038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.613261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.613512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.613751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.613920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.614032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.614253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.614479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.614728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.614910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.614996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.615113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.615306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.237 [2024-11-18 19:26:07.615530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.237 [2024-11-18 19:26:07.615658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.237 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.615760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.615868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.615893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.615983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.616167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.616384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.616581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.616805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.616911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.616992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.617199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.617424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.617641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.617855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.617956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.618073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.618267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.618486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.618713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.618859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.618948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.619162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.619387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.619604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.619854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.619965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.620059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.620282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.620509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.620708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.620852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.620937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.621123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.621383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.621598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.238 [2024-11-18 19:26:07.621716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.238 qpair failed and we were unable to recover it. 00:27:49.238 [2024-11-18 19:26:07.621811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.621929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.621954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.622155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.622433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.622630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.622824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.622931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.623024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.623249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.623491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.623727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.623848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.623934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.624133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.624390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.624618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.624847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.624991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.625101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.625305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.625513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.625712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.625848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.625970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.626158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.626459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.626704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.626808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.626899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.627008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.627033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.627147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.627223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.627248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.627333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.627425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.239 [2024-11-18 19:26:07.627450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.239 qpair failed and we were unable to recover it. 00:27:49.239 [2024-11-18 19:26:07.627539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.627632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.627658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.627745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.627864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.627890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.627977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.628178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.628407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.628640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.628893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.628981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.629123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.629343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.629568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.629761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.629896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.630019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.630212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.630425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.630650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.630901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.630991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.631132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.631350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.631579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.631853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.631963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.632044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.632241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.632457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.632675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.632788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.632877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.633126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.633316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.240 [2024-11-18 19:26:07.633498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.240 [2024-11-18 19:26:07.633602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.240 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.633718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.633831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.633856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.633953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.634142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.634336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.634561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.634799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.634906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.635015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.635224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.635413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.635599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.635844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.635960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.636091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.636287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.636505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.636744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.636889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.636972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.637163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.637413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.637617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.637844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.637945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.638064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.638254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.638465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.638660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.638850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.638987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.639082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.639334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.639643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.241 qpair failed and we were unable to recover it. 00:27:49.241 [2024-11-18 19:26:07.639845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.241 [2024-11-18 19:26:07.639926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.639951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.640046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.640299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.640533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.640806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.640916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.641031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.641261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.641457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.641742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.641854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.641953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.642243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.642492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.642759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.642891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.642981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.643182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.643406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.643651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.643847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.643981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.644061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.644509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.644775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.644896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.644989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.645254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.645448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.645640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.645844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.645954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.646044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.646161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.646186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.242 qpair failed and we were unable to recover it. 00:27:49.242 [2024-11-18 19:26:07.646283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.242 [2024-11-18 19:26:07.646366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.646391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.646503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.646582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.646612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.646702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.646830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.646855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.646945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.647175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.647401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.647615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.647809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.647919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.648035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.648287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.648478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.648680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.648911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.648988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.649162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.649371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.649569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.649808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.649917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.649999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.650188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.650404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.650598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.650804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.650907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.651033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.651286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.651503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.651714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.651853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.243 qpair failed and we were unable to recover it. 00:27:49.243 [2024-11-18 19:26:07.651939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.243 [2024-11-18 19:26:07.652034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.652177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.652393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.652620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.652832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.652935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.653046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.653299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.653517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.653743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.653847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.653960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.654188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.654439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.654667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.654917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.654995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.655103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.655302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.655541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.655798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.655913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.656011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.656205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.656397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.656590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.656824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.656925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.657011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.657096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.657121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.657238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.657350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.657375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.244 qpair failed and we were unable to recover it. 00:27:49.244 [2024-11-18 19:26:07.657462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.244 [2024-11-18 19:26:07.657548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.657573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.657678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.657783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.657812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.657936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.658171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.658398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.658589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.658826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.658939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.659019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.659235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.659442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.659699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.659896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.659997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.660111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.660331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.660533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.660735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.660846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.660933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.661124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.661382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.661583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.661780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.661921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.662012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.662210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.662406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.662638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.662851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.662957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.663045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.663161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.663185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.663270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.663378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.663403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.245 qpair failed and we were unable to recover it. 00:27:49.245 [2024-11-18 19:26:07.663517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.663596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.245 [2024-11-18 19:26:07.663627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.663720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.663831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.663857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.663956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.664172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.664372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.664565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.664799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.664937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.665023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.665209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.665429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.665657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.665771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.665893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.666127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.666310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.666504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.666729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.666894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.666977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.667206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.667436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.667621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.667845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.667949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.668033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.668227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.668411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.668644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.668766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.668860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.669004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.669029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.669121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.669198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.246 [2024-11-18 19:26:07.669224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.246 qpair failed and we were unable to recover it. 00:27:49.246 [2024-11-18 19:26:07.669314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.669404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.669429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.669517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.669630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.669656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.669756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.669845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.669871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.669954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.670168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.670370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.670571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.670787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.670905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.670993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.671219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.671447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.671663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.671886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.671988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.672071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.672325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.672519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.672749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.672860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.672980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.673183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.673413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.673654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.673852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.673964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.674048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.674263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.674483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.674688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.674919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.674998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.675024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.247 qpair failed and we were unable to recover it. 00:27:49.247 [2024-11-18 19:26:07.675137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.675252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.247 [2024-11-18 19:26:07.675278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.675392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.675480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.675507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.675599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.675725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.675751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.675868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.675983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.676093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.676314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.676570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.676815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.676953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.677049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.677278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.677476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.677701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.677824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.677917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.678138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.678402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.678634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.678828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.678936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.679055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.679268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.679451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.679691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.679806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.679920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.680114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.680313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.680592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.680804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.680915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.680999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.681088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.681113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.681199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.681317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.681343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.681426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.681512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.248 [2024-11-18 19:26:07.681539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.248 qpair failed and we were unable to recover it. 00:27:49.248 [2024-11-18 19:26:07.681634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.681753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.681778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.681877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.681987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.682102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.682326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.682554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.682748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.682886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.682973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.683194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.683420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.683659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.683886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.683992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.684104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.684340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.684554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.684808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.684926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.685016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.685223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.685434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.685666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.685869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.685973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.686053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.686317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.686516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.686723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.686869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.686956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.687075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.687100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.249 qpair failed and we were unable to recover it. 00:27:49.249 [2024-11-18 19:26:07.687184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.249 [2024-11-18 19:26:07.687259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.687372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.687575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.687769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.687870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.687957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.688149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.688398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.688621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.688824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.688929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.689016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.689211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.689410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.689640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.689841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.689947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.690034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.690246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.690441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.690651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.690842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.690947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.691034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.691230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.691419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.691631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.691820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.691927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.692032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.692284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.692478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.692689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.692807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.250 [2024-11-18 19:26:07.692896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.693015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.250 [2024-11-18 19:26:07.693042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.250 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.693137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.693330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.693555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.693762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.693869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.693951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.694178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.694430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.694626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.694853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.694962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.695045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.695257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.695478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.695671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.695867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.695969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.696053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.696273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.696495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.696713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.696824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.696947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.697168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.697390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.697625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.697824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.697930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.698018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.698242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.698469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.698698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.698842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.698928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.699016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.699044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.251 qpair failed and we were unable to recover it. 00:27:49.251 [2024-11-18 19:26:07.699177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.251 [2024-11-18 19:26:07.699303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.699428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.699632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.699827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.699930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.700016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.700240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.700466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.700664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.700866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.700983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.701125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.701302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.701535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.701745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.701858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.701976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.702239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.702504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.702734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.702844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.702934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.703185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.703381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.703616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.703810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.703913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.704031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.704252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.704513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.704706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.704904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.704987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.705094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.705326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.705522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.252 [2024-11-18 19:26:07.705656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.252 qpair failed and we were unable to recover it. 00:27:49.252 [2024-11-18 19:26:07.705766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.705848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.705880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.705967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.706157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.706382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.706587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.706795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.706936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.707035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.707234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.707478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.707685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.707917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.707999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.708123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.708381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.708568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.708792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.708963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.709046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.709245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.709473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.709753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.709858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.709939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.710185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.710421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.710678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.710789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.710876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.711012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.711037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.711123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.711209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.711233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.711316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.711394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.253 [2024-11-18 19:26:07.711419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.253 qpair failed and we were unable to recover it. 00:27:49.253 [2024-11-18 19:26:07.711540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.711624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.711650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.711761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.711842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.711867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.711980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.712206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.712426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.712640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.712901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.712985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.713136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.713369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.713598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.713828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.713958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.714046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.714269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.714485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.714688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.714822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.714945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.715143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.715345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.715615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.715848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.715964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.716083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.716277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.716504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.716740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.716845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.716968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.717191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.717384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.717585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.717787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.717892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.717978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.718094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.718119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.254 qpair failed and we were unable to recover it. 00:27:49.254 [2024-11-18 19:26:07.718201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.718285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.254 [2024-11-18 19:26:07.718309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.718423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.718534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.718559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.718649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.718729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.718754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.718848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.718928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.718953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.719036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.719292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.719488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.719720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.719911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.719985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.720102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.720299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.720519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.720746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.720850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.720933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.721157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.721412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.721599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.721790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.721901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.721988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.722179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.722400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.722636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.722857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.722964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.723050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.723240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.723480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.723672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.723775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.723895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.724117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.724370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.724553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.724777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.724877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.724975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.725057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.725082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.255 qpair failed and we were unable to recover it. 00:27:49.255 [2024-11-18 19:26:07.725176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.255 [2024-11-18 19:26:07.725261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.725369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.725598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.725792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.725905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.725986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.726204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.726438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.726682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.726875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.726973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.727061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.727278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.727484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.727724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.727883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.728001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.728225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.728429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.728674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.728807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.728928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.729173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.729386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.729690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.729792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.729884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.730109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.730301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.730526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.730721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.730826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.730942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.731138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.731360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.731556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.731741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.731899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.256 [2024-11-18 19:26:07.731990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.732068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.256 [2024-11-18 19:26:07.732092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.256 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.732180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.732407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.732615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.732866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.732967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.733086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.733313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.733505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.733729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.733841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.733957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.734154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.734377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.734562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.734773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.734890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.734976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.735168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.735355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.735582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.735824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.735949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.736069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.736269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.736523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.736761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.736872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.736965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.737082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.737108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.737191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.737301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.737326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.737413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.737525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.257 [2024-11-18 19:26:07.737551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.257 qpair failed and we were unable to recover it. 00:27:49.257 [2024-11-18 19:26:07.737645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.737763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.737790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.737884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.737995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.738133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.738332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.738555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.738766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.738900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.738996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.739172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.739351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.739541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.739734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.739843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.739931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.740125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.740310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.740490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.740688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.740796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.740927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.741150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.741342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.741524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.258 [2024-11-18 19:26:07.741773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.258 [2024-11-18 19:26:07.741893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.258 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.742039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.742234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.742446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.742649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.742847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.742946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.743028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.743238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.743449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.743639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.743839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.743956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.744071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.744270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.744462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.744672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.744910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.744988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.745095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.745346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.745529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.745822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.745931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.746017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.746235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.746424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.746623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.746828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.746934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.259 [2024-11-18 19:26:07.747051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.747130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.259 [2024-11-18 19:26:07.747155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.259 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.747272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.747410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.747440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.747527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.747620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.747645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.747727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.747809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.747833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.747918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.748114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.748456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.748695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.748830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.748927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.749149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.749368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.749571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.749794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.749899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.749986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.750177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.750408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.750636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.750884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.750994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.751106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.751321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.751510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.260 [2024-11-18 19:26:07.751655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.260 qpair failed and we were unable to recover it. 00:27:49.260 [2024-11-18 19:26:07.751737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.751846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.751871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.751968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.752161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.752343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.752565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.752803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.752941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.753108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.753332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.753625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.753820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.753920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.754001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.754264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.754516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.754742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.754882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.754969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.755166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.755379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.755598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.755811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.755919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.756007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.756125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.756150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.261 qpair failed and we were unable to recover it. 00:27:49.261 [2024-11-18 19:26:07.756239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.261 [2024-11-18 19:26:07.756362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.756387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.756476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.756551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.756576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.756669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.756787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.756813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.756900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.757120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.757312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.757508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.757734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.757842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.757931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.758121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.758348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.758547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.758744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.758852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.758943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.759197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.759393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.759624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.759814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.759919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.760011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.760238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.760489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.262 qpair failed and we were unable to recover it. 00:27:49.262 [2024-11-18 19:26:07.760747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.262 [2024-11-18 19:26:07.760837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.760866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.760950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.761170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.761388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.761583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.761816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.761922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.762032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.762222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.762425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.762629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.762833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.762944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.763033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.763268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.763465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.763704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.763808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.763926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.764151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.764352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.764602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.764795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.764903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.263 qpair failed and we were unable to recover it. 00:27:49.263 [2024-11-18 19:26:07.765014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.263 [2024-11-18 19:26:07.765093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.765209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.765407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.765600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.765843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.765948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.766026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.766234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.766422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.766632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.766826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.766964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.767049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.767272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.767497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.767716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.767932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.768046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.768137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.768162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.768250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.768334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.768359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.264 qpair failed and we were unable to recover it. 00:27:49.264 [2024-11-18 19:26:07.768445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.264 [2024-11-18 19:26:07.768524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.768549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.768634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.768726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.768751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.768833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.768912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.768936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.769020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.769242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.769461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.769655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.769875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.769981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.770079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.770275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.770472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.770680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.770872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.770984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.771120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.771350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.771621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.771810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.771922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.772016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.772098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.772123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.772210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.772295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.772322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.772407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.772487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.265 [2024-11-18 19:26:07.772512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.265 qpair failed and we were unable to recover it. 00:27:49.265 [2024-11-18 19:26:07.772595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.772691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.772716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.772806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.772895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.772919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.773013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.773211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.773435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.773643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.773876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.773991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.774099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.774282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.774504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.774754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.774889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.774972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.775165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.775361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.775552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.775755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.775901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.776013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.776262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.776455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.776639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.266 [2024-11-18 19:26:07.776804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.266 qpair failed and we were unable to recover it. 00:27:49.266 [2024-11-18 19:26:07.776888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.776965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.776989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.777099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.777332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.777545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.777803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.777915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.777998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.778192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.778435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.778657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.778877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.778978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.779090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.779326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.779507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.779712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.779823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.779942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.780166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.780378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.780566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.780791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.780900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.780987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.781164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.781189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.781269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.781357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.781381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.267 qpair failed and we were unable to recover it. 00:27:49.267 [2024-11-18 19:26:07.781489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.267 [2024-11-18 19:26:07.781564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.781589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.781692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.781776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.781801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.781921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.782136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.782329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.782547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.782813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.782917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.783045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.783259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.783449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.783679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.783912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.783996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.784114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.784371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.784559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.784758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.784865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.784955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.785167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.785388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.785593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.785816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.785923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.268 [2024-11-18 19:26:07.786047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.786129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.268 [2024-11-18 19:26:07.786154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.268 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.786249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.786483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.786681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.786868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.786983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.787129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.787321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.787527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.787723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.787831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.787917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.788033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.788058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.788142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.788216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.788241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.269 qpair failed and we were unable to recover it. 00:27:49.269 [2024-11-18 19:26:07.788326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.269 [2024-11-18 19:26:07.788411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.788436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.788549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.788627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.788652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.788745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.788821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.788845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.788925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.789138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.789355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.789560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.789799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.789899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.789991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.790213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.790428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.790656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.790852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.790963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.791040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.791298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.791505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.791715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.791853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.791934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.792128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.792308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.792512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.555 [2024-11-18 19:26:07.792707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.555 [2024-11-18 19:26:07.792815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.555 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.792905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.792990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.793102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.793294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.793480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.793720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.793913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.793996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.794108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.794296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.794544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.794755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.794865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.794952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.795153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.795352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.795539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.795742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.795850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.795937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.796177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.796394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.796618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.796876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.796983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.797087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.797333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.797542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.797788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.797898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.798014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.798269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.798502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.798743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.798859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.556 qpair failed and we were unable to recover it. 00:27:49.556 [2024-11-18 19:26:07.798941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.799057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.556 [2024-11-18 19:26:07.799082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.799162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.799360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.799580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.799842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.799950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.800078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.800269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.800518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.800775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.800916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.800995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.801250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.801505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.801777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.801887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.802001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.802236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.802499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.802724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.802844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.802932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.803181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.803370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.803638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.803823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.803933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.804022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.804258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.804439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.804649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.804859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.804975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.805001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.805121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.805205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.805231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.805320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.805397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.557 [2024-11-18 19:26:07.805422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.557 qpair failed and we were unable to recover it. 00:27:49.557 [2024-11-18 19:26:07.805512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.805629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.805656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.805742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.805863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.805889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.805976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.806243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.806473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.806695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.806807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.806933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.807186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.807418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.807653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.807874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.807987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.808071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.808261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.808474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.808674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.808894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.808976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.809127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.809317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.809521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.809723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.809859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.809970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.810188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.810379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.810578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.810805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.810908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.811022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.811275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.811464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.558 [2024-11-18 19:26:07.811709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.558 [2024-11-18 19:26:07.811813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.558 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.811892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.812160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.812351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.812578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.812785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.812919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.813009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.813206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.813414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.813682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.813914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.813995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.814111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.814321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.814553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.814748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.814864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.814986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.815204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.815436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.815646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.815856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.815972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.816092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.816330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.816535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.816729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.816837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.559 qpair failed and we were unable to recover it. 00:27:49.559 [2024-11-18 19:26:07.816932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.817019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.559 [2024-11-18 19:26:07.817044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.817132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.817328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.817518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.817718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.817910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.817991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.818105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.818328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.818516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.818747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.818869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.818951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.819172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.819420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.819638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.819832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.819949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.820067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.820252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.820464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.820746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.820855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.820946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.821174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.821427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.821616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.821843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.821976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.822063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.822311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.822533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.822750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.822864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.822995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.823079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.823104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.560 qpair failed and we were unable to recover it. 00:27:49.560 [2024-11-18 19:26:07.823191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.560 [2024-11-18 19:26:07.823271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.823379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.823561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.823791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.823915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.824035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.824221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.824474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.824737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.824848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.824958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.825186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.825387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.825579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.825770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.825882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.826000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.826240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.826460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 A controller has encountered a failure and is being reset. 00:27:49.561 [2024-11-18 19:26:07.826697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.826838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.826971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.827219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.827418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.827673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.827869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.827983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.828088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.828287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.828509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.828721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.828863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.828956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.829041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.829067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.829152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.829263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.829289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.561 [2024-11-18 19:26:07.829372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.829488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.561 [2024-11-18 19:26:07.829514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.561 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.829601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.829691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.829717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.829828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.829946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.829973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.830095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.830292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.830501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.830722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.830834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.830929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.831169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.831445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.831638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.831843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.831951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.832068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.832301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.832554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.832757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.832893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.833003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.833209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.833487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.833721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.833892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.833982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.834182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.834406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.834646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.834848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.834958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.835043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.835229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.835458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.835660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.562 [2024-11-18 19:26:07.835785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.562 qpair failed and we were unable to recover it. 00:27:49.562 [2024-11-18 19:26:07.835873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.835956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.835981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.836094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.836277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.836503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.836724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.836892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.836982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.837208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.837429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.837644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.837833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.837974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.838088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.838306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.838514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.838729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.838867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.838962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.839178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.839405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.839613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.839833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.839951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.840040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.840249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.840472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.840680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.840904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.840994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.841109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.841311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.841566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.841796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.841900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.563 [2024-11-18 19:26:07.842017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.842134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.563 [2024-11-18 19:26:07.842159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.563 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.842242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.842437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.842688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.842883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.842989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.843082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.843340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.843556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.843758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.843936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.844059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.844276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.844497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.844740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.844842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.844927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.845148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.845400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.845617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.845729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.845878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.846121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.846349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.846599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.846805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.846954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.847073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.847302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.847547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.847759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.564 [2024-11-18 19:26:07.847926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.564 qpair failed and we were unable to recover it. 00:27:49.564 [2024-11-18 19:26:07.848046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.848321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.848508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.848730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.848881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.848963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.849178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.849417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.849652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.849856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.849961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.850051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.850278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.850506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.850744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.850856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.850969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.851190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.851413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.851620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.851838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.851972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.852077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.852270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.852460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.852695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.852840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.852924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.853151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.853343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.853564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.853768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.853916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.854012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.854101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.854127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.565 qpair failed and we were unable to recover it. 00:27:49.565 [2024-11-18 19:26:07.854275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.565 [2024-11-18 19:26:07.854353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.854467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.854673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.854884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.854994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.855113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.855306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.855332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.855477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.855563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.855589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.856429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.856583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.856625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.856775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.856877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.856907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.857019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.857283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.857476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.857712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.857832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.857964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.858211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.858462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.858680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.858876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.858994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.859137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.859336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.859577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.859788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.859925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.860008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.860192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.860392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.860612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.860822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.860939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.861026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.861134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.861161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.861249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.861359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.861385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.861472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.861550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.566 [2024-11-18 19:26:07.861576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.566 qpair failed and we were unable to recover it. 00:27:49.566 [2024-11-18 19:26:07.861666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.861746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.861771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.861857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.861933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.861958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.862105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.862324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.862550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.862779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.862888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.862976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.863198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.863447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.863709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.863847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.863972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.864166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.864384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.864613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.864801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.864947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.865030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.865230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.865454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.865679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.865820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.865942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.866167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.866420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.866633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.866825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.866933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.867034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.867222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.867410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.867640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.567 qpair failed and we were unable to recover it. 00:27:49.567 [2024-11-18 19:26:07.867836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.567 [2024-11-18 19:26:07.867945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.868037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.868269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.868495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.868743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.868849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.868959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.869209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.869439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.869675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.869878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.869998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.870181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.870446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.870682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.870815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.870903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.871164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.871420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.871621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.871820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.871955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.872040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.872266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.872454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.872693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.872909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.872990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.873106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.873337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.873531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.873736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.873899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.568 qpair failed and we were unable to recover it. 00:27:49.568 [2024-11-18 19:26:07.873992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.568 [2024-11-18 19:26:07.874072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.874185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.874395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.874633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.874837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.874951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.875033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.875293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.875539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.875769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.875880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.875978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.876194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.876430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.876690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.876892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.876977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.877092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.877330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.877518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.877743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.877849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.877934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.878177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.878402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.878587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.878830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.878937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.879061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.879257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.879460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.879689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.879802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.569 qpair failed and we were unable to recover it. 00:27:49.569 [2024-11-18 19:26:07.879921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.569 [2024-11-18 19:26:07.880032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.880147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.880367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.880589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.880836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.880940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.881019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.881209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.881437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.881655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.881858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.881973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.882062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.882312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.882556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.882785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.882892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.882983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.883210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.883411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.883592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.883796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.883904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.883993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.884183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.884406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.884596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.884818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.884955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.885051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.885264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.885450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.885659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.570 [2024-11-18 19:26:07.885862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.570 [2024-11-18 19:26:07.885998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.570 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.886080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.886296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.886526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.886749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.886890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.886973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.887169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.887358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.887578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.887808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.887949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.888043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.888228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.888445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.888708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.888821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.888903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.889122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.889342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.889563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.889776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.889886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.889972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.890200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.890387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.890619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.890815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.890964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.891050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.891271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.891509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.891737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.891850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.891937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.892052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.892077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.571 qpair failed and we were unable to recover it. 00:27:49.571 [2024-11-18 19:26:07.892171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.571 [2024-11-18 19:26:07.892253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.892367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.892558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.892786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.892898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.892978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.893209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.893423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.893629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.893817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.893952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.894033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.894257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.894512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.894705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.894844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.894929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.895120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.895339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.895552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.895784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.895888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.895996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.896192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.896444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.896650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.896876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.896998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.897088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.897319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.897541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.897775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.897888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.897974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.898083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.898108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.572 qpair failed and we were unable to recover it. 00:27:49.572 [2024-11-18 19:26:07.898201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.898281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.572 [2024-11-18 19:26:07.898307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.898395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.898475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.898502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.898587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.898673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.898699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.898848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.898930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.898955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.899036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.899262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.899496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.899722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.899835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.899930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.900157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.900347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.900551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.900778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.900882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.901010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.901203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.901392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.901582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.901822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.901926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.902013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.902267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.902458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.902713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.902820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.902939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.903140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.903333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.573 qpair failed and we were unable to recover it. 00:27:49.573 [2024-11-18 19:26:07.903537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.573 [2024-11-18 19:26:07.903643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.903669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.903785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.903878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.903904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.903996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.904228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.904420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.904652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.904907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.904990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.905126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.905331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.905569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.905775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.905886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.906003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.906201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.906390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.906624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.906855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.906997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.907081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.907282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.907514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.907721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.907824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.907912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.908138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.908357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.908581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.908815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.908922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.908999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.909194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.909444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.909646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.574 [2024-11-18 19:26:07.909791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.574 qpair failed and we were unable to recover it. 00:27:49.574 [2024-11-18 19:26:07.909877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.909956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.909980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.910069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.910272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.910493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.910692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.910798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.910915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.911134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.911320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.911513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.911767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.911913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.911998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.912225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.912450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.912699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.912897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.912984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.913124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.913319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.913522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.913728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.913835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.913923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.914185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.914454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.914658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.914879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.914981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.915065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.915335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.915557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.915816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.915918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.575 qpair failed and we were unable to recover it. 00:27:49.575 [2024-11-18 19:26:07.916013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.916092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.575 [2024-11-18 19:26:07.916117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.916214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.916299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.916329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.916448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.916565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.916590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.916684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.916794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.916818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.916903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.917130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.917363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.917563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.917788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.917932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.918021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.918228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.918422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.918715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.918827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.918921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.919155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.919341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.919537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.919771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.919871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.919964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.920182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.920414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.920642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.920852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.920958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.921077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.921300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.921532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.921751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.921891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.922005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.922082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.922107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.922189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.922266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.922291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.576 qpair failed and we were unable to recover it. 00:27:49.576 [2024-11-18 19:26:07.922382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.576 [2024-11-18 19:26:07.922459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.922484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.922569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.922655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.922680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.922772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.922857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.922882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.922966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.923169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.923398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.923602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.923802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.923911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.924007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.924199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.924396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.924621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.924849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.924987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.925075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.925295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.925485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.925681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.925882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.925992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.926073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.926259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.926476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.926702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.926886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.926991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.927083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.927327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.927554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.927760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.927871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.927952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.928059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.928084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.577 [2024-11-18 19:26:07.928172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.928249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.577 [2024-11-18 19:26:07.928274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.577 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.928394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.928477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.928502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.928619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.928712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.928737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.928823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.928904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.928929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.929044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.929245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.929463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.929705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.929898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.929988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.930090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.930313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.930504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.930764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.930873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.930961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.931176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.931367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.931563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.931789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.931961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.932043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.932229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.932447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.932664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.932852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.932963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.933046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.933155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.933180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.933264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.933344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.933369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.578 [2024-11-18 19:26:07.933451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.933621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.578 [2024-11-18 19:26:07.933647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.578 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.933727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.933816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.933841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.933919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.933998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.934146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.934361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.934565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.934767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.934885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.934971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.935213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.935404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.935604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.935829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.935963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.936053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.936245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.936439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.936678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.936824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.936910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.937127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.937342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.937570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.937787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.937923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.938010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.938200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.938452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.938714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.938908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.938987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.939099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.939288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.939484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.579 qpair failed and we were unable to recover it. 00:27:49.579 [2024-11-18 19:26:07.939674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.579 [2024-11-18 19:26:07.939758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.939783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.939878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.939959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.939984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.940098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.940358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.940549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.940790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.940890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.940979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.941168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.941356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.941590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.941782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.941885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.941967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.942182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.942385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.942635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.942858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.942972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.943057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.943258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.943487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.943718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.943823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.943919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.944118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.944337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.944520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.944711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.944825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.944919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.945118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.945316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.945535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.580 [2024-11-18 19:26:07.945651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.580 qpair failed and we were unable to recover it. 00:27:49.580 [2024-11-18 19:26:07.945772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.945864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.945890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.945983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.946179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.946438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.946642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.946841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.946999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.947117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.947322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.947568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.947781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.947889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.947971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.948175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.948403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.948647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.948873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.948977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.949114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.949357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.949551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.949744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.949866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.949956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.950156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.950407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.950615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.950838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.950945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.951035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.951295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.951489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.951767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.951879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.581 [2024-11-18 19:26:07.951968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.952081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.581 [2024-11-18 19:26:07.952106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.581 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.952188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.952430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.952624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.952821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.952940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.953031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.953250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.953449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.953665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.953873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.953982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.954092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.954284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.954551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.954814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.954922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.955007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.955245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.955464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.955671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.955893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.955997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.956081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.956264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.956454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.956656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.956862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.956968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.957050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.957129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.957155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.957306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.957388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.582 [2024-11-18 19:26:07.957415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.582 qpair failed and we were unable to recover it. 00:27:49.582 [2024-11-18 19:26:07.957503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.957640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.957667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.957781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.957869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.957894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.957978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.958173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.958364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.958582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.958814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.958955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.959071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.959265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.959487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.959708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.959812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.959930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.960142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.960344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.960529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.960725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.960858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.960975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.961177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.961377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.961582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.961777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.961877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.962020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.962211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.962413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.962645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.962850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.962991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.963077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.963163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.963191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.963282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.963402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.963428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.583 qpair failed and we were unable to recover it. 00:27:49.583 [2024-11-18 19:26:07.963510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.963594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.583 [2024-11-18 19:26:07.963625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.963710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.963794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.963820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.963911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.963993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.964143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.964369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.964630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.964821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.964931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.965019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.965277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.965501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.965762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.965866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.965960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.966176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.966388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.966584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.966791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.966935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.967018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.967223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.967455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.967664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.967880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.967991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.968141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.968350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.968612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.968801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.968941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.969030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.969259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.969513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.969709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.584 qpair failed and we were unable to recover it. 00:27:49.584 [2024-11-18 19:26:07.969907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.584 [2024-11-18 19:26:07.969986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.970112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.970308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.970551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.970781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.970886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.970970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.971192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.971384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.971639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.971832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.971941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.972038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.972321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.972545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.972749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.972854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.972947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.973135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.973389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.973602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.973810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.973958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.974038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.974264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.974515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.974780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.974904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.974988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.975177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.975431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.975630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.975821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.975927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.585 [2024-11-18 19:26:07.976020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.976103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.585 [2024-11-18 19:26:07.976128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.585 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.976216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.976437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.976667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.976894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.976980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.977100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.977326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.977545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.977749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.977861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.977949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.978227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.978426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.978652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.978855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.978997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.979117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.979336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.979527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.979770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.979883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.979976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.980189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.980405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.980625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.980823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.980930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.981047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.981240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.981482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.981723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.981837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.981925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.982005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.982030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.982124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.982214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.982240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.586 qpair failed and we were unable to recover it. 00:27:49.586 [2024-11-18 19:26:07.982354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.586 [2024-11-18 19:26:07.982444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.982470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.982557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.982678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.982705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.982818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.982904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.982929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.983045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.983261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.983471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.983682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.983873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.983980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.984068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.984340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.984562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.984783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.984896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.984984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.985253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.985494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.985702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.985831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.985945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.986221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.986415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.986597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.986813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.986925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.987007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.987266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.987465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.987663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.587 [2024-11-18 19:26:07.987858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.587 [2024-11-18 19:26:07.987979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.587 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.988096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.988355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.988579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.988816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.988925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.989007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.989278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.989611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.989871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.989978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.990068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.990319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.990533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.990775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.990914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.991030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.991280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.991592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.991837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.991940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.992055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.992273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.992483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.992718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.992823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.992924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.993165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.993425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.993661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.993807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.993895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.994230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.994443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b44000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.994688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.588 qpair failed and we were unable to recover it. 00:27:49.588 [2024-11-18 19:26:07.994909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.588 [2024-11-18 19:26:07.994998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.995109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.995341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.995537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.995727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.995864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.995950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.996171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.996399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.996600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.996800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.996932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.997046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.997229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.997451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.997703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.997891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.997997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.998081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.998334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.998522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.998718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.998853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.998938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.999158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.999384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.999585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:07.999776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:07.999941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:08.000019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:08.000274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:08.000530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:08.000736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.000842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:08.001032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.001154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.589 [2024-11-18 19:26:08.001180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.589 qpair failed and we were unable to recover it. 00:27:49.589 [2024-11-18 19:26:08.001264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.001458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.001672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.001903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.001988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.002128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.002318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.002566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.002772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.002870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.002952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.003181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.003370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.003591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.003800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.003932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.004051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.004280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.004498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.004713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.004826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.004914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.005142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.005422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.005629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.005836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.005977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.006098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.006298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.006527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.006761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.006862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.006939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.007057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.007083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.007166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.007278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.007304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.590 qpair failed and we were unable to recover it. 00:27:49.590 [2024-11-18 19:26:08.007428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.007551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.590 [2024-11-18 19:26:08.007576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.007697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.007784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.007810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.007897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.007986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.008134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.008363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.008564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.008798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.008902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.008997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.009191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.009443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.009682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.009903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.009982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.010120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.010306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.010535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.010724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.010844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.010931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.011118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.011324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.011517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.011744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.011849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.011940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.012137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.012362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.012597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.591 qpair failed and we were unable to recover it. 00:27:49.591 [2024-11-18 19:26:08.012827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.591 [2024-11-18 19:26:08.012947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.012972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.013054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.013235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.013418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.013640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.013863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.013998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.014079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.014265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.014487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.014721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.014823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.014915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.015160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.015386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.015674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.015873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.015980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.016064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.016284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.016476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.016704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.016892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.016997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.017108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.017328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.017524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.017740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.017880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.017972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.018174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.018430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.018651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.018855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.592 [2024-11-18 19:26:08.018987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.592 qpair failed and we were unable to recover it. 00:27:49.592 [2024-11-18 19:26:08.019100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.019286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.019484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.019715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.019901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.019993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.020134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.020336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.020545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.020808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.020925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.021006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.021228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.021462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.021665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.021809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.021899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.022123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.022350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.022537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.022817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.022932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.023051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.023246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.023469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.023706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.023821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.023939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.024190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.024380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.024602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.024799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.024935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.025020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.025103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.025128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.593 qpair failed and we were unable to recover it. 00:27:49.593 [2024-11-18 19:26:08.025213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.593 [2024-11-18 19:26:08.025295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.025435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.025629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.025813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.025954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.026045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.026238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.026475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.026710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.026892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.026999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.027083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.027326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.027562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.027795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.027902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.028020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.028239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.028438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.028655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.028875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.028977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.029065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.029264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.029496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.029736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.029873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.029958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.030157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.030381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.030602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.030831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.030979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.031061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.031143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.031168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.594 qpair failed and we were unable to recover it. 00:27:49.594 [2024-11-18 19:26:08.031286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.594 [2024-11-18 19:26:08.031363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.031387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.031479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.031588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.031619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.031706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.031785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.031810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.031898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.031979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.032119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.032306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.032499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.032702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.032840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.032926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.033130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.033348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.033571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.033780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.033888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.033976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.034165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.034386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.034620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.034814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.034916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.035027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.035224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.035416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.035601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.035873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.035984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.036098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.036309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.036529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.036765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.036883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.036969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.037185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.037386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.595 [2024-11-18 19:26:08.037643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.595 [2024-11-18 19:26:08.037757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.595 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.037849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.037969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.037996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.038090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.038283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.038541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.038748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.038858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.038945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.039204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.039389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.039623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.039830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.039973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.040055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.040245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.040442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.040690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.040878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.040984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.041105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.041318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.041500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.041729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.041864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.041943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.042168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.042425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.042659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.042850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.042987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.043076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.043193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.043220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.043299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.043421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.043447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.043532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.043620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.596 [2024-11-18 19:26:08.043646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.596 qpair failed and we were unable to recover it. 00:27:49.596 [2024-11-18 19:26:08.043760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.043850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.043877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.043978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.044203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.044402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.044645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.044849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.044966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.045053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.045284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.045482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.045710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.045809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.045918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.046123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.046312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.046542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.046743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.046879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.046970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.047162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.047415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.047604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.047847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.047959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.048056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.048258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.048479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.048684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.048868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.048972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.049054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.049283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.049504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.049725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.049864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.049955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.050062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.050087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.050198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.050313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.597 [2024-11-18 19:26:08.050338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.597 qpair failed and we were unable to recover it. 00:27:49.597 [2024-11-18 19:26:08.050420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.050498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.050523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.050639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.050725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.050750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.050846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.050955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.050979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.051066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.051261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.051475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.051707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.051829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.051921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.052123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.052350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.052577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.052817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.052931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.053014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.053237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.053472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.053697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.053887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.053993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.054075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.054306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.054534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.054755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.054859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.054936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.055134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.055386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.055574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.055766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.055872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.055984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.056214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.056410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.056637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.598 [2024-11-18 19:26:08.056843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.598 [2024-11-18 19:26:08.056944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.598 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.057058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.057272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.057489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.057698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.057807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.057892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.058111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.058305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.058542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.058759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.058868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.058954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.059174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.059381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.059597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.059824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.059962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.060059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.060309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.060504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.060724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.060907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.060990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.061100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.061357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.061543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.061737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.061859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.061975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.062166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.062385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.062601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.062801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.062937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.063034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.063144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.063168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.063253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.063334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.063359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.599 [2024-11-18 19:26:08.063440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.063518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.599 [2024-11-18 19:26:08.063542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.599 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.063630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.063737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.063762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.063845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.063926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.063951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.064062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.064271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.064489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.064688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.064908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.064986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.065090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.065284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.065512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.065739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.065874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.065991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.066221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.066435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.066640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.066876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.066981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.067072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.067298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.067480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.067708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.067832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.067932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.068128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.068349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.068530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.068795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.068897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.069042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.069118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.069143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.069234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.069359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.600 [2024-11-18 19:26:08.069386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.600 qpair failed and we were unable to recover it. 00:27:49.600 [2024-11-18 19:26:08.069497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.069579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.069604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.069700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.069853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.069878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.069958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.070139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.070355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.070561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.070754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.070889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.070978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.071167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.071394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.071614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.071872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.071980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.072063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.072258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.072444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.072676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.072872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.072984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.073067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.073326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.073524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.073765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.073869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.073957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.074061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.074086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.601 qpair failed and we were unable to recover it. 00:27:49.601 [2024-11-18 19:26:08.074164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.601 [2024-11-18 19:26:08.074244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.074362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.074590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.074808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.074917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.075000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.075258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.075453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b4c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.075677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.075892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.075987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.076100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.076306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.076511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.076739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.076896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.076994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.077225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.077443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.077638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.077862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.077982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.078099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.078298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.078519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.078716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.078825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.078911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.079147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.079340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.079596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.079824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.079931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.080028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.080270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.080496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.080689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.080805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.080896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.081008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.081034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.081176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.081290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.081315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.602 qpair failed and we were unable to recover it. 00:27:49.602 [2024-11-18 19:26:08.081403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.081522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.602 [2024-11-18 19:26:08.081548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.081638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.081717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.081743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.081837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.081946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.081972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.082055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.082260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.082485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.082684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.082912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.082993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.083132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.083324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.083518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.083710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.083810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.083918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.084119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.084346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.084601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.084803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.084942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.085027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.085234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.085460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.085711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.085912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.085999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.086109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.086334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.086528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.086788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.086894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.086983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.087209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.087452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.087651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.087882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.087993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.088075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.088152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.088178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.088320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.088461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.088486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.603 [2024-11-18 19:26:08.088595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.088688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.603 [2024-11-18 19:26:08.088715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.603 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.088803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.088915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.088946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.089027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.089210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.089433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.089659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.089833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.089921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.090146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.090370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.090568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.090801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.090938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.091015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.091211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.091443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.091683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.091887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.091974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.092087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.092350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.092536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.092728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.092835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.092925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.093178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.093378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.093635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.093843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.093984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.094102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.094326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.094521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.094728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.094846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.094932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.095050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.604 [2024-11-18 19:26:08.095076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.604 qpair failed and we were unable to recover it. 00:27:49.604 [2024-11-18 19:26:08.095158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.095405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.095706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.095907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.095988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.096122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.096341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.096536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.096779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.096926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.097019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.097240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.097459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.097777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.097889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.097975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.098203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.098425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.098688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.098822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.098900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.099127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.099361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.099616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.099844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.099957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.100040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.100237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.100473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.100734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.100843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.100966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.101244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.101464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.101763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.101879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.101964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.102188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.102419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.102688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.605 qpair failed and we were unable to recover it. 00:27:49.605 [2024-11-18 19:26:08.102913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.605 [2024-11-18 19:26:08.102999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.103110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.103345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.103571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.103805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.103910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.103998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.104183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.104379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.104574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.104813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.104977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.105070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.105297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.105521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.105766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.105874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.105990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.106209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.106401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.106631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.106860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.106970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.107068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.107282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.107515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.107778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.107883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.107973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.108260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.108452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.108706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.108908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.108994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.109110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.109431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.109669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.109816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.109930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.110013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.110038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.110125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.110207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.110233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.606 qpair failed and we were unable to recover it. 00:27:49.606 [2024-11-18 19:26:08.110329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.110443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.606 [2024-11-18 19:26:08.110469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.110555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.110641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.110669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.110782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.110872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.110899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.111040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.111258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.111506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.111706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.111878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.111992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.112199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.112469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.112714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.112992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.113128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.113340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.113534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.113746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.113890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.113976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.114234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.114429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.114652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.114874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.114978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.115102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.115317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.115525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.115756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.115860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.115945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.116195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.116435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.116647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.116872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.116975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.117058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.117288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.117537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.607 [2024-11-18 19:26:08.117744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.607 [2024-11-18 19:26:08.117863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.607 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.117979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.118199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.118461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.118691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.118828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.118944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.119178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.119377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.119643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.119892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.119975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.120084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.120285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.120482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.120713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.120827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.120917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.121114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.121342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.121596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.121795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.121906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.122012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.122245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.122427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.122686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.122798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.122888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.123147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.123378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.123641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.123843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.123950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.124033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.124127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.124155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.124259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.124404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.124429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.608 qpair failed and we were unable to recover it. 00:27:49.608 [2024-11-18 19:26:08.124550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.608 [2024-11-18 19:26:08.124640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.124667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.124789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.124877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.124905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.124988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.125186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.125416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.125630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.125831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.125970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.126083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.126295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.126507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.126737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.126879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.126966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.127196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.127384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.127594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.127835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.127945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.128030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.128226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.128426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.128694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.128889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.128975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.129088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.129288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.129488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f7b3c000b90 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.129782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.129915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14bbcb0 with addr=10.0.0.2, port=4420 00:27:49.609 qpair failed and we were unable to recover it. 00:27:49.609 [2024-11-18 19:26:08.130103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.130208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:49.609 [2024-11-18 19:26:08.130238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x14c9600 with addr=10.0.0.2, port=4420 00:27:49.609 [2024-11-18 19:26:08.130258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14c9600 is same with the state(5) to be set 00:27:49.609 [2024-11-18 19:26:08.130290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x14c9600 (9): Bad file descriptor 00:27:49.609 [2024-11-18 19:26:08.130313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:49.609 [2024-11-18 19:26:08.130330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:49.609 [2024-11-18 19:26:08.130352] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:49.609 Unable to reset the controller. 00:27:49.867 19:26:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:49.867 19:26:08 -- common/autotest_common.sh@862 -- # return 0 00:27:49.867 19:26:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:49.867 19:26:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:49.867 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.867 19:26:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:49.867 19:26:08 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:49.867 19:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.867 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.867 Malloc0 00:27:49.867 19:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.867 19:26:08 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:49.867 19:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.867 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.867 [2024-11-18 19:26:08.283495] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:49.867 19:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.867 19:26:08 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:49.867 19:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.867 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.867 19:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.867 19:26:08 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:49.867 19:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.867 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.867 19:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.867 19:26:08 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:49.868 19:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.868 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.868 [2024-11-18 19:26:08.311815] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:49.868 19:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.868 19:26:08 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:49.868 19:26:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:49.868 19:26:08 -- common/autotest_common.sh@10 -- # set +x 00:27:49.868 19:26:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:49.868 19:26:08 -- host/target_disconnect.sh@58 -- # wait 3564338 00:27:50.799 Controller properly reset. 00:27:54.977 Initializing NVMe Controllers 00:27:54.977 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:54.977 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:54.977 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:54.977 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:54.977 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:54.977 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:54.977 Initialization complete. Launching workers. 00:27:54.977 Starting thread on core 1 00:27:54.977 Starting thread on core 2 00:27:54.977 Starting thread on core 0 00:27:54.977 Starting thread on core 3 00:27:54.977 19:26:13 -- host/target_disconnect.sh@59 -- # sync 00:27:54.977 00:27:54.977 real 0m11.379s 00:27:54.977 user 0m34.885s 00:27:54.978 sys 0m6.989s 00:27:54.978 19:26:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:54.978 19:26:13 -- common/autotest_common.sh@10 -- # set +x 00:27:54.978 ************************************ 00:27:54.978 END TEST nvmf_target_disconnect_tc2 00:27:54.978 ************************************ 00:27:54.978 19:26:13 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:54.978 19:26:13 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:54.978 19:26:13 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:54.978 19:26:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:54.978 19:26:13 -- nvmf/common.sh@116 -- # sync 00:27:54.978 19:26:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:54.978 19:26:13 -- nvmf/common.sh@119 -- # set +e 00:27:54.978 19:26:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:54.978 19:26:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:54.978 rmmod nvme_tcp 00:27:54.978 rmmod nvme_fabrics 00:27:54.978 rmmod nvme_keyring 00:27:54.978 19:26:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:54.978 19:26:13 -- nvmf/common.sh@123 -- # set -e 00:27:54.978 19:26:13 -- nvmf/common.sh@124 -- # return 0 00:27:54.978 19:26:13 -- nvmf/common.sh@477 -- # '[' -n 3564881 ']' 00:27:54.978 19:26:13 -- nvmf/common.sh@478 -- # killprocess 3564881 00:27:54.978 19:26:13 -- common/autotest_common.sh@936 -- # '[' -z 3564881 ']' 00:27:54.978 19:26:13 -- common/autotest_common.sh@940 -- # kill -0 3564881 00:27:54.978 19:26:13 -- common/autotest_common.sh@941 -- # uname 00:27:54.978 19:26:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:54.978 19:26:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3564881 00:27:54.978 19:26:13 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:54.978 19:26:13 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:54.978 19:26:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3564881' 00:27:54.978 killing process with pid 3564881 00:27:54.978 19:26:13 -- common/autotest_common.sh@955 -- # kill 3564881 00:27:54.978 19:26:13 -- common/autotest_common.sh@960 -- # wait 3564881 00:27:55.236 19:26:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:55.236 19:26:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:55.236 19:26:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:55.236 19:26:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:55.236 19:26:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:55.236 19:26:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:55.236 19:26:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:55.236 19:26:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:57.765 19:26:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:57.765 00:27:57.765 real 0m16.230s 00:27:57.765 user 1m0.463s 00:27:57.765 sys 0m9.295s 00:27:57.765 19:26:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:57.765 19:26:15 -- common/autotest_common.sh@10 -- # set +x 00:27:57.765 ************************************ 00:27:57.765 END TEST nvmf_target_disconnect 00:27:57.765 ************************************ 00:27:57.765 19:26:15 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:57.765 19:26:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:57.765 19:26:15 -- common/autotest_common.sh@10 -- # set +x 00:27:57.765 19:26:15 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:57.765 00:27:57.765 real 21m29.911s 00:27:57.765 user 62m37.944s 00:27:57.765 sys 4m58.528s 00:27:57.765 19:26:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:57.765 19:26:15 -- common/autotest_common.sh@10 -- # set +x 00:27:57.765 ************************************ 00:27:57.765 END TEST nvmf_tcp 00:27:57.765 ************************************ 00:27:57.765 19:26:15 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:57.765 19:26:15 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:57.765 19:26:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:57.765 19:26:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:57.765 19:26:15 -- common/autotest_common.sh@10 -- # set +x 00:27:57.765 ************************************ 00:27:57.765 START TEST spdkcli_nvmf_tcp 00:27:57.765 ************************************ 00:27:57.765 19:26:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:57.765 * Looking for test storage... 00:27:57.765 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:57.765 19:26:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:57.765 19:26:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:57.765 19:26:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:57.765 19:26:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:57.765 19:26:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:57.765 19:26:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:57.765 19:26:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:57.765 19:26:16 -- scripts/common.sh@335 -- # IFS=.-: 00:27:57.765 19:26:16 -- scripts/common.sh@335 -- # read -ra ver1 00:27:57.765 19:26:16 -- scripts/common.sh@336 -- # IFS=.-: 00:27:57.765 19:26:16 -- scripts/common.sh@336 -- # read -ra ver2 00:27:57.765 19:26:16 -- scripts/common.sh@337 -- # local 'op=<' 00:27:57.765 19:26:16 -- scripts/common.sh@339 -- # ver1_l=2 00:27:57.765 19:26:16 -- scripts/common.sh@340 -- # ver2_l=1 00:27:57.765 19:26:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:57.765 19:26:16 -- scripts/common.sh@343 -- # case "$op" in 00:27:57.765 19:26:16 -- scripts/common.sh@344 -- # : 1 00:27:57.765 19:26:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:57.765 19:26:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:57.765 19:26:16 -- scripts/common.sh@364 -- # decimal 1 00:27:57.765 19:26:16 -- scripts/common.sh@352 -- # local d=1 00:27:57.765 19:26:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:57.765 19:26:16 -- scripts/common.sh@354 -- # echo 1 00:27:57.765 19:26:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:57.765 19:26:16 -- scripts/common.sh@365 -- # decimal 2 00:27:57.765 19:26:16 -- scripts/common.sh@352 -- # local d=2 00:27:57.766 19:26:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:57.766 19:26:16 -- scripts/common.sh@354 -- # echo 2 00:27:57.766 19:26:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:57.766 19:26:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:57.766 19:26:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:57.766 19:26:16 -- scripts/common.sh@367 -- # return 0 00:27:57.766 19:26:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:57.766 19:26:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:57.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.766 --rc genhtml_branch_coverage=1 00:27:57.766 --rc genhtml_function_coverage=1 00:27:57.766 --rc genhtml_legend=1 00:27:57.766 --rc geninfo_all_blocks=1 00:27:57.766 --rc geninfo_unexecuted_blocks=1 00:27:57.766 00:27:57.766 ' 00:27:57.766 19:26:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:57.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.766 --rc genhtml_branch_coverage=1 00:27:57.766 --rc genhtml_function_coverage=1 00:27:57.766 --rc genhtml_legend=1 00:27:57.766 --rc geninfo_all_blocks=1 00:27:57.766 --rc geninfo_unexecuted_blocks=1 00:27:57.766 00:27:57.766 ' 00:27:57.766 19:26:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:57.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.766 --rc genhtml_branch_coverage=1 00:27:57.766 --rc genhtml_function_coverage=1 00:27:57.766 --rc genhtml_legend=1 00:27:57.766 --rc geninfo_all_blocks=1 00:27:57.766 --rc geninfo_unexecuted_blocks=1 00:27:57.766 00:27:57.766 ' 00:27:57.766 19:26:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:57.766 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.766 --rc genhtml_branch_coverage=1 00:27:57.766 --rc genhtml_function_coverage=1 00:27:57.766 --rc genhtml_legend=1 00:27:57.766 --rc geninfo_all_blocks=1 00:27:57.766 --rc geninfo_unexecuted_blocks=1 00:27:57.766 00:27:57.766 ' 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:57.766 19:26:16 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:57.766 19:26:16 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:57.766 19:26:16 -- nvmf/common.sh@7 -- # uname -s 00:27:57.766 19:26:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:57.766 19:26:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:57.766 19:26:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:57.766 19:26:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:57.766 19:26:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:57.766 19:26:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:57.766 19:26:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:57.766 19:26:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:57.766 19:26:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:57.766 19:26:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:57.766 19:26:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.766 19:26:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.766 19:26:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:57.766 19:26:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:57.766 19:26:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:57.766 19:26:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:57.766 19:26:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:57.766 19:26:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:57.766 19:26:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:57.766 19:26:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.766 19:26:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.766 19:26:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.766 19:26:16 -- paths/export.sh@5 -- # export PATH 00:27:57.766 19:26:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.766 19:26:16 -- nvmf/common.sh@46 -- # : 0 00:27:57.766 19:26:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:57.766 19:26:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:57.766 19:26:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:57.766 19:26:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:57.766 19:26:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:57.766 19:26:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:57.766 19:26:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:57.766 19:26:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:57.766 19:26:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.766 19:26:16 -- common/autotest_common.sh@10 -- # set +x 00:27:57.766 19:26:16 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:57.766 19:26:16 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3566106 00:27:57.766 19:26:16 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:57.766 19:26:16 -- spdkcli/common.sh@34 -- # waitforlisten 3566106 00:27:57.766 19:26:16 -- common/autotest_common.sh@829 -- # '[' -z 3566106 ']' 00:27:57.766 19:26:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:57.766 19:26:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:57.766 19:26:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:57.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:57.766 19:26:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:57.766 19:26:16 -- common/autotest_common.sh@10 -- # set +x 00:27:57.766 [2024-11-18 19:26:16.135430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:57.766 [2024-11-18 19:26:16.135528] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3566106 ] 00:27:57.766 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.766 [2024-11-18 19:26:16.200519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:57.766 [2024-11-18 19:26:16.317299] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:57.766 [2024-11-18 19:26:16.320629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:57.766 [2024-11-18 19:26:16.320644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:58.699 19:26:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:58.699 19:26:17 -- common/autotest_common.sh@862 -- # return 0 00:27:58.699 19:26:17 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:58.699 19:26:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:58.699 19:26:17 -- common/autotest_common.sh@10 -- # set +x 00:27:58.699 19:26:17 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:58.699 19:26:17 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:58.699 19:26:17 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:58.699 19:26:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:58.699 19:26:17 -- common/autotest_common.sh@10 -- # set +x 00:27:58.699 19:26:17 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:58.699 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:58.699 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:58.699 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:58.699 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:58.699 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:58.699 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:58.699 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:58.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:58.699 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:58.700 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:58.700 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:58.700 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:58.700 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:58.700 ' 00:27:58.957 [2024-11-18 19:26:17.510874] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:01.484 [2024-11-18 19:26:19.704832] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:02.418 [2024-11-18 19:26:20.945354] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:04.946 [2024-11-18 19:26:23.232545] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:06.846 [2024-11-18 19:26:25.235090] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:08.221 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:08.221 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:08.221 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:08.221 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:08.221 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:08.221 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:08.221 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:08.221 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:08.221 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:08.221 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:08.221 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:08.221 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:08.479 19:26:26 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:08.479 19:26:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:08.479 19:26:26 -- common/autotest_common.sh@10 -- # set +x 00:28:08.479 19:26:26 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:08.479 19:26:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:08.479 19:26:26 -- common/autotest_common.sh@10 -- # set +x 00:28:08.479 19:26:26 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:08.479 19:26:26 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:08.738 19:26:27 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:08.996 19:26:27 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:08.996 19:26:27 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:08.996 19:26:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:08.996 19:26:27 -- common/autotest_common.sh@10 -- # set +x 00:28:08.996 19:26:27 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:08.996 19:26:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:08.996 19:26:27 -- common/autotest_common.sh@10 -- # set +x 00:28:08.996 19:26:27 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:08.996 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:08.996 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:08.996 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:08.996 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:08.996 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:08.996 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:08.996 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:08.996 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:08.996 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:08.996 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:08.996 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:08.996 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:08.996 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:08.996 ' 00:28:14.260 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:14.260 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:14.260 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:14.260 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:14.260 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:14.260 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:14.260 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:14.260 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:14.260 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:14.260 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:14.260 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:14.260 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:14.260 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:14.260 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:14.260 19:26:32 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:14.260 19:26:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:14.260 19:26:32 -- common/autotest_common.sh@10 -- # set +x 00:28:14.260 19:26:32 -- spdkcli/nvmf.sh@90 -- # killprocess 3566106 00:28:14.260 19:26:32 -- common/autotest_common.sh@936 -- # '[' -z 3566106 ']' 00:28:14.260 19:26:32 -- common/autotest_common.sh@940 -- # kill -0 3566106 00:28:14.260 19:26:32 -- common/autotest_common.sh@941 -- # uname 00:28:14.260 19:26:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:14.260 19:26:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3566106 00:28:14.518 19:26:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:14.518 19:26:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:14.518 19:26:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3566106' 00:28:14.518 killing process with pid 3566106 00:28:14.518 19:26:32 -- common/autotest_common.sh@955 -- # kill 3566106 00:28:14.518 [2024-11-18 19:26:32.885392] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:14.518 19:26:32 -- common/autotest_common.sh@960 -- # wait 3566106 00:28:14.777 19:26:33 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:14.777 19:26:33 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:14.777 19:26:33 -- spdkcli/common.sh@13 -- # '[' -n 3566106 ']' 00:28:14.777 19:26:33 -- spdkcli/common.sh@14 -- # killprocess 3566106 00:28:14.777 19:26:33 -- common/autotest_common.sh@936 -- # '[' -z 3566106 ']' 00:28:14.777 19:26:33 -- common/autotest_common.sh@940 -- # kill -0 3566106 00:28:14.777 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3566106) - No such process 00:28:14.777 19:26:33 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3566106 is not found' 00:28:14.777 Process with pid 3566106 is not found 00:28:14.777 19:26:33 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:14.777 19:26:33 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:14.777 19:26:33 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:14.777 00:28:14.777 real 0m17.219s 00:28:14.777 user 0m36.847s 00:28:14.777 sys 0m0.770s 00:28:14.777 19:26:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:14.777 19:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:14.777 ************************************ 00:28:14.777 END TEST spdkcli_nvmf_tcp 00:28:14.777 ************************************ 00:28:14.777 19:26:33 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:14.777 19:26:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:14.777 19:26:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:14.777 19:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:14.777 ************************************ 00:28:14.777 START TEST nvmf_identify_passthru 00:28:14.777 ************************************ 00:28:14.777 19:26:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:14.777 * Looking for test storage... 00:28:14.777 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:14.777 19:26:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:14.777 19:26:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:14.777 19:26:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:14.777 19:26:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:14.777 19:26:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:14.777 19:26:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:14.777 19:26:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:14.777 19:26:33 -- scripts/common.sh@335 -- # IFS=.-: 00:28:14.777 19:26:33 -- scripts/common.sh@335 -- # read -ra ver1 00:28:14.777 19:26:33 -- scripts/common.sh@336 -- # IFS=.-: 00:28:14.777 19:26:33 -- scripts/common.sh@336 -- # read -ra ver2 00:28:14.777 19:26:33 -- scripts/common.sh@337 -- # local 'op=<' 00:28:14.777 19:26:33 -- scripts/common.sh@339 -- # ver1_l=2 00:28:14.777 19:26:33 -- scripts/common.sh@340 -- # ver2_l=1 00:28:14.777 19:26:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:14.777 19:26:33 -- scripts/common.sh@343 -- # case "$op" in 00:28:14.777 19:26:33 -- scripts/common.sh@344 -- # : 1 00:28:14.777 19:26:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:14.777 19:26:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:14.777 19:26:33 -- scripts/common.sh@364 -- # decimal 1 00:28:14.777 19:26:33 -- scripts/common.sh@352 -- # local d=1 00:28:14.777 19:26:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:14.777 19:26:33 -- scripts/common.sh@354 -- # echo 1 00:28:14.777 19:26:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:14.777 19:26:33 -- scripts/common.sh@365 -- # decimal 2 00:28:14.777 19:26:33 -- scripts/common.sh@352 -- # local d=2 00:28:14.777 19:26:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:14.777 19:26:33 -- scripts/common.sh@354 -- # echo 2 00:28:14.777 19:26:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:14.777 19:26:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:14.777 19:26:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:14.777 19:26:33 -- scripts/common.sh@367 -- # return 0 00:28:14.777 19:26:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:14.777 19:26:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:14.777 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.777 --rc genhtml_branch_coverage=1 00:28:14.777 --rc genhtml_function_coverage=1 00:28:14.777 --rc genhtml_legend=1 00:28:14.777 --rc geninfo_all_blocks=1 00:28:14.777 --rc geninfo_unexecuted_blocks=1 00:28:14.777 00:28:14.777 ' 00:28:14.778 19:26:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:14.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.778 --rc genhtml_branch_coverage=1 00:28:14.778 --rc genhtml_function_coverage=1 00:28:14.778 --rc genhtml_legend=1 00:28:14.778 --rc geninfo_all_blocks=1 00:28:14.778 --rc geninfo_unexecuted_blocks=1 00:28:14.778 00:28:14.778 ' 00:28:14.778 19:26:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:14.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.778 --rc genhtml_branch_coverage=1 00:28:14.778 --rc genhtml_function_coverage=1 00:28:14.778 --rc genhtml_legend=1 00:28:14.778 --rc geninfo_all_blocks=1 00:28:14.778 --rc geninfo_unexecuted_blocks=1 00:28:14.778 00:28:14.778 ' 00:28:14.778 19:26:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:14.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:14.778 --rc genhtml_branch_coverage=1 00:28:14.778 --rc genhtml_function_coverage=1 00:28:14.778 --rc genhtml_legend=1 00:28:14.778 --rc geninfo_all_blocks=1 00:28:14.778 --rc geninfo_unexecuted_blocks=1 00:28:14.778 00:28:14.778 ' 00:28:14.778 19:26:33 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:14.778 19:26:33 -- nvmf/common.sh@7 -- # uname -s 00:28:14.778 19:26:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:14.778 19:26:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:14.778 19:26:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:14.778 19:26:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:14.778 19:26:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:14.778 19:26:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:14.778 19:26:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:14.778 19:26:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:14.778 19:26:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:14.778 19:26:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:14.778 19:26:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:14.778 19:26:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:14.778 19:26:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:14.778 19:26:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:14.778 19:26:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:14.778 19:26:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:14.778 19:26:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:14.778 19:26:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:14.778 19:26:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:14.778 19:26:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- paths/export.sh@5 -- # export PATH 00:28:14.778 19:26:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- nvmf/common.sh@46 -- # : 0 00:28:14.778 19:26:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:14.778 19:26:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:14.778 19:26:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:14.778 19:26:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:14.778 19:26:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:14.778 19:26:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:14.778 19:26:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:14.778 19:26:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:14.778 19:26:33 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:14.778 19:26:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:14.778 19:26:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:14.778 19:26:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:14.778 19:26:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- paths/export.sh@5 -- # export PATH 00:28:14.778 19:26:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:14.778 19:26:33 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:14.778 19:26:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:14.778 19:26:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:14.778 19:26:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:14.778 19:26:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:14.778 19:26:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:14.778 19:26:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:14.778 19:26:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:14.778 19:26:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:14.778 19:26:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:14.778 19:26:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:14.778 19:26:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:14.778 19:26:33 -- common/autotest_common.sh@10 -- # set +x 00:28:16.676 19:26:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:16.676 19:26:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:16.676 19:26:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:16.676 19:26:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:16.676 19:26:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:16.676 19:26:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:16.676 19:26:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:16.676 19:26:35 -- nvmf/common.sh@294 -- # net_devs=() 00:28:16.676 19:26:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:16.676 19:26:35 -- nvmf/common.sh@295 -- # e810=() 00:28:16.676 19:26:35 -- nvmf/common.sh@295 -- # local -ga e810 00:28:16.676 19:26:35 -- nvmf/common.sh@296 -- # x722=() 00:28:16.676 19:26:35 -- nvmf/common.sh@296 -- # local -ga x722 00:28:16.676 19:26:35 -- nvmf/common.sh@297 -- # mlx=() 00:28:16.676 19:26:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:16.676 19:26:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:16.676 19:26:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:16.676 19:26:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:16.676 19:26:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:16.676 19:26:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:16.676 19:26:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:16.676 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:16.676 19:26:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:16.676 19:26:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:16.676 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:16.676 19:26:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:16.676 19:26:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:16.677 19:26:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:16.677 19:26:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:16.677 19:26:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:16.677 19:26:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:16.677 19:26:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:16.677 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:16.677 19:26:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:16.677 19:26:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:16.677 19:26:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:16.677 19:26:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:16.677 19:26:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:16.677 19:26:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:16.677 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:16.677 19:26:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:16.677 19:26:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:16.677 19:26:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:16.677 19:26:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:16.677 19:26:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:16.677 19:26:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:16.677 19:26:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:16.677 19:26:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:16.677 19:26:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:16.677 19:26:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:16.677 19:26:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:16.677 19:26:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:16.677 19:26:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:16.677 19:26:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:16.677 19:26:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:16.677 19:26:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:16.677 19:26:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:16.934 19:26:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:16.934 19:26:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:16.934 19:26:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:16.934 19:26:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:16.934 19:26:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:16.934 19:26:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:16.934 19:26:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:16.934 19:26:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:16.934 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:16.934 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:28:16.934 00:28:16.934 --- 10.0.0.2 ping statistics --- 00:28:16.934 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:16.934 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:28:16.934 19:26:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:16.934 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:16.934 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:28:16.934 00:28:16.934 --- 10.0.0.1 ping statistics --- 00:28:16.934 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:16.934 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:28:16.934 19:26:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:16.934 19:26:35 -- nvmf/common.sh@410 -- # return 0 00:28:16.934 19:26:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:16.934 19:26:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:16.934 19:26:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:16.934 19:26:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:16.934 19:26:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:16.934 19:26:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:16.934 19:26:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:17.197 19:26:35 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:17.197 19:26:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:17.197 19:26:35 -- common/autotest_common.sh@10 -- # set +x 00:28:17.197 19:26:35 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:17.197 19:26:35 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:17.197 19:26:35 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:17.197 19:26:35 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:17.197 19:26:35 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:17.197 19:26:35 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:17.197 19:26:35 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:17.197 19:26:35 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:17.197 19:26:35 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:17.197 19:26:35 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:17.197 19:26:35 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:17.197 19:26:35 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:17.197 19:26:35 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:17.197 19:26:35 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:17.197 19:26:35 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:17.197 19:26:35 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:17.197 19:26:35 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:17.197 19:26:35 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:17.197 EAL: No free 2048 kB hugepages reported on node 1 00:28:21.378 19:26:39 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:21.378 19:26:39 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:21.378 19:26:39 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:21.378 19:26:39 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:21.378 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.562 19:26:43 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:25.562 19:26:43 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:25.562 19:26:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:25.562 19:26:43 -- common/autotest_common.sh@10 -- # set +x 00:28:25.562 19:26:44 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:25.562 19:26:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:25.562 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:25.562 19:26:44 -- target/identify_passthru.sh@31 -- # nvmfpid=3570853 00:28:25.562 19:26:44 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:25.562 19:26:44 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:25.562 19:26:44 -- target/identify_passthru.sh@35 -- # waitforlisten 3570853 00:28:25.562 19:26:44 -- common/autotest_common.sh@829 -- # '[' -z 3570853 ']' 00:28:25.562 19:26:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:25.562 19:26:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:25.562 19:26:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:25.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:25.562 19:26:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:25.562 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:25.562 [2024-11-18 19:26:44.073843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:25.562 [2024-11-18 19:26:44.073920] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:25.562 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.562 [2024-11-18 19:26:44.140996] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:25.821 [2024-11-18 19:26:44.256077] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:25.821 [2024-11-18 19:26:44.256238] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:25.821 [2024-11-18 19:26:44.256257] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:25.821 [2024-11-18 19:26:44.256272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:25.821 [2024-11-18 19:26:44.256358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:25.821 [2024-11-18 19:26:44.256427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:25.821 [2024-11-18 19:26:44.256519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:25.821 [2024-11-18 19:26:44.256521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:25.821 19:26:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:25.821 19:26:44 -- common/autotest_common.sh@862 -- # return 0 00:28:25.821 19:26:44 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:25.821 19:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.821 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:25.821 INFO: Log level set to 20 00:28:25.821 INFO: Requests: 00:28:25.821 { 00:28:25.821 "jsonrpc": "2.0", 00:28:25.821 "method": "nvmf_set_config", 00:28:25.821 "id": 1, 00:28:25.821 "params": { 00:28:25.821 "admin_cmd_passthru": { 00:28:25.821 "identify_ctrlr": true 00:28:25.821 } 00:28:25.821 } 00:28:25.821 } 00:28:25.821 00:28:25.821 INFO: response: 00:28:25.821 { 00:28:25.821 "jsonrpc": "2.0", 00:28:25.821 "id": 1, 00:28:25.821 "result": true 00:28:25.821 } 00:28:25.821 00:28:25.821 19:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.821 19:26:44 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:25.821 19:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.821 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:25.821 INFO: Setting log level to 20 00:28:25.821 INFO: Setting log level to 20 00:28:25.821 INFO: Log level set to 20 00:28:25.821 INFO: Log level set to 20 00:28:25.821 INFO: Requests: 00:28:25.821 { 00:28:25.821 "jsonrpc": "2.0", 00:28:25.821 "method": "framework_start_init", 00:28:25.821 "id": 1 00:28:25.821 } 00:28:25.821 00:28:25.821 INFO: Requests: 00:28:25.821 { 00:28:25.821 "jsonrpc": "2.0", 00:28:25.821 "method": "framework_start_init", 00:28:25.821 "id": 1 00:28:25.821 } 00:28:25.821 00:28:25.821 [2024-11-18 19:26:44.396839] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:25.821 INFO: response: 00:28:25.821 { 00:28:25.821 "jsonrpc": "2.0", 00:28:25.821 "id": 1, 00:28:25.821 "result": true 00:28:25.821 } 00:28:25.821 00:28:25.821 INFO: response: 00:28:25.821 { 00:28:25.821 "jsonrpc": "2.0", 00:28:25.821 "id": 1, 00:28:25.821 "result": true 00:28:25.821 } 00:28:25.821 00:28:25.821 19:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.821 19:26:44 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:25.821 19:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:25.821 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:25.821 INFO: Setting log level to 40 00:28:25.821 INFO: Setting log level to 40 00:28:25.821 INFO: Setting log level to 40 00:28:25.821 [2024-11-18 19:26:44.406819] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:25.821 19:26:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:25.821 19:26:44 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:25.821 19:26:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:25.821 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:26.079 19:26:44 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:26.079 19:26:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:26.079 19:26:44 -- common/autotest_common.sh@10 -- # set +x 00:28:29.360 Nvme0n1 00:28:29.360 19:26:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.360 19:26:47 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:29.360 19:26:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.360 19:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.360 19:26:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.360 19:26:47 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:29.360 19:26:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.360 19:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.360 19:26:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.360 19:26:47 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:29.360 19:26:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.360 19:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.360 [2024-11-18 19:26:47.297871] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:29.360 19:26:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.360 19:26:47 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:29.360 19:26:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.360 19:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.360 [2024-11-18 19:26:47.305578] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:29.360 [ 00:28:29.360 { 00:28:29.360 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:29.360 "subtype": "Discovery", 00:28:29.360 "listen_addresses": [], 00:28:29.360 "allow_any_host": true, 00:28:29.360 "hosts": [] 00:28:29.360 }, 00:28:29.360 { 00:28:29.360 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:29.360 "subtype": "NVMe", 00:28:29.360 "listen_addresses": [ 00:28:29.360 { 00:28:29.360 "transport": "TCP", 00:28:29.360 "trtype": "TCP", 00:28:29.360 "adrfam": "IPv4", 00:28:29.360 "traddr": "10.0.0.2", 00:28:29.360 "trsvcid": "4420" 00:28:29.360 } 00:28:29.360 ], 00:28:29.360 "allow_any_host": true, 00:28:29.360 "hosts": [], 00:28:29.360 "serial_number": "SPDK00000000000001", 00:28:29.360 "model_number": "SPDK bdev Controller", 00:28:29.360 "max_namespaces": 1, 00:28:29.360 "min_cntlid": 1, 00:28:29.360 "max_cntlid": 65519, 00:28:29.360 "namespaces": [ 00:28:29.360 { 00:28:29.360 "nsid": 1, 00:28:29.360 "bdev_name": "Nvme0n1", 00:28:29.360 "name": "Nvme0n1", 00:28:29.360 "nguid": "5BBD98570C32485AB7A79BC3752C15C4", 00:28:29.360 "uuid": "5bbd9857-0c32-485a-b7a7-9bc3752c15c4" 00:28:29.360 } 00:28:29.360 ] 00:28:29.360 } 00:28:29.360 ] 00:28:29.360 19:26:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.360 19:26:47 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:29.360 19:26:47 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:29.360 19:26:47 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:29.360 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.360 19:26:47 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:29.360 19:26:47 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:29.360 19:26:47 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:29.360 19:26:47 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:29.360 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.360 19:26:47 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:29.360 19:26:47 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:29.360 19:26:47 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:29.360 19:26:47 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:29.360 19:26:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.360 19:26:47 -- common/autotest_common.sh@10 -- # set +x 00:28:29.360 19:26:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.360 19:26:47 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:29.360 19:26:47 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:29.360 19:26:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:29.360 19:26:47 -- nvmf/common.sh@116 -- # sync 00:28:29.360 19:26:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:29.360 19:26:47 -- nvmf/common.sh@119 -- # set +e 00:28:29.360 19:26:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:29.360 19:26:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:29.360 rmmod nvme_tcp 00:28:29.360 rmmod nvme_fabrics 00:28:29.360 rmmod nvme_keyring 00:28:29.360 19:26:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:29.360 19:26:47 -- nvmf/common.sh@123 -- # set -e 00:28:29.360 19:26:47 -- nvmf/common.sh@124 -- # return 0 00:28:29.360 19:26:47 -- nvmf/common.sh@477 -- # '[' -n 3570853 ']' 00:28:29.360 19:26:47 -- nvmf/common.sh@478 -- # killprocess 3570853 00:28:29.360 19:26:47 -- common/autotest_common.sh@936 -- # '[' -z 3570853 ']' 00:28:29.360 19:26:47 -- common/autotest_common.sh@940 -- # kill -0 3570853 00:28:29.360 19:26:47 -- common/autotest_common.sh@941 -- # uname 00:28:29.360 19:26:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:29.360 19:26:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3570853 00:28:29.360 19:26:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:29.360 19:26:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:29.360 19:26:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3570853' 00:28:29.360 killing process with pid 3570853 00:28:29.360 19:26:47 -- common/autotest_common.sh@955 -- # kill 3570853 00:28:29.361 [2024-11-18 19:26:47.692216] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:29.361 19:26:47 -- common/autotest_common.sh@960 -- # wait 3570853 00:28:30.733 19:26:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:30.733 19:26:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:30.733 19:26:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:30.733 19:26:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:30.733 19:26:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:30.733 19:26:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:30.733 19:26:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:30.733 19:26:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:33.264 19:26:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:33.264 00:28:33.264 real 0m18.164s 00:28:33.264 user 0m26.608s 00:28:33.264 sys 0m2.261s 00:28:33.264 19:26:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:33.264 19:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:33.264 ************************************ 00:28:33.264 END TEST nvmf_identify_passthru 00:28:33.264 ************************************ 00:28:33.264 19:26:51 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:33.264 19:26:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:33.264 19:26:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:33.264 19:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:33.264 ************************************ 00:28:33.264 START TEST nvmf_dif 00:28:33.264 ************************************ 00:28:33.264 19:26:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:33.264 * Looking for test storage... 00:28:33.264 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:33.264 19:26:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:33.264 19:26:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:33.264 19:26:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:33.264 19:26:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:33.264 19:26:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:33.264 19:26:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:33.264 19:26:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:33.264 19:26:51 -- scripts/common.sh@335 -- # IFS=.-: 00:28:33.264 19:26:51 -- scripts/common.sh@335 -- # read -ra ver1 00:28:33.264 19:26:51 -- scripts/common.sh@336 -- # IFS=.-: 00:28:33.264 19:26:51 -- scripts/common.sh@336 -- # read -ra ver2 00:28:33.264 19:26:51 -- scripts/common.sh@337 -- # local 'op=<' 00:28:33.264 19:26:51 -- scripts/common.sh@339 -- # ver1_l=2 00:28:33.265 19:26:51 -- scripts/common.sh@340 -- # ver2_l=1 00:28:33.265 19:26:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:33.265 19:26:51 -- scripts/common.sh@343 -- # case "$op" in 00:28:33.265 19:26:51 -- scripts/common.sh@344 -- # : 1 00:28:33.265 19:26:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:33.265 19:26:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:33.265 19:26:51 -- scripts/common.sh@364 -- # decimal 1 00:28:33.265 19:26:51 -- scripts/common.sh@352 -- # local d=1 00:28:33.265 19:26:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:33.265 19:26:51 -- scripts/common.sh@354 -- # echo 1 00:28:33.265 19:26:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:33.265 19:26:51 -- scripts/common.sh@365 -- # decimal 2 00:28:33.265 19:26:51 -- scripts/common.sh@352 -- # local d=2 00:28:33.265 19:26:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:33.265 19:26:51 -- scripts/common.sh@354 -- # echo 2 00:28:33.265 19:26:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:33.265 19:26:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:33.265 19:26:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:33.265 19:26:51 -- scripts/common.sh@367 -- # return 0 00:28:33.265 19:26:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:33.265 19:26:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:33.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:33.265 --rc genhtml_branch_coverage=1 00:28:33.265 --rc genhtml_function_coverage=1 00:28:33.265 --rc genhtml_legend=1 00:28:33.265 --rc geninfo_all_blocks=1 00:28:33.265 --rc geninfo_unexecuted_blocks=1 00:28:33.265 00:28:33.265 ' 00:28:33.265 19:26:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:33.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:33.265 --rc genhtml_branch_coverage=1 00:28:33.265 --rc genhtml_function_coverage=1 00:28:33.265 --rc genhtml_legend=1 00:28:33.265 --rc geninfo_all_blocks=1 00:28:33.265 --rc geninfo_unexecuted_blocks=1 00:28:33.265 00:28:33.265 ' 00:28:33.265 19:26:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:33.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:33.265 --rc genhtml_branch_coverage=1 00:28:33.265 --rc genhtml_function_coverage=1 00:28:33.265 --rc genhtml_legend=1 00:28:33.265 --rc geninfo_all_blocks=1 00:28:33.265 --rc geninfo_unexecuted_blocks=1 00:28:33.265 00:28:33.265 ' 00:28:33.265 19:26:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:33.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:33.265 --rc genhtml_branch_coverage=1 00:28:33.265 --rc genhtml_function_coverage=1 00:28:33.265 --rc genhtml_legend=1 00:28:33.265 --rc geninfo_all_blocks=1 00:28:33.265 --rc geninfo_unexecuted_blocks=1 00:28:33.265 00:28:33.265 ' 00:28:33.265 19:26:51 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:33.265 19:26:51 -- nvmf/common.sh@7 -- # uname -s 00:28:33.265 19:26:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:33.265 19:26:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:33.265 19:26:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:33.265 19:26:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:33.265 19:26:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:33.265 19:26:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:33.265 19:26:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:33.265 19:26:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:33.265 19:26:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:33.265 19:26:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:33.265 19:26:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:33.265 19:26:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:33.265 19:26:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:33.265 19:26:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:33.265 19:26:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:33.265 19:26:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:33.265 19:26:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:33.265 19:26:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:33.265 19:26:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:33.265 19:26:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.265 19:26:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.265 19:26:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.265 19:26:51 -- paths/export.sh@5 -- # export PATH 00:28:33.265 19:26:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:33.265 19:26:51 -- nvmf/common.sh@46 -- # : 0 00:28:33.265 19:26:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:33.265 19:26:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:33.265 19:26:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:33.265 19:26:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:33.265 19:26:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:33.265 19:26:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:33.265 19:26:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:33.265 19:26:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:33.265 19:26:51 -- target/dif.sh@15 -- # NULL_META=16 00:28:33.265 19:26:51 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:33.265 19:26:51 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:33.265 19:26:51 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:33.265 19:26:51 -- target/dif.sh@135 -- # nvmftestinit 00:28:33.265 19:26:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:33.265 19:26:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:33.265 19:26:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:33.265 19:26:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:33.265 19:26:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:33.265 19:26:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:33.265 19:26:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:33.265 19:26:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:33.265 19:26:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:33.265 19:26:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:33.265 19:26:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:33.265 19:26:51 -- common/autotest_common.sh@10 -- # set +x 00:28:35.168 19:26:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:35.168 19:26:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:35.168 19:26:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:35.168 19:26:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:35.168 19:26:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:35.168 19:26:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:35.168 19:26:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:35.168 19:26:53 -- nvmf/common.sh@294 -- # net_devs=() 00:28:35.168 19:26:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:35.168 19:26:53 -- nvmf/common.sh@295 -- # e810=() 00:28:35.168 19:26:53 -- nvmf/common.sh@295 -- # local -ga e810 00:28:35.168 19:26:53 -- nvmf/common.sh@296 -- # x722=() 00:28:35.168 19:26:53 -- nvmf/common.sh@296 -- # local -ga x722 00:28:35.168 19:26:53 -- nvmf/common.sh@297 -- # mlx=() 00:28:35.168 19:26:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:35.168 19:26:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:35.168 19:26:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:35.168 19:26:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:35.168 19:26:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:35.168 19:26:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:35.168 19:26:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:35.168 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:35.168 19:26:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:35.168 19:26:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:35.168 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:35.168 19:26:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:35.168 19:26:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:35.168 19:26:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:35.168 19:26:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:35.168 19:26:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:35.168 19:26:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:35.168 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:35.168 19:26:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:35.168 19:26:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:35.168 19:26:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:35.168 19:26:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:35.168 19:26:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:35.168 19:26:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:35.168 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:35.168 19:26:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:35.168 19:26:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:35.168 19:26:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:35.168 19:26:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:35.168 19:26:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:35.168 19:26:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:35.168 19:26:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:35.168 19:26:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:35.168 19:26:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:35.168 19:26:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:35.168 19:26:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:35.168 19:26:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:35.168 19:26:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:35.168 19:26:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:35.168 19:26:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:35.168 19:26:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:35.168 19:26:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:35.168 19:26:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:35.168 19:26:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:35.168 19:26:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:35.168 19:26:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:35.168 19:26:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:35.169 19:26:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:35.169 19:26:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:35.169 19:26:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:35.169 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:35.169 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:28:35.169 00:28:35.169 --- 10.0.0.2 ping statistics --- 00:28:35.169 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:35.169 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:28:35.169 19:26:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:35.169 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:35.169 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:28:35.169 00:28:35.169 --- 10.0.0.1 ping statistics --- 00:28:35.169 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:35.169 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:28:35.169 19:26:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:35.169 19:26:53 -- nvmf/common.sh@410 -- # return 0 00:28:35.169 19:26:53 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:35.169 19:26:53 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:36.540 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:36.540 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:36.540 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:36.540 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:36.540 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:36.540 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:36.540 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:36.540 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:36.540 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:36.540 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:36.540 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:36.540 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:36.540 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:36.540 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:36.540 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:36.540 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:36.540 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:36.540 19:26:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:36.540 19:26:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:36.540 19:26:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:36.540 19:26:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:36.540 19:26:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:36.540 19:26:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:36.540 19:26:55 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:36.540 19:26:55 -- target/dif.sh@137 -- # nvmfappstart 00:28:36.540 19:26:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:36.540 19:26:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:36.540 19:26:55 -- common/autotest_common.sh@10 -- # set +x 00:28:36.540 19:26:55 -- nvmf/common.sh@469 -- # nvmfpid=3574171 00:28:36.540 19:26:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:36.540 19:26:55 -- nvmf/common.sh@470 -- # waitforlisten 3574171 00:28:36.540 19:26:55 -- common/autotest_common.sh@829 -- # '[' -z 3574171 ']' 00:28:36.540 19:26:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:36.540 19:26:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:36.540 19:26:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:36.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:36.540 19:26:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:36.540 19:26:55 -- common/autotest_common.sh@10 -- # set +x 00:28:36.540 [2024-11-18 19:26:55.087566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:36.540 [2024-11-18 19:26:55.087657] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:36.540 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.828 [2024-11-18 19:26:55.158871] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:36.828 [2024-11-18 19:26:55.271884] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:36.828 [2024-11-18 19:26:55.272063] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:36.828 [2024-11-18 19:26:55.272085] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:36.828 [2024-11-18 19:26:55.272100] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:36.828 [2024-11-18 19:26:55.272131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:37.829 19:26:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:37.829 19:26:56 -- common/autotest_common.sh@862 -- # return 0 00:28:37.829 19:26:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:37.829 19:26:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 19:26:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:37.829 19:26:56 -- target/dif.sh@139 -- # create_transport 00:28:37.829 19:26:56 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:37.829 19:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 [2024-11-18 19:26:56.099984] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:37.829 19:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.829 19:26:56 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:37.829 19:26:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:37.829 19:26:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 ************************************ 00:28:37.829 START TEST fio_dif_1_default 00:28:37.829 ************************************ 00:28:37.829 19:26:56 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:37.829 19:26:56 -- target/dif.sh@86 -- # create_subsystems 0 00:28:37.829 19:26:56 -- target/dif.sh@28 -- # local sub 00:28:37.829 19:26:56 -- target/dif.sh@30 -- # for sub in "$@" 00:28:37.829 19:26:56 -- target/dif.sh@31 -- # create_subsystem 0 00:28:37.829 19:26:56 -- target/dif.sh@18 -- # local sub_id=0 00:28:37.829 19:26:56 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:37.829 19:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 bdev_null0 00:28:37.829 19:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.829 19:26:56 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:37.829 19:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 19:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.829 19:26:56 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:37.829 19:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 19:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.829 19:26:56 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:37.829 19:26:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.829 19:26:56 -- common/autotest_common.sh@10 -- # set +x 00:28:37.829 [2024-11-18 19:26:56.136260] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:37.829 19:26:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:37.830 19:26:56 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:37.830 19:26:56 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:37.830 19:26:56 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:37.830 19:26:56 -- nvmf/common.sh@520 -- # config=() 00:28:37.830 19:26:56 -- nvmf/common.sh@520 -- # local subsystem config 00:28:37.830 19:26:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:37.830 19:26:56 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:37.830 19:26:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:37.830 { 00:28:37.830 "params": { 00:28:37.830 "name": "Nvme$subsystem", 00:28:37.830 "trtype": "$TEST_TRANSPORT", 00:28:37.830 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:37.830 "adrfam": "ipv4", 00:28:37.830 "trsvcid": "$NVMF_PORT", 00:28:37.830 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:37.830 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:37.830 "hdgst": ${hdgst:-false}, 00:28:37.830 "ddgst": ${ddgst:-false} 00:28:37.830 }, 00:28:37.830 "method": "bdev_nvme_attach_controller" 00:28:37.830 } 00:28:37.830 EOF 00:28:37.830 )") 00:28:37.830 19:26:56 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:37.830 19:26:56 -- target/dif.sh@82 -- # gen_fio_conf 00:28:37.830 19:26:56 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:37.830 19:26:56 -- target/dif.sh@54 -- # local file 00:28:37.830 19:26:56 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:37.830 19:26:56 -- target/dif.sh@56 -- # cat 00:28:37.830 19:26:56 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:37.830 19:26:56 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:37.830 19:26:56 -- common/autotest_common.sh@1330 -- # shift 00:28:37.830 19:26:56 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:37.830 19:26:56 -- nvmf/common.sh@542 -- # cat 00:28:37.830 19:26:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:37.830 19:26:56 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:37.830 19:26:56 -- target/dif.sh@72 -- # (( file <= files )) 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:37.830 19:26:56 -- nvmf/common.sh@544 -- # jq . 00:28:37.830 19:26:56 -- nvmf/common.sh@545 -- # IFS=, 00:28:37.830 19:26:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:37.830 "params": { 00:28:37.830 "name": "Nvme0", 00:28:37.830 "trtype": "tcp", 00:28:37.830 "traddr": "10.0.0.2", 00:28:37.830 "adrfam": "ipv4", 00:28:37.830 "trsvcid": "4420", 00:28:37.830 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:37.830 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:37.830 "hdgst": false, 00:28:37.830 "ddgst": false 00:28:37.830 }, 00:28:37.830 "method": "bdev_nvme_attach_controller" 00:28:37.830 }' 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:37.830 19:26:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:37.830 19:26:56 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:37.830 19:26:56 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:37.830 19:26:56 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:37.830 19:26:56 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:37.830 19:26:56 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:37.830 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:37.830 fio-3.35 00:28:37.830 Starting 1 thread 00:28:37.830 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.396 [2024-11-18 19:26:56.760235] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:38.396 [2024-11-18 19:26:56.760303] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:48.363 00:28:48.363 filename0: (groupid=0, jobs=1): err= 0: pid=3574415: Mon Nov 18 19:27:06 2024 00:28:48.363 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10009msec) 00:28:48.363 slat (nsec): min=4521, max=52377, avg=9047.38, stdev=3160.75 00:28:48.363 clat (usec): min=40763, max=45707, avg=40991.05, stdev=305.98 00:28:48.363 lat (usec): min=40771, max=45721, avg=41000.10, stdev=305.86 00:28:48.363 clat percentiles (usec): 00:28:48.363 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:48.363 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:48.363 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:48.363 | 99.00th=[41157], 99.50th=[41157], 99.90th=[45876], 99.95th=[45876], 00:28:48.363 | 99.99th=[45876] 00:28:48.363 bw ( KiB/s): min= 384, max= 416, per=99.47%, avg=388.80, stdev=11.72, samples=20 00:28:48.363 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:48.363 lat (msec) : 50=100.00% 00:28:48.363 cpu : usr=91.99%, sys=7.70%, ctx=13, majf=0, minf=248 00:28:48.363 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:48.363 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:48.363 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:48.363 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:48.363 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:48.363 00:28:48.363 Run status group 0 (all jobs): 00:28:48.363 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10009-10009msec 00:28:48.622 19:27:07 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:48.622 19:27:07 -- target/dif.sh@43 -- # local sub 00:28:48.622 19:27:07 -- target/dif.sh@45 -- # for sub in "$@" 00:28:48.622 19:27:07 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:48.622 19:27:07 -- target/dif.sh@36 -- # local sub_id=0 00:28:48.622 19:27:07 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:48.622 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.622 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.881 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.881 19:27:07 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:48.881 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.881 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.881 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.881 00:28:48.881 real 0m11.131s 00:28:48.881 user 0m10.341s 00:28:48.881 sys 0m1.033s 00:28:48.881 19:27:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:48.881 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.881 ************************************ 00:28:48.881 END TEST fio_dif_1_default 00:28:48.881 ************************************ 00:28:48.881 19:27:07 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:48.881 19:27:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:48.881 19:27:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:48.881 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.881 ************************************ 00:28:48.881 START TEST fio_dif_1_multi_subsystems 00:28:48.881 ************************************ 00:28:48.881 19:27:07 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:48.881 19:27:07 -- target/dif.sh@92 -- # local files=1 00:28:48.881 19:27:07 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:48.881 19:27:07 -- target/dif.sh@28 -- # local sub 00:28:48.881 19:27:07 -- target/dif.sh@30 -- # for sub in "$@" 00:28:48.881 19:27:07 -- target/dif.sh@31 -- # create_subsystem 0 00:28:48.881 19:27:07 -- target/dif.sh@18 -- # local sub_id=0 00:28:48.881 19:27:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:48.881 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 bdev_null0 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 [2024-11-18 19:27:07.295098] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@30 -- # for sub in "$@" 00:28:48.882 19:27:07 -- target/dif.sh@31 -- # create_subsystem 1 00:28:48.882 19:27:07 -- target/dif.sh@18 -- # local sub_id=1 00:28:48.882 19:27:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 bdev_null1 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:48.882 19:27:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:48.882 19:27:07 -- common/autotest_common.sh@10 -- # set +x 00:28:48.882 19:27:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:48.882 19:27:07 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:48.882 19:27:07 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:48.882 19:27:07 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:48.882 19:27:07 -- nvmf/common.sh@520 -- # config=() 00:28:48.882 19:27:07 -- nvmf/common.sh@520 -- # local subsystem config 00:28:48.882 19:27:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:48.882 19:27:07 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.882 19:27:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:48.882 { 00:28:48.882 "params": { 00:28:48.882 "name": "Nvme$subsystem", 00:28:48.882 "trtype": "$TEST_TRANSPORT", 00:28:48.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:48.882 "adrfam": "ipv4", 00:28:48.882 "trsvcid": "$NVMF_PORT", 00:28:48.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:48.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:48.882 "hdgst": ${hdgst:-false}, 00:28:48.882 "ddgst": ${ddgst:-false} 00:28:48.882 }, 00:28:48.882 "method": "bdev_nvme_attach_controller" 00:28:48.882 } 00:28:48.882 EOF 00:28:48.882 )") 00:28:48.882 19:27:07 -- target/dif.sh@82 -- # gen_fio_conf 00:28:48.882 19:27:07 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:48.882 19:27:07 -- target/dif.sh@54 -- # local file 00:28:48.882 19:27:07 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:48.882 19:27:07 -- target/dif.sh@56 -- # cat 00:28:48.882 19:27:07 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:48.882 19:27:07 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:48.882 19:27:07 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.882 19:27:07 -- common/autotest_common.sh@1330 -- # shift 00:28:48.882 19:27:07 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:48.882 19:27:07 -- nvmf/common.sh@542 -- # cat 00:28:48.882 19:27:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:48.882 19:27:07 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:48.882 19:27:07 -- target/dif.sh@72 -- # (( file <= files )) 00:28:48.882 19:27:07 -- target/dif.sh@73 -- # cat 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:48.882 19:27:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:48.882 19:27:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:48.882 { 00:28:48.882 "params": { 00:28:48.882 "name": "Nvme$subsystem", 00:28:48.882 "trtype": "$TEST_TRANSPORT", 00:28:48.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:48.882 "adrfam": "ipv4", 00:28:48.882 "trsvcid": "$NVMF_PORT", 00:28:48.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:48.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:48.882 "hdgst": ${hdgst:-false}, 00:28:48.882 "ddgst": ${ddgst:-false} 00:28:48.882 }, 00:28:48.882 "method": "bdev_nvme_attach_controller" 00:28:48.882 } 00:28:48.882 EOF 00:28:48.882 )") 00:28:48.882 19:27:07 -- target/dif.sh@72 -- # (( file++ )) 00:28:48.882 19:27:07 -- target/dif.sh@72 -- # (( file <= files )) 00:28:48.882 19:27:07 -- nvmf/common.sh@542 -- # cat 00:28:48.882 19:27:07 -- nvmf/common.sh@544 -- # jq . 00:28:48.882 19:27:07 -- nvmf/common.sh@545 -- # IFS=, 00:28:48.882 19:27:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:48.882 "params": { 00:28:48.882 "name": "Nvme0", 00:28:48.882 "trtype": "tcp", 00:28:48.882 "traddr": "10.0.0.2", 00:28:48.882 "adrfam": "ipv4", 00:28:48.882 "trsvcid": "4420", 00:28:48.882 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:48.882 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:48.882 "hdgst": false, 00:28:48.882 "ddgst": false 00:28:48.882 }, 00:28:48.882 "method": "bdev_nvme_attach_controller" 00:28:48.882 },{ 00:28:48.882 "params": { 00:28:48.882 "name": "Nvme1", 00:28:48.882 "trtype": "tcp", 00:28:48.882 "traddr": "10.0.0.2", 00:28:48.882 "adrfam": "ipv4", 00:28:48.882 "trsvcid": "4420", 00:28:48.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:48.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:48.882 "hdgst": false, 00:28:48.882 "ddgst": false 00:28:48.882 }, 00:28:48.882 "method": "bdev_nvme_attach_controller" 00:28:48.882 }' 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:48.882 19:27:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:48.882 19:27:07 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:48.882 19:27:07 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:48.882 19:27:07 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:48.882 19:27:07 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:48.882 19:27:07 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:49.141 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:49.141 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:49.141 fio-3.35 00:28:49.141 Starting 2 threads 00:28:49.141 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.707 [2024-11-18 19:27:08.242527] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:49.707 [2024-11-18 19:27:08.242604] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:01.902 00:29:01.902 filename0: (groupid=0, jobs=1): err= 0: pid=3576370: Mon Nov 18 19:27:18 2024 00:29:01.902 read: IOPS=95, BW=382KiB/s (391kB/s)(3824KiB/10005msec) 00:29:01.902 slat (nsec): min=7383, max=29184, avg=10270.35, stdev=3559.27 00:29:01.902 clat (usec): min=40915, max=45506, avg=41827.67, stdev=433.58 00:29:01.902 lat (usec): min=40929, max=45531, avg=41837.94, stdev=433.68 00:29:01.902 clat percentiles (usec): 00:29:01.902 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41681], 00:29:01.902 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:29:01.902 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:29:01.902 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45351], 99.95th=[45351], 00:29:01.902 | 99.99th=[45351] 00:29:01.902 bw ( KiB/s): min= 352, max= 384, per=49.71%, avg=380.80, stdev= 9.85, samples=20 00:29:01.902 iops : min= 88, max= 96, avg=95.20, stdev= 2.46, samples=20 00:29:01.902 lat (msec) : 50=100.00% 00:29:01.902 cpu : usr=95.48%, sys=4.16%, ctx=36, majf=0, minf=187 00:29:01.902 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.902 issued rwts: total=956,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.902 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:01.902 filename1: (groupid=0, jobs=1): err= 0: pid=3576371: Mon Nov 18 19:27:18 2024 00:29:01.902 read: IOPS=95, BW=382KiB/s (391kB/s)(3824KiB/10004msec) 00:29:01.902 slat (nsec): min=7101, max=40301, avg=10606.15, stdev=4377.32 00:29:01.902 clat (usec): min=40888, max=45523, avg=41822.48, stdev=476.72 00:29:01.902 lat (usec): min=40897, max=45535, avg=41833.08, stdev=476.96 00:29:01.902 clat percentiles (usec): 00:29:01.902 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41681], 00:29:01.902 | 30.00th=[41681], 40.00th=[41681], 50.00th=[42206], 60.00th=[42206], 00:29:01.902 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:29:01.902 | 99.00th=[42730], 99.50th=[42730], 99.90th=[45351], 99.95th=[45351], 00:29:01.902 | 99.99th=[45351] 00:29:01.902 bw ( KiB/s): min= 352, max= 384, per=49.71%, avg=380.63, stdev=10.09, samples=19 00:29:01.902 iops : min= 88, max= 96, avg=95.16, stdev= 2.52, samples=19 00:29:01.902 lat (msec) : 50=100.00% 00:29:01.902 cpu : usr=95.22%, sys=4.24%, ctx=51, majf=0, minf=128 00:29:01.902 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:01.902 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.902 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:01.902 issued rwts: total=956,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:01.902 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:01.902 00:29:01.902 Run status group 0 (all jobs): 00:29:01.902 READ: bw=764KiB/s (783kB/s), 382KiB/s-382KiB/s (391kB/s-391kB/s), io=7648KiB (7832kB), run=10004-10005msec 00:29:01.902 19:27:18 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:01.902 19:27:18 -- target/dif.sh@43 -- # local sub 00:29:01.902 19:27:18 -- target/dif.sh@45 -- # for sub in "$@" 00:29:01.902 19:27:18 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:01.902 19:27:18 -- target/dif.sh@36 -- # local sub_id=0 00:29:01.902 19:27:18 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@45 -- # for sub in "$@" 00:29:01.902 19:27:18 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:01.902 19:27:18 -- target/dif.sh@36 -- # local sub_id=1 00:29:01.902 19:27:18 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 00:29:01.902 real 0m11.385s 00:29:01.902 user 0m20.521s 00:29:01.902 sys 0m1.130s 00:29:01.902 19:27:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 ************************************ 00:29:01.902 END TEST fio_dif_1_multi_subsystems 00:29:01.902 ************************************ 00:29:01.902 19:27:18 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:01.902 19:27:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:01.902 19:27:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 ************************************ 00:29:01.902 START TEST fio_dif_rand_params 00:29:01.902 ************************************ 00:29:01.902 19:27:18 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:01.902 19:27:18 -- target/dif.sh@100 -- # local NULL_DIF 00:29:01.902 19:27:18 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:01.902 19:27:18 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:01.902 19:27:18 -- target/dif.sh@103 -- # bs=128k 00:29:01.902 19:27:18 -- target/dif.sh@103 -- # numjobs=3 00:29:01.902 19:27:18 -- target/dif.sh@103 -- # iodepth=3 00:29:01.902 19:27:18 -- target/dif.sh@103 -- # runtime=5 00:29:01.902 19:27:18 -- target/dif.sh@105 -- # create_subsystems 0 00:29:01.902 19:27:18 -- target/dif.sh@28 -- # local sub 00:29:01.902 19:27:18 -- target/dif.sh@30 -- # for sub in "$@" 00:29:01.902 19:27:18 -- target/dif.sh@31 -- # create_subsystem 0 00:29:01.902 19:27:18 -- target/dif.sh@18 -- # local sub_id=0 00:29:01.902 19:27:18 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 bdev_null0 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:01.902 19:27:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.902 19:27:18 -- common/autotest_common.sh@10 -- # set +x 00:29:01.902 [2024-11-18 19:27:18.709689] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:01.902 19:27:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.902 19:27:18 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:01.903 19:27:18 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:01.903 19:27:18 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:01.903 19:27:18 -- nvmf/common.sh@520 -- # config=() 00:29:01.903 19:27:18 -- nvmf/common.sh@520 -- # local subsystem config 00:29:01.903 19:27:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:01.903 19:27:18 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.903 19:27:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:01.903 { 00:29:01.903 "params": { 00:29:01.903 "name": "Nvme$subsystem", 00:29:01.903 "trtype": "$TEST_TRANSPORT", 00:29:01.903 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:01.903 "adrfam": "ipv4", 00:29:01.903 "trsvcid": "$NVMF_PORT", 00:29:01.903 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:01.903 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:01.903 "hdgst": ${hdgst:-false}, 00:29:01.903 "ddgst": ${ddgst:-false} 00:29:01.903 }, 00:29:01.903 "method": "bdev_nvme_attach_controller" 00:29:01.903 } 00:29:01.903 EOF 00:29:01.903 )") 00:29:01.903 19:27:18 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.903 19:27:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:01.903 19:27:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:01.903 19:27:18 -- target/dif.sh@82 -- # gen_fio_conf 00:29:01.903 19:27:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:01.903 19:27:18 -- target/dif.sh@54 -- # local file 00:29:01.903 19:27:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.903 19:27:18 -- common/autotest_common.sh@1330 -- # shift 00:29:01.903 19:27:18 -- target/dif.sh@56 -- # cat 00:29:01.903 19:27:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:01.903 19:27:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:01.903 19:27:18 -- nvmf/common.sh@542 -- # cat 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:01.903 19:27:18 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:01.903 19:27:18 -- target/dif.sh@72 -- # (( file <= files )) 00:29:01.903 19:27:18 -- nvmf/common.sh@544 -- # jq . 00:29:01.903 19:27:18 -- nvmf/common.sh@545 -- # IFS=, 00:29:01.903 19:27:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:01.903 "params": { 00:29:01.903 "name": "Nvme0", 00:29:01.903 "trtype": "tcp", 00:29:01.903 "traddr": "10.0.0.2", 00:29:01.903 "adrfam": "ipv4", 00:29:01.903 "trsvcid": "4420", 00:29:01.903 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:01.903 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:01.903 "hdgst": false, 00:29:01.903 "ddgst": false 00:29:01.903 }, 00:29:01.903 "method": "bdev_nvme_attach_controller" 00:29:01.903 }' 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:01.903 19:27:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:01.903 19:27:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:01.903 19:27:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:01.903 19:27:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:01.903 19:27:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:01.903 19:27:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:01.903 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:01.903 ... 00:29:01.903 fio-3.35 00:29:01.903 Starting 3 threads 00:29:01.903 EAL: No free 2048 kB hugepages reported on node 1 00:29:01.903 [2024-11-18 19:27:19.396410] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:01.903 [2024-11-18 19:27:19.396462] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:06.086 00:29:06.086 filename0: (groupid=0, jobs=1): err= 0: pid=3577929: Mon Nov 18 19:27:24 2024 00:29:06.086 read: IOPS=225, BW=28.2MiB/s (29.6MB/s)(142MiB/5043msec) 00:29:06.086 slat (nsec): min=7004, max=40370, avg=15306.84, stdev=4182.78 00:29:06.086 clat (usec): min=5469, max=54118, avg=13239.37, stdev=5627.90 00:29:06.086 lat (usec): min=5480, max=54130, avg=13254.68, stdev=5627.94 00:29:06.086 clat percentiles (usec): 00:29:06.086 | 1.00th=[ 7177], 5.00th=[ 9110], 10.00th=[10028], 20.00th=[10945], 00:29:06.086 | 30.00th=[11600], 40.00th=[12125], 50.00th=[12649], 60.00th=[13173], 00:29:06.086 | 70.00th=[13698], 80.00th=[14222], 90.00th=[15139], 95.00th=[15795], 00:29:06.086 | 99.00th=[50070], 99.50th=[52167], 99.90th=[54264], 99.95th=[54264], 00:29:06.086 | 99.99th=[54264] 00:29:06.086 bw ( KiB/s): min=25600, max=31488, per=32.34%, avg=29081.60, stdev=1703.25, samples=10 00:29:06.086 iops : min= 200, max= 246, avg=227.20, stdev=13.31, samples=10 00:29:06.086 lat (msec) : 10=10.02%, 20=87.96%, 50=0.97%, 100=1.05% 00:29:06.086 cpu : usr=95.50%, sys=4.05%, ctx=12, majf=0, minf=121 00:29:06.087 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:06.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.087 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.087 issued rwts: total=1138,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:06.087 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:06.087 filename0: (groupid=0, jobs=1): err= 0: pid=3577930: Mon Nov 18 19:27:24 2024 00:29:06.087 read: IOPS=241, BW=30.2MiB/s (31.7MB/s)(153MiB/5047msec) 00:29:06.087 slat (nsec): min=3897, max=66717, avg=18776.74, stdev=4554.84 00:29:06.087 clat (usec): min=4886, max=56608, avg=12352.10, stdev=5309.66 00:29:06.087 lat (usec): min=4894, max=56639, avg=12370.87, stdev=5309.48 00:29:06.087 clat percentiles (usec): 00:29:06.087 | 1.00th=[ 7373], 5.00th=[ 8848], 10.00th=[ 9503], 20.00th=[10159], 00:29:06.087 | 30.00th=[10683], 40.00th=[11207], 50.00th=[11731], 60.00th=[12256], 00:29:06.087 | 70.00th=[12780], 80.00th=[13435], 90.00th=[14222], 95.00th=[14746], 00:29:06.087 | 99.00th=[50070], 99.50th=[51643], 99.90th=[56361], 99.95th=[56361], 00:29:06.087 | 99.99th=[56361] 00:29:06.087 bw ( KiB/s): min=25088, max=34048, per=34.64%, avg=31155.20, stdev=2871.18, samples=10 00:29:06.087 iops : min= 196, max= 266, avg=243.40, stdev=22.43, samples=10 00:29:06.087 lat (msec) : 10=15.82%, 20=82.54%, 50=0.74%, 100=0.90% 00:29:06.087 cpu : usr=95.92%, sys=3.61%, ctx=10, majf=0, minf=111 00:29:06.087 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:06.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.087 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.087 issued rwts: total=1220,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:06.087 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:06.087 filename0: (groupid=0, jobs=1): err= 0: pid=3577931: Mon Nov 18 19:27:24 2024 00:29:06.087 read: IOPS=235, BW=29.4MiB/s (30.9MB/s)(149MiB/5046msec) 00:29:06.087 slat (nsec): min=4554, max=64457, avg=16115.49, stdev=4967.30 00:29:06.087 clat (usec): min=4017, max=55426, avg=12683.87, stdev=5383.02 00:29:06.087 lat (usec): min=4030, max=55445, avg=12699.98, stdev=5383.18 00:29:06.087 clat percentiles (usec): 00:29:06.087 | 1.00th=[ 5669], 5.00th=[ 8094], 10.00th=[ 9372], 20.00th=[10683], 00:29:06.087 | 30.00th=[11207], 40.00th=[11731], 50.00th=[12125], 60.00th=[12649], 00:29:06.087 | 70.00th=[13173], 80.00th=[13829], 90.00th=[14746], 95.00th=[15664], 00:29:06.087 | 99.00th=[50594], 99.50th=[52167], 99.90th=[54264], 99.95th=[55313], 00:29:06.087 | 99.99th=[55313] 00:29:06.087 bw ( KiB/s): min=21290, max=34048, per=33.76%, avg=30365.80, stdev=3649.18, samples=10 00:29:06.087 iops : min= 166, max= 266, avg=237.20, stdev=28.60, samples=10 00:29:06.087 lat (msec) : 10=13.13%, 20=85.10%, 50=0.67%, 100=1.09% 00:29:06.087 cpu : usr=94.19%, sys=5.19%, ctx=44, majf=0, minf=165 00:29:06.087 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:06.087 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.087 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:06.087 issued rwts: total=1188,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:06.087 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:06.087 00:29:06.087 Run status group 0 (all jobs): 00:29:06.087 READ: bw=87.8MiB/s (92.1MB/s), 28.2MiB/s-30.2MiB/s (29.6MB/s-31.7MB/s), io=443MiB (465MB), run=5043-5047msec 00:29:06.345 19:27:24 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:06.345 19:27:24 -- target/dif.sh@43 -- # local sub 00:29:06.345 19:27:24 -- target/dif.sh@45 -- # for sub in "$@" 00:29:06.345 19:27:24 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:06.345 19:27:24 -- target/dif.sh@36 -- # local sub_id=0 00:29:06.345 19:27:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:06.346 19:27:24 -- target/dif.sh@109 -- # bs=4k 00:29:06.346 19:27:24 -- target/dif.sh@109 -- # numjobs=8 00:29:06.346 19:27:24 -- target/dif.sh@109 -- # iodepth=16 00:29:06.346 19:27:24 -- target/dif.sh@109 -- # runtime= 00:29:06.346 19:27:24 -- target/dif.sh@109 -- # files=2 00:29:06.346 19:27:24 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:06.346 19:27:24 -- target/dif.sh@28 -- # local sub 00:29:06.346 19:27:24 -- target/dif.sh@30 -- # for sub in "$@" 00:29:06.346 19:27:24 -- target/dif.sh@31 -- # create_subsystem 0 00:29:06.346 19:27:24 -- target/dif.sh@18 -- # local sub_id=0 00:29:06.346 19:27:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 bdev_null0 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 [2024-11-18 19:27:24.842650] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@30 -- # for sub in "$@" 00:29:06.346 19:27:24 -- target/dif.sh@31 -- # create_subsystem 1 00:29:06.346 19:27:24 -- target/dif.sh@18 -- # local sub_id=1 00:29:06.346 19:27:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 bdev_null1 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@30 -- # for sub in "$@" 00:29:06.346 19:27:24 -- target/dif.sh@31 -- # create_subsystem 2 00:29:06.346 19:27:24 -- target/dif.sh@18 -- # local sub_id=2 00:29:06.346 19:27:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 bdev_null2 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:06.346 19:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.346 19:27:24 -- common/autotest_common.sh@10 -- # set +x 00:29:06.346 19:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.346 19:27:24 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:06.346 19:27:24 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:06.346 19:27:24 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:06.346 19:27:24 -- nvmf/common.sh@520 -- # config=() 00:29:06.346 19:27:24 -- nvmf/common.sh@520 -- # local subsystem config 00:29:06.346 19:27:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:06.346 19:27:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:06.346 { 00:29:06.346 "params": { 00:29:06.346 "name": "Nvme$subsystem", 00:29:06.346 "trtype": "$TEST_TRANSPORT", 00:29:06.346 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:06.346 "adrfam": "ipv4", 00:29:06.346 "trsvcid": "$NVMF_PORT", 00:29:06.346 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:06.346 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:06.346 "hdgst": ${hdgst:-false}, 00:29:06.346 "ddgst": ${ddgst:-false} 00:29:06.346 }, 00:29:06.346 "method": "bdev_nvme_attach_controller" 00:29:06.346 } 00:29:06.346 EOF 00:29:06.346 )") 00:29:06.346 19:27:24 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:06.346 19:27:24 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:06.346 19:27:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:06.346 19:27:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:06.346 19:27:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:06.346 19:27:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:06.346 19:27:24 -- common/autotest_common.sh@1330 -- # shift 00:29:06.346 19:27:24 -- target/dif.sh@82 -- # gen_fio_conf 00:29:06.346 19:27:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:06.346 19:27:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:06.346 19:27:24 -- target/dif.sh@54 -- # local file 00:29:06.346 19:27:24 -- target/dif.sh@56 -- # cat 00:29:06.346 19:27:24 -- nvmf/common.sh@542 -- # cat 00:29:06.346 19:27:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:06.346 19:27:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:06.346 19:27:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:06.346 19:27:24 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:06.346 19:27:24 -- target/dif.sh@72 -- # (( file <= files )) 00:29:06.346 19:27:24 -- target/dif.sh@73 -- # cat 00:29:06.346 19:27:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:06.346 19:27:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:06.346 { 00:29:06.346 "params": { 00:29:06.346 "name": "Nvme$subsystem", 00:29:06.347 "trtype": "$TEST_TRANSPORT", 00:29:06.347 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:06.347 "adrfam": "ipv4", 00:29:06.347 "trsvcid": "$NVMF_PORT", 00:29:06.347 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:06.347 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:06.347 "hdgst": ${hdgst:-false}, 00:29:06.347 "ddgst": ${ddgst:-false} 00:29:06.347 }, 00:29:06.347 "method": "bdev_nvme_attach_controller" 00:29:06.347 } 00:29:06.347 EOF 00:29:06.347 )") 00:29:06.347 19:27:24 -- nvmf/common.sh@542 -- # cat 00:29:06.347 19:27:24 -- target/dif.sh@72 -- # (( file++ )) 00:29:06.347 19:27:24 -- target/dif.sh@72 -- # (( file <= files )) 00:29:06.347 19:27:24 -- target/dif.sh@73 -- # cat 00:29:06.347 19:27:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:06.347 19:27:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:06.347 { 00:29:06.347 "params": { 00:29:06.347 "name": "Nvme$subsystem", 00:29:06.347 "trtype": "$TEST_TRANSPORT", 00:29:06.347 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:06.347 "adrfam": "ipv4", 00:29:06.347 "trsvcid": "$NVMF_PORT", 00:29:06.347 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:06.347 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:06.347 "hdgst": ${hdgst:-false}, 00:29:06.347 "ddgst": ${ddgst:-false} 00:29:06.347 }, 00:29:06.347 "method": "bdev_nvme_attach_controller" 00:29:06.347 } 00:29:06.347 EOF 00:29:06.347 )") 00:29:06.347 19:27:24 -- target/dif.sh@72 -- # (( file++ )) 00:29:06.347 19:27:24 -- target/dif.sh@72 -- # (( file <= files )) 00:29:06.347 19:27:24 -- nvmf/common.sh@542 -- # cat 00:29:06.347 19:27:24 -- nvmf/common.sh@544 -- # jq . 00:29:06.347 19:27:24 -- nvmf/common.sh@545 -- # IFS=, 00:29:06.347 19:27:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:06.347 "params": { 00:29:06.347 "name": "Nvme0", 00:29:06.347 "trtype": "tcp", 00:29:06.347 "traddr": "10.0.0.2", 00:29:06.347 "adrfam": "ipv4", 00:29:06.347 "trsvcid": "4420", 00:29:06.347 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:06.347 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:06.347 "hdgst": false, 00:29:06.347 "ddgst": false 00:29:06.347 }, 00:29:06.347 "method": "bdev_nvme_attach_controller" 00:29:06.347 },{ 00:29:06.347 "params": { 00:29:06.347 "name": "Nvme1", 00:29:06.347 "trtype": "tcp", 00:29:06.347 "traddr": "10.0.0.2", 00:29:06.347 "adrfam": "ipv4", 00:29:06.347 "trsvcid": "4420", 00:29:06.347 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:06.347 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:06.347 "hdgst": false, 00:29:06.347 "ddgst": false 00:29:06.347 }, 00:29:06.347 "method": "bdev_nvme_attach_controller" 00:29:06.347 },{ 00:29:06.347 "params": { 00:29:06.347 "name": "Nvme2", 00:29:06.347 "trtype": "tcp", 00:29:06.347 "traddr": "10.0.0.2", 00:29:06.347 "adrfam": "ipv4", 00:29:06.347 "trsvcid": "4420", 00:29:06.347 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:06.347 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:06.347 "hdgst": false, 00:29:06.347 "ddgst": false 00:29:06.347 }, 00:29:06.347 "method": "bdev_nvme_attach_controller" 00:29:06.347 }' 00:29:06.347 19:27:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:06.347 19:27:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:06.347 19:27:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:06.347 19:27:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:06.347 19:27:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:06.347 19:27:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:06.605 19:27:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:06.605 19:27:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:06.605 19:27:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:06.605 19:27:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:06.605 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:06.605 ... 00:29:06.605 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:06.605 ... 00:29:06.605 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:06.605 ... 00:29:06.605 fio-3.35 00:29:06.605 Starting 24 threads 00:29:06.863 EAL: No free 2048 kB hugepages reported on node 1 00:29:07.796 [2024-11-18 19:27:26.047545] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:07.796 [2024-11-18 19:27:26.047627] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:20.002 00:29:20.002 filename0: (groupid=0, jobs=1): err= 0: pid=3578813: Mon Nov 18 19:27:36 2024 00:29:20.002 read: IOPS=495, BW=1982KiB/s (2029kB/s)(19.6MiB/10141msec) 00:29:20.002 slat (nsec): min=16024, max=91083, avg=43608.89, stdev=10931.97 00:29:20.002 clat (msec): min=24, max=165, avg=31.90, stdev= 7.67 00:29:20.002 lat (msec): min=24, max=165, avg=31.95, stdev= 7.67 00:29:20.002 clat percentiles (msec): 00:29:20.002 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.002 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.002 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.002 | 99.00th=[ 33], 99.50th=[ 56], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.002 | 99.99th=[ 165] 00:29:20.002 bw ( KiB/s): min= 1792, max= 2048, per=4.21%, avg=2002.05, stdev=76.66, samples=20 00:29:20.002 iops : min= 448, max= 512, avg=500.50, stdev=19.18, samples=20 00:29:20.002 lat (msec) : 50=99.36%, 100=0.32%, 250=0.32% 00:29:20.002 cpu : usr=96.64%, sys=1.97%, ctx=215, majf=0, minf=9 00:29:20.002 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.002 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.002 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.002 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.002 filename0: (groupid=0, jobs=1): err= 0: pid=3578814: Mon Nov 18 19:27:36 2024 00:29:20.002 read: IOPS=496, BW=1986KiB/s (2034kB/s)(19.7MiB/10149msec) 00:29:20.002 slat (nsec): min=8103, max=70497, avg=28932.15, stdev=9874.28 00:29:20.002 clat (msec): min=25, max=160, avg=31.95, stdev= 7.29 00:29:20.002 lat (msec): min=25, max=160, avg=31.98, stdev= 7.29 00:29:20.002 clat percentiles (msec): 00:29:20.002 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:29:20.002 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.002 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.002 | 99.00th=[ 35], 99.50th=[ 39], 99.90th=[ 161], 99.95th=[ 161], 00:29:20.002 | 99.99th=[ 161] 00:29:20.002 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.002 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.002 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.002 cpu : usr=97.38%, sys=1.46%, ctx=96, majf=0, minf=9 00:29:20.002 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:20.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.002 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.002 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.002 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.002 filename0: (groupid=0, jobs=1): err= 0: pid=3578815: Mon Nov 18 19:27:36 2024 00:29:20.002 read: IOPS=496, BW=1986KiB/s (2034kB/s)(19.7MiB/10149msec) 00:29:20.002 slat (nsec): min=7847, max=53095, avg=26508.87, stdev=10919.55 00:29:20.002 clat (msec): min=25, max=161, avg=31.97, stdev= 7.32 00:29:20.002 lat (msec): min=25, max=161, avg=32.00, stdev= 7.32 00:29:20.002 clat percentiles (msec): 00:29:20.002 | 1.00th=[ 31], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], 00:29:20.002 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.002 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.002 | 99.00th=[ 36], 99.50th=[ 39], 99.90th=[ 161], 99.95th=[ 161], 00:29:20.002 | 99.99th=[ 161] 00:29:20.002 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.002 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.002 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.002 cpu : usr=96.96%, sys=1.72%, ctx=294, majf=0, minf=9 00:29:20.002 IO depths : 1=5.8%, 2=12.1%, 4=24.9%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:20.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.002 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.002 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.002 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.002 filename0: (groupid=0, jobs=1): err= 0: pid=3578816: Mon Nov 18 19:27:36 2024 00:29:20.002 read: IOPS=496, BW=1985KiB/s (2032kB/s)(19.7MiB/10158msec) 00:29:20.002 slat (usec): min=6, max=103, avg=44.84, stdev=12.32 00:29:20.002 clat (msec): min=25, max=164, avg=31.85, stdev= 7.52 00:29:20.002 lat (msec): min=25, max=164, avg=31.90, stdev= 7.52 00:29:20.002 clat percentiles (msec): 00:29:20.002 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.002 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.002 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.003 | 99.00th=[ 34], 99.50th=[ 40], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.003 | 99.99th=[ 165] 00:29:20.003 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.003 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.003 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.003 cpu : usr=98.21%, sys=1.12%, ctx=85, majf=0, minf=9 00:29:20.003 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename0: (groupid=0, jobs=1): err= 0: pid=3578817: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=495, BW=1980KiB/s (2028kB/s)(19.6MiB/10147msec) 00:29:20.003 slat (usec): min=13, max=135, avg=52.19, stdev=18.12 00:29:20.003 clat (msec): min=29, max=165, avg=31.84, stdev= 7.72 00:29:20.003 lat (msec): min=29, max=165, avg=31.90, stdev= 7.72 00:29:20.003 clat percentiles (msec): 00:29:20.003 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.003 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.003 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.003 | 99.00th=[ 33], 99.50th=[ 61], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.003 | 99.99th=[ 165] 00:29:20.003 bw ( KiB/s): min= 1792, max= 2048, per=4.20%, avg=2000.95, stdev=78.38, samples=20 00:29:20.003 iops : min= 448, max= 512, avg=500.20, stdev=19.66, samples=20 00:29:20.003 lat (msec) : 50=99.36%, 100=0.32%, 250=0.32% 00:29:20.003 cpu : usr=97.85%, sys=1.25%, ctx=98, majf=0, minf=9 00:29:20.003 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename0: (groupid=0, jobs=1): err= 0: pid=3578818: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=505, BW=2021KiB/s (2069kB/s)(19.8MiB/10009msec) 00:29:20.003 slat (usec): min=6, max=135, avg=31.84, stdev=31.65 00:29:20.003 clat (usec): min=8511, max=35528, avg=31396.40, stdev=1821.84 00:29:20.003 lat (usec): min=8539, max=35579, avg=31428.24, stdev=1816.28 00:29:20.003 clat percentiles (usec): 00:29:20.003 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[31065], 00:29:20.003 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:20.003 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:20.003 | 99.00th=[32900], 99.50th=[34341], 99.90th=[35390], 99.95th=[35390], 00:29:20.003 | 99.99th=[35390] 00:29:20.003 bw ( KiB/s): min= 1920, max= 2052, per=4.24%, avg=2016.40, stdev=57.12, samples=20 00:29:20.003 iops : min= 480, max= 513, avg=504.10, stdev=14.28, samples=20 00:29:20.003 lat (msec) : 10=0.32%, 20=0.32%, 50=99.37% 00:29:20.003 cpu : usr=98.30%, sys=1.26%, ctx=23, majf=0, minf=9 00:29:20.003 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename0: (groupid=0, jobs=1): err= 0: pid=3578819: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=505, BW=2021KiB/s (2069kB/s)(19.8MiB/10009msec) 00:29:20.003 slat (usec): min=8, max=140, avg=48.55, stdev=24.02 00:29:20.003 clat (usec): min=8252, max=36908, avg=31294.29, stdev=1805.94 00:29:20.003 lat (usec): min=8273, max=36949, avg=31342.84, stdev=1803.80 00:29:20.003 clat percentiles (usec): 00:29:20.003 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30802], 20.00th=[31065], 00:29:20.003 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:20.003 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:20.003 | 99.00th=[32637], 99.50th=[34341], 99.90th=[35390], 99.95th=[35390], 00:29:20.003 | 99.99th=[36963] 00:29:20.003 bw ( KiB/s): min= 1920, max= 2052, per=4.24%, avg=2016.40, stdev=57.12, samples=20 00:29:20.003 iops : min= 480, max= 513, avg=504.10, stdev=14.28, samples=20 00:29:20.003 lat (msec) : 10=0.32%, 20=0.32%, 50=99.37% 00:29:20.003 cpu : usr=96.53%, sys=1.93%, ctx=362, majf=0, minf=9 00:29:20.003 IO depths : 1=4.8%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename0: (groupid=0, jobs=1): err= 0: pid=3578820: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=495, BW=1983KiB/s (2031kB/s)(19.6MiB/10134msec) 00:29:20.003 slat (usec): min=15, max=153, avg=47.74, stdev=26.43 00:29:20.003 clat (msec): min=20, max=165, avg=31.79, stdev= 7.63 00:29:20.003 lat (msec): min=21, max=165, avg=31.84, stdev= 7.63 00:29:20.003 clat percentiles (msec): 00:29:20.003 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.003 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.003 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:20.003 | 99.00th=[ 34], 99.50th=[ 48], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.003 | 99.99th=[ 165] 00:29:20.003 bw ( KiB/s): min= 1907, max= 2048, per=4.21%, avg=2003.35, stdev=62.61, samples=20 00:29:20.003 iops : min= 476, max= 512, avg=500.80, stdev=15.71, samples=20 00:29:20.003 lat (msec) : 50=99.64%, 100=0.04%, 250=0.32% 00:29:20.003 cpu : usr=98.68%, sys=0.88%, ctx=18, majf=0, minf=9 00:29:20.003 IO depths : 1=4.7%, 2=11.0%, 4=25.0%, 8=51.5%, 16=7.8%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename1: (groupid=0, jobs=1): err= 0: pid=3578821: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=496, BW=1985KiB/s (2032kB/s)(19.7MiB/10158msec) 00:29:20.003 slat (usec): min=8, max=163, avg=46.91, stdev=26.05 00:29:20.003 clat (msec): min=29, max=164, avg=31.76, stdev= 7.53 00:29:20.003 lat (msec): min=29, max=164, avg=31.80, stdev= 7.53 00:29:20.003 clat percentiles (msec): 00:29:20.003 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.003 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.003 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 32], 00:29:20.003 | 99.00th=[ 34], 99.50th=[ 40], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.003 | 99.99th=[ 165] 00:29:20.003 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.003 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.003 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.003 cpu : usr=98.65%, sys=0.91%, ctx=12, majf=0, minf=9 00:29:20.003 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename1: (groupid=0, jobs=1): err= 0: pid=3578822: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=494, BW=1980KiB/s (2027kB/s)(19.6MiB/10150msec) 00:29:20.003 slat (usec): min=13, max=100, avg=44.68, stdev=11.67 00:29:20.003 clat (msec): min=25, max=165, avg=31.93, stdev= 7.77 00:29:20.003 lat (msec): min=25, max=165, avg=31.97, stdev= 7.77 00:29:20.003 clat percentiles (msec): 00:29:20.003 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.003 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.003 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.003 | 99.00th=[ 33], 99.50th=[ 65], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.003 | 99.99th=[ 165] 00:29:20.003 bw ( KiB/s): min= 1795, max= 2048, per=4.20%, avg=2000.35, stdev=79.30, samples=20 00:29:20.003 iops : min= 448, max= 512, avg=500.05, stdev=19.93, samples=20 00:29:20.003 lat (msec) : 50=99.36%, 100=0.32%, 250=0.32% 00:29:20.003 cpu : usr=97.92%, sys=1.16%, ctx=121, majf=0, minf=9 00:29:20.003 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename1: (groupid=0, jobs=1): err= 0: pid=3578823: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=496, BW=1984KiB/s (2032kB/s)(19.7MiB/10160msec) 00:29:20.003 slat (usec): min=9, max=143, avg=44.72, stdev=15.59 00:29:20.003 clat (msec): min=25, max=165, avg=31.85, stdev= 7.54 00:29:20.003 lat (msec): min=25, max=165, avg=31.89, stdev= 7.54 00:29:20.003 clat percentiles (msec): 00:29:20.003 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.003 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.003 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.003 | 99.00th=[ 34], 99.50th=[ 40], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.003 | 99.99th=[ 167] 00:29:20.003 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.003 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.003 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.003 cpu : usr=97.17%, sys=1.73%, ctx=94, majf=0, minf=9 00:29:20.003 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.003 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.003 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.003 filename1: (groupid=0, jobs=1): err= 0: pid=3578824: Mon Nov 18 19:27:36 2024 00:29:20.003 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.7MiB/10002msec) 00:29:20.004 slat (usec): min=9, max=146, avg=45.85, stdev=28.47 00:29:20.004 clat (usec): min=4891, max=35971, avg=31254.32, stdev=1828.34 00:29:20.004 lat (usec): min=4933, max=35999, avg=31300.17, stdev=1823.01 00:29:20.004 clat percentiles (usec): 00:29:20.004 | 1.00th=[29492], 5.00th=[30016], 10.00th=[30278], 20.00th=[30802], 00:29:20.004 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:20.004 | 70.00th=[31589], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:20.004 | 99.00th=[32375], 99.50th=[34341], 99.90th=[34866], 99.95th=[34866], 00:29:20.004 | 99.99th=[35914] 00:29:20.004 bw ( KiB/s): min= 1920, max= 2160, per=4.24%, avg=2020.21, stdev=66.58, samples=19 00:29:20.004 iops : min= 480, max= 540, avg=505.05, stdev=16.64, samples=19 00:29:20.004 lat (msec) : 10=0.28%, 20=0.32%, 50=99.41% 00:29:20.004 cpu : usr=98.57%, sys=1.03%, ctx=14, majf=0, minf=9 00:29:20.004 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5054,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename1: (groupid=0, jobs=1): err= 0: pid=3578825: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=495, BW=1982KiB/s (2030kB/s)(19.6MiB/10137msec) 00:29:20.004 slat (usec): min=7, max=107, avg=43.40, stdev=19.78 00:29:20.004 clat (msec): min=17, max=165, avg=31.96, stdev= 7.52 00:29:20.004 lat (msec): min=17, max=165, avg=32.00, stdev= 7.52 00:29:20.004 clat percentiles (msec): 00:29:20.004 | 1.00th=[ 29], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.004 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.004 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:29:20.004 | 99.00th=[ 37], 99.50th=[ 52], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.004 | 99.99th=[ 165] 00:29:20.004 bw ( KiB/s): min= 1912, max= 2048, per=4.21%, avg=2002.80, stdev=60.16, samples=20 00:29:20.004 iops : min= 478, max= 512, avg=500.70, stdev=15.04, samples=20 00:29:20.004 lat (msec) : 20=0.04%, 50=99.28%, 100=0.36%, 250=0.32% 00:29:20.004 cpu : usr=98.67%, sys=0.93%, ctx=39, majf=0, minf=9 00:29:20.004 IO depths : 1=0.8%, 2=6.7%, 4=23.4%, 8=57.4%, 16=11.7%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.0%, 8=0.4%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename1: (groupid=0, jobs=1): err= 0: pid=3578826: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=495, BW=1982KiB/s (2030kB/s)(19.6MiB/10138msec) 00:29:20.004 slat (usec): min=7, max=130, avg=27.24, stdev=28.64 00:29:20.004 clat (msec): min=10, max=141, avg=32.03, stdev= 6.57 00:29:20.004 lat (msec): min=10, max=141, avg=32.06, stdev= 6.57 00:29:20.004 clat percentiles (msec): 00:29:20.004 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.004 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.004 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:29:20.004 | 99.00th=[ 53], 99.50th=[ 56], 99.90th=[ 142], 99.95th=[ 142], 00:29:20.004 | 99.99th=[ 142] 00:29:20.004 bw ( KiB/s): min= 1792, max= 2048, per=4.21%, avg=2003.20, stdev=75.15, samples=20 00:29:20.004 iops : min= 448, max= 512, avg=500.80, stdev=18.79, samples=20 00:29:20.004 lat (msec) : 20=0.22%, 50=98.65%, 100=0.82%, 250=0.32% 00:29:20.004 cpu : usr=98.74%, sys=0.86%, ctx=13, majf=0, minf=9 00:29:20.004 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename1: (groupid=0, jobs=1): err= 0: pid=3578827: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=505, BW=2021KiB/s (2069kB/s)(19.8MiB/10008msec) 00:29:20.004 slat (usec): min=5, max=128, avg=26.13, stdev=19.89 00:29:20.004 clat (usec): min=8255, max=37171, avg=31466.72, stdev=1822.68 00:29:20.004 lat (usec): min=8287, max=37246, avg=31492.84, stdev=1823.34 00:29:20.004 clat percentiles (usec): 00:29:20.004 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:20.004 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:20.004 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:20.004 | 99.00th=[32637], 99.50th=[34866], 99.90th=[36963], 99.95th=[36963], 00:29:20.004 | 99.99th=[36963] 00:29:20.004 bw ( KiB/s): min= 1920, max= 2052, per=4.24%, avg=2016.60, stdev=57.24, samples=20 00:29:20.004 iops : min= 480, max= 513, avg=504.15, stdev=14.31, samples=20 00:29:20.004 lat (msec) : 10=0.32%, 20=0.32%, 50=99.37% 00:29:20.004 cpu : usr=98.37%, sys=1.17%, ctx=9, majf=0, minf=9 00:29:20.004 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename1: (groupid=0, jobs=1): err= 0: pid=3578828: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=496, BW=1987KiB/s (2034kB/s)(19.7MiB/10134msec) 00:29:20.004 slat (usec): min=8, max=134, avg=56.34, stdev=22.20 00:29:20.004 clat (msec): min=13, max=165, avg=31.73, stdev= 7.81 00:29:20.004 lat (msec): min=13, max=165, avg=31.78, stdev= 7.81 00:29:20.004 clat percentiles (msec): 00:29:20.004 | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.004 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.004 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.004 | 99.00th=[ 39], 99.50th=[ 55], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.004 | 99.99th=[ 165] 00:29:20.004 bw ( KiB/s): min= 1795, max= 2136, per=4.22%, avg=2006.95, stdev=79.72, samples=20 00:29:20.004 iops : min= 448, max= 534, avg=501.70, stdev=20.03, samples=20 00:29:20.004 lat (msec) : 20=0.76%, 50=98.61%, 100=0.32%, 250=0.32% 00:29:20.004 cpu : usr=98.69%, sys=0.90%, ctx=13, majf=0, minf=9 00:29:20.004 IO depths : 1=5.1%, 2=11.2%, 4=24.3%, 8=52.0%, 16=7.4%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.0%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5033,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename2: (groupid=0, jobs=1): err= 0: pid=3578829: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=495, BW=1983KiB/s (2030kB/s)(19.6MiB/10134msec) 00:29:20.004 slat (usec): min=7, max=286, avg=56.90, stdev=31.91 00:29:20.004 clat (msec): min=11, max=165, avg=31.83, stdev= 7.64 00:29:20.004 lat (msec): min=11, max=165, avg=31.89, stdev= 7.64 00:29:20.004 clat percentiles (msec): 00:29:20.004 | 1.00th=[ 22], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.004 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.004 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.004 | 99.00th=[ 51], 99.50th=[ 55], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.004 | 99.99th=[ 165] 00:29:20.004 bw ( KiB/s): min= 1795, max= 2104, per=4.21%, avg=2002.95, stdev=70.96, samples=20 00:29:20.004 iops : min= 448, max= 526, avg=500.70, stdev=17.86, samples=20 00:29:20.004 lat (msec) : 20=0.66%, 50=98.27%, 100=0.76%, 250=0.32% 00:29:20.004 cpu : usr=98.36%, sys=1.01%, ctx=23, majf=0, minf=11 00:29:20.004 IO depths : 1=0.6%, 2=6.5%, 4=23.9%, 8=57.0%, 16=12.0%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.1%, 8=0.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5023,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename2: (groupid=0, jobs=1): err= 0: pid=3578830: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=495, BW=1981KiB/s (2028kB/s)(19.6MiB/10145msec) 00:29:20.004 slat (usec): min=14, max=139, avg=47.49, stdev=16.50 00:29:20.004 clat (msec): min=20, max=165, avg=31.89, stdev= 7.70 00:29:20.004 lat (msec): min=20, max=166, avg=31.94, stdev= 7.70 00:29:20.004 clat percentiles (msec): 00:29:20.004 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.004 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.004 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.004 | 99.00th=[ 35], 99.50th=[ 58], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.004 | 99.99th=[ 167] 00:29:20.004 bw ( KiB/s): min= 1792, max= 2064, per=4.20%, avg=2001.50, stdev=77.66, samples=20 00:29:20.004 iops : min= 448, max= 516, avg=500.35, stdev=19.45, samples=20 00:29:20.004 lat (msec) : 50=99.36%, 100=0.32%, 250=0.32% 00:29:20.004 cpu : usr=98.62%, sys=0.97%, ctx=15, majf=0, minf=9 00:29:20.004 IO depths : 1=5.0%, 2=11.3%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:29:20.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.004 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.004 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.004 filename2: (groupid=0, jobs=1): err= 0: pid=3578831: Mon Nov 18 19:27:36 2024 00:29:20.004 read: IOPS=503, BW=2016KiB/s (2064kB/s)(19.8MiB/10033msec) 00:29:20.004 slat (usec): min=7, max=134, avg=38.10, stdev=35.66 00:29:20.004 clat (usec): min=10002, max=52480, avg=31413.64, stdev=1964.80 00:29:20.004 lat (usec): min=10062, max=52495, avg=31451.75, stdev=1954.71 00:29:20.004 clat percentiles (usec): 00:29:20.004 | 1.00th=[29754], 5.00th=[30016], 10.00th=[30278], 20.00th=[30802], 00:29:20.004 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:20.004 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32113], 00:29:20.004 | 99.00th=[32637], 99.50th=[34341], 99.90th=[52167], 99.95th=[52691], 00:29:20.004 | 99.99th=[52691] 00:29:20.004 bw ( KiB/s): min= 1867, max= 2048, per=4.23%, avg=2013.35, stdev=62.53, samples=20 00:29:20.004 iops : min= 466, max= 512, avg=503.30, stdev=15.72, samples=20 00:29:20.004 lat (msec) : 20=0.63%, 50=99.05%, 100=0.32% 00:29:20.004 cpu : usr=98.68%, sys=0.92%, ctx=14, majf=0, minf=9 00:29:20.005 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:20.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.005 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.005 filename2: (groupid=0, jobs=1): err= 0: pid=3578832: Mon Nov 18 19:27:36 2024 00:29:20.005 read: IOPS=494, BW=1980KiB/s (2027kB/s)(19.6MiB/10151msec) 00:29:20.005 slat (usec): min=8, max=104, avg=46.65, stdev=15.21 00:29:20.005 clat (msec): min=25, max=165, avg=31.93, stdev= 7.77 00:29:20.005 lat (msec): min=25, max=165, avg=31.97, stdev= 7.77 00:29:20.005 clat percentiles (msec): 00:29:20.005 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.005 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.005 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.005 | 99.00th=[ 33], 99.50th=[ 65], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.005 | 99.99th=[ 165] 00:29:20.005 bw ( KiB/s): min= 1792, max= 2048, per=4.20%, avg=2000.20, stdev=79.71, samples=20 00:29:20.005 iops : min= 448, max= 512, avg=500.05, stdev=19.93, samples=20 00:29:20.005 lat (msec) : 50=99.36%, 100=0.32%, 250=0.32% 00:29:20.005 cpu : usr=98.63%, sys=0.95%, ctx=21, majf=0, minf=9 00:29:20.005 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.005 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.005 filename2: (groupid=0, jobs=1): err= 0: pid=3578833: Mon Nov 18 19:27:36 2024 00:29:20.005 read: IOPS=503, BW=2016KiB/s (2064kB/s)(19.7MiB/10002msec) 00:29:20.005 slat (usec): min=8, max=144, avg=28.12, stdev=11.55 00:29:20.005 clat (usec): min=16549, max=36382, avg=31515.49, stdev=986.06 00:29:20.005 lat (usec): min=16560, max=36442, avg=31543.61, stdev=986.51 00:29:20.005 clat percentiles (usec): 00:29:20.005 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:20.005 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:20.005 | 70.00th=[31851], 80.00th=[31851], 90.00th=[31851], 95.00th=[32113], 00:29:20.005 | 99.00th=[32375], 99.50th=[34341], 99.90th=[35914], 99.95th=[36439], 00:29:20.005 | 99.99th=[36439] 00:29:20.005 bw ( KiB/s): min= 1920, max= 2048, per=4.23%, avg=2014.32, stdev=57.91, samples=19 00:29:20.005 iops : min= 480, max= 512, avg=503.58, stdev=14.48, samples=19 00:29:20.005 lat (msec) : 20=0.32%, 50=99.68% 00:29:20.005 cpu : usr=97.15%, sys=1.65%, ctx=124, majf=0, minf=9 00:29:20.005 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:20.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.005 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.005 filename2: (groupid=0, jobs=1): err= 0: pid=3578834: Mon Nov 18 19:27:36 2024 00:29:20.005 read: IOPS=495, BW=1983KiB/s (2030kB/s)(19.6MiB/10135msec) 00:29:20.005 slat (usec): min=9, max=103, avg=48.08, stdev=16.40 00:29:20.005 clat (msec): min=16, max=165, avg=31.82, stdev= 7.64 00:29:20.005 lat (msec): min=16, max=165, avg=31.87, stdev= 7.64 00:29:20.005 clat percentiles (msec): 00:29:20.005 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.005 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.005 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.005 | 99.00th=[ 34], 99.50th=[ 49], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.005 | 99.99th=[ 165] 00:29:20.005 bw ( KiB/s): min= 1920, max= 2048, per=4.21%, avg=2003.20, stdev=62.64, samples=20 00:29:20.005 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:20.005 lat (msec) : 20=0.04%, 50=99.60%, 100=0.04%, 250=0.32% 00:29:20.005 cpu : usr=98.56%, sys=1.04%, ctx=15, majf=0, minf=9 00:29:20.005 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:20.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.005 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.005 filename2: (groupid=0, jobs=1): err= 0: pid=3578835: Mon Nov 18 19:27:36 2024 00:29:20.005 read: IOPS=496, BW=1986KiB/s (2034kB/s)(19.7MiB/10149msec) 00:29:20.005 slat (nsec): min=8117, max=57977, avg=28667.45, stdev=10140.20 00:29:20.005 clat (msec): min=25, max=160, avg=31.95, stdev= 7.31 00:29:20.005 lat (msec): min=25, max=160, avg=31.98, stdev= 7.31 00:29:20.005 clat percentiles (msec): 00:29:20.005 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 32], 20.00th=[ 32], 00:29:20.005 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.005 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.005 | 99.00th=[ 35], 99.50th=[ 40], 99.90th=[ 161], 99.95th=[ 161], 00:29:20.005 | 99.99th=[ 161] 00:29:20.005 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.005 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.005 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.005 cpu : usr=97.19%, sys=1.54%, ctx=232, majf=0, minf=9 00:29:20.005 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:20.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.005 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.005 filename2: (groupid=0, jobs=1): err= 0: pid=3578836: Mon Nov 18 19:27:36 2024 00:29:20.005 read: IOPS=496, BW=1984KiB/s (2032kB/s)(19.7MiB/10160msec) 00:29:20.005 slat (usec): min=9, max=150, avg=42.70, stdev=15.72 00:29:20.005 clat (msec): min=29, max=166, avg=31.87, stdev= 7.54 00:29:20.005 lat (msec): min=29, max=166, avg=31.91, stdev= 7.54 00:29:20.005 clat percentiles (msec): 00:29:20.005 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:29:20.005 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:29:20.005 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:29:20.005 | 99.00th=[ 34], 99.50th=[ 40], 99.90th=[ 165], 99.95th=[ 165], 00:29:20.005 | 99.99th=[ 167] 00:29:20.005 bw ( KiB/s): min= 1920, max= 2048, per=4.22%, avg=2009.60, stdev=60.18, samples=20 00:29:20.005 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:29:20.005 lat (msec) : 50=99.68%, 250=0.32% 00:29:20.005 cpu : usr=98.69%, sys=0.85%, ctx=52, majf=0, minf=9 00:29:20.005 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:20.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:20.005 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:20.005 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:20.005 00:29:20.005 Run status group 0 (all jobs): 00:29:20.005 READ: bw=46.5MiB/s (48.7MB/s), 1980KiB/s-2021KiB/s (2027kB/s-2070kB/s), io=472MiB (495MB), run=10002-10160msec 00:29:20.005 19:27:36 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:20.005 19:27:36 -- target/dif.sh@43 -- # local sub 00:29:20.005 19:27:36 -- target/dif.sh@45 -- # for sub in "$@" 00:29:20.005 19:27:36 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:20.005 19:27:36 -- target/dif.sh@36 -- # local sub_id=0 00:29:20.005 19:27:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:20.005 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.005 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.005 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.005 19:27:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:20.005 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.005 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.005 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.005 19:27:36 -- target/dif.sh@45 -- # for sub in "$@" 00:29:20.005 19:27:36 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:20.005 19:27:36 -- target/dif.sh@36 -- # local sub_id=1 00:29:20.005 19:27:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:20.005 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.005 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.005 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.005 19:27:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:20.005 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.005 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.005 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.005 19:27:36 -- target/dif.sh@45 -- # for sub in "$@" 00:29:20.005 19:27:36 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:20.005 19:27:36 -- target/dif.sh@36 -- # local sub_id=2 00:29:20.005 19:27:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:20.005 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.005 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.005 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.005 19:27:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:20.005 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.005 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.005 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.005 19:27:36 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:20.005 19:27:36 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:20.005 19:27:36 -- target/dif.sh@115 -- # numjobs=2 00:29:20.005 19:27:36 -- target/dif.sh@115 -- # iodepth=8 00:29:20.005 19:27:36 -- target/dif.sh@115 -- # runtime=5 00:29:20.005 19:27:36 -- target/dif.sh@115 -- # files=1 00:29:20.005 19:27:36 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:20.005 19:27:36 -- target/dif.sh@28 -- # local sub 00:29:20.005 19:27:36 -- target/dif.sh@30 -- # for sub in "$@" 00:29:20.005 19:27:36 -- target/dif.sh@31 -- # create_subsystem 0 00:29:20.005 19:27:36 -- target/dif.sh@18 -- # local sub_id=0 00:29:20.005 19:27:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 bdev_null0 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 [2024-11-18 19:27:36.709374] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@30 -- # for sub in "$@" 00:29:20.006 19:27:36 -- target/dif.sh@31 -- # create_subsystem 1 00:29:20.006 19:27:36 -- target/dif.sh@18 -- # local sub_id=1 00:29:20.006 19:27:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 bdev_null1 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:20.006 19:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.006 19:27:36 -- common/autotest_common.sh@10 -- # set +x 00:29:20.006 19:27:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.006 19:27:36 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:20.006 19:27:36 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:20.006 19:27:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:20.006 19:27:36 -- nvmf/common.sh@520 -- # config=() 00:29:20.006 19:27:36 -- nvmf/common.sh@520 -- # local subsystem config 00:29:20.006 19:27:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:20.006 19:27:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:20.006 { 00:29:20.006 "params": { 00:29:20.006 "name": "Nvme$subsystem", 00:29:20.006 "trtype": "$TEST_TRANSPORT", 00:29:20.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:20.006 "adrfam": "ipv4", 00:29:20.006 "trsvcid": "$NVMF_PORT", 00:29:20.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:20.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:20.006 "hdgst": ${hdgst:-false}, 00:29:20.006 "ddgst": ${ddgst:-false} 00:29:20.006 }, 00:29:20.006 "method": "bdev_nvme_attach_controller" 00:29:20.006 } 00:29:20.006 EOF 00:29:20.006 )") 00:29:20.006 19:27:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:20.006 19:27:36 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:20.006 19:27:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:20.006 19:27:36 -- target/dif.sh@82 -- # gen_fio_conf 00:29:20.006 19:27:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:20.006 19:27:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:20.006 19:27:36 -- target/dif.sh@54 -- # local file 00:29:20.006 19:27:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:20.006 19:27:36 -- common/autotest_common.sh@1330 -- # shift 00:29:20.006 19:27:36 -- target/dif.sh@56 -- # cat 00:29:20.006 19:27:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:20.006 19:27:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:20.006 19:27:36 -- nvmf/common.sh@542 -- # cat 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:20.006 19:27:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:20.006 19:27:36 -- target/dif.sh@72 -- # (( file <= files )) 00:29:20.006 19:27:36 -- target/dif.sh@73 -- # cat 00:29:20.006 19:27:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:20.006 19:27:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:20.006 { 00:29:20.006 "params": { 00:29:20.006 "name": "Nvme$subsystem", 00:29:20.006 "trtype": "$TEST_TRANSPORT", 00:29:20.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:20.006 "adrfam": "ipv4", 00:29:20.006 "trsvcid": "$NVMF_PORT", 00:29:20.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:20.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:20.006 "hdgst": ${hdgst:-false}, 00:29:20.006 "ddgst": ${ddgst:-false} 00:29:20.006 }, 00:29:20.006 "method": "bdev_nvme_attach_controller" 00:29:20.006 } 00:29:20.006 EOF 00:29:20.006 )") 00:29:20.006 19:27:36 -- nvmf/common.sh@542 -- # cat 00:29:20.006 19:27:36 -- target/dif.sh@72 -- # (( file++ )) 00:29:20.006 19:27:36 -- target/dif.sh@72 -- # (( file <= files )) 00:29:20.006 19:27:36 -- nvmf/common.sh@544 -- # jq . 00:29:20.006 19:27:36 -- nvmf/common.sh@545 -- # IFS=, 00:29:20.006 19:27:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:20.006 "params": { 00:29:20.006 "name": "Nvme0", 00:29:20.006 "trtype": "tcp", 00:29:20.006 "traddr": "10.0.0.2", 00:29:20.006 "adrfam": "ipv4", 00:29:20.006 "trsvcid": "4420", 00:29:20.006 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:20.006 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:20.006 "hdgst": false, 00:29:20.006 "ddgst": false 00:29:20.006 }, 00:29:20.006 "method": "bdev_nvme_attach_controller" 00:29:20.006 },{ 00:29:20.006 "params": { 00:29:20.006 "name": "Nvme1", 00:29:20.006 "trtype": "tcp", 00:29:20.006 "traddr": "10.0.0.2", 00:29:20.006 "adrfam": "ipv4", 00:29:20.006 "trsvcid": "4420", 00:29:20.006 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:20.006 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:20.006 "hdgst": false, 00:29:20.006 "ddgst": false 00:29:20.006 }, 00:29:20.006 "method": "bdev_nvme_attach_controller" 00:29:20.006 }' 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:20.006 19:27:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:20.006 19:27:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:20.006 19:27:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:20.006 19:27:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:20.006 19:27:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:20.006 19:27:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:20.006 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:20.006 ... 00:29:20.006 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:20.006 ... 00:29:20.006 fio-3.35 00:29:20.006 Starting 4 threads 00:29:20.006 EAL: No free 2048 kB hugepages reported on node 1 00:29:20.006 [2024-11-18 19:27:37.696246] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:20.006 [2024-11-18 19:27:37.696308] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:25.272 00:29:25.272 filename0: (groupid=0, jobs=1): err= 0: pid=3580261: Mon Nov 18 19:27:42 2024 00:29:25.272 read: IOPS=1896, BW=14.8MiB/s (15.5MB/s)(74.1MiB/5004msec) 00:29:25.272 slat (nsec): min=3797, max=67022, avg=21406.61, stdev=9134.45 00:29:25.272 clat (usec): min=865, max=12599, avg=4144.12, stdev=552.77 00:29:25.272 lat (usec): min=886, max=12613, avg=4165.53, stdev=553.43 00:29:25.272 clat percentiles (usec): 00:29:25.272 | 1.00th=[ 2638], 5.00th=[ 3261], 10.00th=[ 3556], 20.00th=[ 3884], 00:29:25.272 | 30.00th=[ 4015], 40.00th=[ 4113], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:25.272 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4686], 00:29:25.272 | 99.00th=[ 5866], 99.50th=[ 6325], 99.90th=[ 7373], 99.95th=[10945], 00:29:25.272 | 99.99th=[12649] 00:29:25.272 bw ( KiB/s): min=14688, max=16000, per=25.30%, avg=15177.60, stdev=466.18, samples=10 00:29:25.272 iops : min= 1836, max= 2000, avg=1897.20, stdev=58.27, samples=10 00:29:25.272 lat (usec) : 1000=0.02% 00:29:25.272 lat (msec) : 2=0.35%, 4=27.60%, 10=71.95%, 20=0.08% 00:29:25.272 cpu : usr=96.06%, sys=3.38%, ctx=8, majf=0, minf=9 00:29:25.272 IO depths : 1=0.3%, 2=14.4%, 4=58.3%, 8=27.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:25.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 issued rwts: total=9489,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.272 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:25.272 filename0: (groupid=0, jobs=1): err= 0: pid=3580262: Mon Nov 18 19:27:42 2024 00:29:25.272 read: IOPS=1865, BW=14.6MiB/s (15.3MB/s)(72.9MiB/5003msec) 00:29:25.272 slat (nsec): min=7016, max=80125, avg=19386.85, stdev=10836.76 00:29:25.272 clat (usec): min=857, max=10667, avg=4220.86, stdev=602.50 00:29:25.272 lat (usec): min=869, max=10692, avg=4240.24, stdev=602.95 00:29:25.272 clat percentiles (usec): 00:29:25.272 | 1.00th=[ 2245], 5.00th=[ 3359], 10.00th=[ 3720], 20.00th=[ 3949], 00:29:25.272 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:25.272 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4621], 95.00th=[ 5145], 00:29:25.272 | 99.00th=[ 6325], 99.50th=[ 6849], 99.90th=[ 7767], 99.95th=[ 8160], 00:29:25.272 | 99.99th=[10683] 00:29:25.272 bw ( KiB/s): min=14509, max=15808, per=24.88%, avg=14921.30, stdev=461.94, samples=10 00:29:25.272 iops : min= 1813, max= 1976, avg=1865.10, stdev=57.81, samples=10 00:29:25.272 lat (usec) : 1000=0.11% 00:29:25.272 lat (msec) : 2=0.50%, 4=22.76%, 10=76.62%, 20=0.01% 00:29:25.272 cpu : usr=94.84%, sys=4.64%, ctx=10, majf=0, minf=9 00:29:25.272 IO depths : 1=0.1%, 2=13.1%, 4=58.9%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:25.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 complete : 0=0.0%, 4=92.5%, 8=7.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 issued rwts: total=9332,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.272 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:25.272 filename1: (groupid=0, jobs=1): err= 0: pid=3580263: Mon Nov 18 19:27:42 2024 00:29:25.272 read: IOPS=1878, BW=14.7MiB/s (15.4MB/s)(73.4MiB/5001msec) 00:29:25.272 slat (nsec): min=6998, max=80466, avg=18543.18, stdev=10714.25 00:29:25.272 clat (usec): min=861, max=11128, avg=4193.26, stdev=586.28 00:29:25.272 lat (usec): min=879, max=11171, avg=4211.81, stdev=586.96 00:29:25.272 clat percentiles (usec): 00:29:25.272 | 1.00th=[ 2573], 5.00th=[ 3294], 10.00th=[ 3621], 20.00th=[ 3916], 00:29:25.272 | 30.00th=[ 4047], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:25.272 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 5014], 00:29:25.272 | 99.00th=[ 6456], 99.50th=[ 6849], 99.90th=[ 7701], 99.95th=[ 9241], 00:29:25.272 | 99.99th=[11076] 00:29:25.272 bw ( KiB/s): min=14496, max=15904, per=25.06%, avg=15032.89, stdev=542.53, samples=9 00:29:25.272 iops : min= 1812, max= 1988, avg=1879.11, stdev=67.82, samples=9 00:29:25.272 lat (usec) : 1000=0.03% 00:29:25.272 lat (msec) : 2=0.35%, 4=24.88%, 10=74.72%, 20=0.01% 00:29:25.272 cpu : usr=94.96%, sys=4.58%, ctx=10, majf=0, minf=9 00:29:25.272 IO depths : 1=0.2%, 2=13.4%, 4=59.1%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:25.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 issued rwts: total=9396,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.272 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:25.272 filename1: (groupid=0, jobs=1): err= 0: pid=3580264: Mon Nov 18 19:27:42 2024 00:29:25.272 read: IOPS=1859, BW=14.5MiB/s (15.2MB/s)(72.7MiB/5002msec) 00:29:25.272 slat (nsec): min=7003, max=75956, avg=19062.73, stdev=10698.93 00:29:25.272 clat (usec): min=801, max=9876, avg=4233.68, stdev=648.45 00:29:25.272 lat (usec): min=815, max=9899, avg=4252.75, stdev=648.78 00:29:25.272 clat percentiles (usec): 00:29:25.272 | 1.00th=[ 2180], 5.00th=[ 3326], 10.00th=[ 3687], 20.00th=[ 3949], 00:29:25.272 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4293], 00:29:25.272 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4686], 95.00th=[ 5276], 00:29:25.272 | 99.00th=[ 6652], 99.50th=[ 6980], 99.90th=[ 7767], 99.95th=[ 8029], 00:29:25.272 | 99.99th=[ 9896] 00:29:25.272 bw ( KiB/s): min=14480, max=15840, per=24.83%, avg=14892.44, stdev=515.29, samples=9 00:29:25.272 iops : min= 1810, max= 1980, avg=1861.56, stdev=64.41, samples=9 00:29:25.272 lat (usec) : 1000=0.11% 00:29:25.272 lat (msec) : 2=0.62%, 4=22.12%, 10=77.14% 00:29:25.272 cpu : usr=94.76%, sys=4.74%, ctx=6, majf=0, minf=9 00:29:25.272 IO depths : 1=0.1%, 2=14.0%, 4=58.6%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:25.272 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.272 issued rwts: total=9302,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.272 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:25.272 00:29:25.272 Run status group 0 (all jobs): 00:29:25.272 READ: bw=58.6MiB/s (61.4MB/s), 14.5MiB/s-14.8MiB/s (15.2MB/s-15.5MB/s), io=293MiB (307MB), run=5001-5004msec 00:29:25.272 19:27:43 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:25.272 19:27:43 -- target/dif.sh@43 -- # local sub 00:29:25.272 19:27:43 -- target/dif.sh@45 -- # for sub in "$@" 00:29:25.272 19:27:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:25.272 19:27:43 -- target/dif.sh@36 -- # local sub_id=0 00:29:25.272 19:27:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:25.272 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.272 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.272 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.272 19:27:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:25.272 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.272 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.272 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.272 19:27:43 -- target/dif.sh@45 -- # for sub in "$@" 00:29:25.272 19:27:43 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:25.272 19:27:43 -- target/dif.sh@36 -- # local sub_id=1 00:29:25.272 19:27:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:25.272 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.272 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.272 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.272 19:27:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:25.272 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.272 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.272 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.272 00:29:25.272 real 0m24.405s 00:29:25.272 user 4m36.051s 00:29:25.272 sys 0m5.494s 00:29:25.272 19:27:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:25.272 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.272 ************************************ 00:29:25.272 END TEST fio_dif_rand_params 00:29:25.272 ************************************ 00:29:25.272 19:27:43 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:25.272 19:27:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:25.272 19:27:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:25.272 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.272 ************************************ 00:29:25.272 START TEST fio_dif_digest 00:29:25.273 ************************************ 00:29:25.273 19:27:43 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:25.273 19:27:43 -- target/dif.sh@123 -- # local NULL_DIF 00:29:25.273 19:27:43 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:25.273 19:27:43 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:25.273 19:27:43 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:25.273 19:27:43 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:25.273 19:27:43 -- target/dif.sh@127 -- # numjobs=3 00:29:25.273 19:27:43 -- target/dif.sh@127 -- # iodepth=3 00:29:25.273 19:27:43 -- target/dif.sh@127 -- # runtime=10 00:29:25.273 19:27:43 -- target/dif.sh@128 -- # hdgst=true 00:29:25.273 19:27:43 -- target/dif.sh@128 -- # ddgst=true 00:29:25.273 19:27:43 -- target/dif.sh@130 -- # create_subsystems 0 00:29:25.273 19:27:43 -- target/dif.sh@28 -- # local sub 00:29:25.273 19:27:43 -- target/dif.sh@30 -- # for sub in "$@" 00:29:25.273 19:27:43 -- target/dif.sh@31 -- # create_subsystem 0 00:29:25.273 19:27:43 -- target/dif.sh@18 -- # local sub_id=0 00:29:25.273 19:27:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:25.273 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.273 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.273 bdev_null0 00:29:25.273 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.273 19:27:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:25.273 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.273 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.273 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.273 19:27:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:25.273 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.273 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.273 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.273 19:27:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:25.273 19:27:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.273 19:27:43 -- common/autotest_common.sh@10 -- # set +x 00:29:25.273 [2024-11-18 19:27:43.139434] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:25.273 19:27:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.273 19:27:43 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:25.273 19:27:43 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:25.273 19:27:43 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:25.273 19:27:43 -- nvmf/common.sh@520 -- # config=() 00:29:25.273 19:27:43 -- nvmf/common.sh@520 -- # local subsystem config 00:29:25.273 19:27:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:25.273 19:27:43 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:25.273 19:27:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:25.273 { 00:29:25.273 "params": { 00:29:25.273 "name": "Nvme$subsystem", 00:29:25.273 "trtype": "$TEST_TRANSPORT", 00:29:25.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:25.273 "adrfam": "ipv4", 00:29:25.273 "trsvcid": "$NVMF_PORT", 00:29:25.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:25.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:25.273 "hdgst": ${hdgst:-false}, 00:29:25.273 "ddgst": ${ddgst:-false} 00:29:25.273 }, 00:29:25.273 "method": "bdev_nvme_attach_controller" 00:29:25.273 } 00:29:25.273 EOF 00:29:25.273 )") 00:29:25.273 19:27:43 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:25.273 19:27:43 -- target/dif.sh@82 -- # gen_fio_conf 00:29:25.273 19:27:43 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:25.273 19:27:43 -- target/dif.sh@54 -- # local file 00:29:25.273 19:27:43 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:25.273 19:27:43 -- target/dif.sh@56 -- # cat 00:29:25.273 19:27:43 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:25.273 19:27:43 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:25.273 19:27:43 -- common/autotest_common.sh@1330 -- # shift 00:29:25.273 19:27:43 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:25.273 19:27:43 -- nvmf/common.sh@542 -- # cat 00:29:25.273 19:27:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:25.273 19:27:43 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:25.273 19:27:43 -- target/dif.sh@72 -- # (( file <= files )) 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:25.273 19:27:43 -- nvmf/common.sh@544 -- # jq . 00:29:25.273 19:27:43 -- nvmf/common.sh@545 -- # IFS=, 00:29:25.273 19:27:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:25.273 "params": { 00:29:25.273 "name": "Nvme0", 00:29:25.273 "trtype": "tcp", 00:29:25.273 "traddr": "10.0.0.2", 00:29:25.273 "adrfam": "ipv4", 00:29:25.273 "trsvcid": "4420", 00:29:25.273 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:25.273 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:25.273 "hdgst": true, 00:29:25.273 "ddgst": true 00:29:25.273 }, 00:29:25.273 "method": "bdev_nvme_attach_controller" 00:29:25.273 }' 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:25.273 19:27:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:25.273 19:27:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:25.273 19:27:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:25.273 19:27:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:25.273 19:27:43 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:25.273 19:27:43 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:25.273 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:25.273 ... 00:29:25.273 fio-3.35 00:29:25.273 Starting 3 threads 00:29:25.273 EAL: No free 2048 kB hugepages reported on node 1 00:29:25.273 [2024-11-18 19:27:43.838638] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:25.273 [2024-11-18 19:27:43.838712] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:37.547 00:29:37.547 filename0: (groupid=0, jobs=1): err= 0: pid=3581033: Mon Nov 18 19:27:53 2024 00:29:37.547 read: IOPS=222, BW=27.8MiB/s (29.1MB/s)(279MiB/10046msec) 00:29:37.547 slat (nsec): min=4835, max=31972, avg=14358.28, stdev=1422.86 00:29:37.547 clat (usec): min=10343, max=55858, avg=13459.49, stdev=2052.32 00:29:37.547 lat (usec): min=10357, max=55872, avg=13473.85, stdev=2052.32 00:29:37.547 clat percentiles (usec): 00:29:37.547 | 1.00th=[11207], 5.00th=[11863], 10.00th=[12256], 20.00th=[12649], 00:29:37.547 | 30.00th=[12911], 40.00th=[13173], 50.00th=[13435], 60.00th=[13566], 00:29:37.547 | 70.00th=[13829], 80.00th=[14091], 90.00th=[14484], 95.00th=[14746], 00:29:37.547 | 99.00th=[15664], 99.50th=[15926], 99.90th=[54264], 99.95th=[54789], 00:29:37.547 | 99.99th=[55837] 00:29:37.547 bw ( KiB/s): min=26624, max=29440, per=34.64%, avg=28556.80, stdev=560.10, samples=20 00:29:37.547 iops : min= 208, max= 230, avg=223.10, stdev= 4.38, samples=20 00:29:37.547 lat (msec) : 20=99.64%, 50=0.22%, 100=0.13% 00:29:37.547 cpu : usr=93.85%, sys=5.58%, ctx=19, majf=0, minf=108 00:29:37.547 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.547 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.547 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.547 issued rwts: total=2233,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.547 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:37.547 filename0: (groupid=0, jobs=1): err= 0: pid=3581034: Mon Nov 18 19:27:53 2024 00:29:37.547 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(267MiB/10044msec) 00:29:37.547 slat (nsec): min=3713, max=30227, avg=14431.95, stdev=1358.10 00:29:37.547 clat (usec): min=8512, max=50839, avg=14056.16, stdev=1475.67 00:29:37.547 lat (usec): min=8527, max=50854, avg=14070.59, stdev=1475.69 00:29:37.547 clat percentiles (usec): 00:29:37.547 | 1.00th=[11600], 5.00th=[12518], 10.00th=[12780], 20.00th=[13304], 00:29:37.547 | 30.00th=[13566], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:29:37.547 | 70.00th=[14484], 80.00th=[14877], 90.00th=[15270], 95.00th=[15664], 00:29:37.547 | 99.00th=[16319], 99.50th=[16712], 99.90th=[23725], 99.95th=[45351], 00:29:37.547 | 99.99th=[50594] 00:29:37.547 bw ( KiB/s): min=26164, max=28416, per=33.17%, avg=27343.40, stdev=502.79, samples=20 00:29:37.547 iops : min= 204, max= 222, avg=213.60, stdev= 3.98, samples=20 00:29:37.547 lat (msec) : 10=0.51%, 20=99.25%, 50=0.19%, 100=0.05% 00:29:37.547 cpu : usr=94.33%, sys=5.18%, ctx=20, majf=0, minf=104 00:29:37.547 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.547 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.547 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.547 issued rwts: total=2138,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.547 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:37.547 filename0: (groupid=0, jobs=1): err= 0: pid=3581035: Mon Nov 18 19:27:53 2024 00:29:37.547 read: IOPS=209, BW=26.1MiB/s (27.4MB/s)(262MiB/10043msec) 00:29:37.547 slat (nsec): min=4335, max=64772, avg=14200.13, stdev=1759.91 00:29:37.547 clat (usec): min=8491, max=52977, avg=14316.89, stdev=1529.37 00:29:37.547 lat (usec): min=8505, max=52991, avg=14331.09, stdev=1529.46 00:29:37.547 clat percentiles (usec): 00:29:37.547 | 1.00th=[11731], 5.00th=[12780], 10.00th=[13042], 20.00th=[13566], 00:29:37.547 | 30.00th=[13829], 40.00th=[14091], 50.00th=[14222], 60.00th=[14484], 00:29:37.547 | 70.00th=[14746], 80.00th=[15008], 90.00th=[15533], 95.00th=[15795], 00:29:37.547 | 99.00th=[16581], 99.50th=[16909], 99.90th=[19268], 99.95th=[50594], 00:29:37.547 | 99.99th=[53216] 00:29:37.547 bw ( KiB/s): min=26112, max=27904, per=32.56%, avg=26841.60, stdev=425.74, samples=20 00:29:37.547 iops : min= 204, max= 218, avg=209.70, stdev= 3.33, samples=20 00:29:37.547 lat (msec) : 10=0.43%, 20=99.48%, 100=0.10% 00:29:37.547 cpu : usr=94.55%, sys=4.93%, ctx=18, majf=0, minf=192 00:29:37.547 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:37.547 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.547 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:37.547 issued rwts: total=2099,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:37.547 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:37.547 00:29:37.547 Run status group 0 (all jobs): 00:29:37.547 READ: bw=80.5MiB/s (84.4MB/s), 26.1MiB/s-27.8MiB/s (27.4MB/s-29.1MB/s), io=809MiB (848MB), run=10043-10046msec 00:29:37.547 19:27:54 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:37.547 19:27:54 -- target/dif.sh@43 -- # local sub 00:29:37.547 19:27:54 -- target/dif.sh@45 -- # for sub in "$@" 00:29:37.547 19:27:54 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:37.547 19:27:54 -- target/dif.sh@36 -- # local sub_id=0 00:29:37.547 19:27:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:37.547 19:27:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.547 19:27:54 -- common/autotest_common.sh@10 -- # set +x 00:29:37.547 19:27:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.547 19:27:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:37.547 19:27:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:37.547 19:27:54 -- common/autotest_common.sh@10 -- # set +x 00:29:37.547 19:27:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:37.547 00:29:37.547 real 0m11.119s 00:29:37.547 user 0m29.460s 00:29:37.547 sys 0m1.880s 00:29:37.547 19:27:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:37.547 19:27:54 -- common/autotest_common.sh@10 -- # set +x 00:29:37.547 ************************************ 00:29:37.547 END TEST fio_dif_digest 00:29:37.547 ************************************ 00:29:37.547 19:27:54 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:37.547 19:27:54 -- target/dif.sh@147 -- # nvmftestfini 00:29:37.547 19:27:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:37.547 19:27:54 -- nvmf/common.sh@116 -- # sync 00:29:37.547 19:27:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:37.547 19:27:54 -- nvmf/common.sh@119 -- # set +e 00:29:37.547 19:27:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:37.547 19:27:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:37.547 rmmod nvme_tcp 00:29:37.547 rmmod nvme_fabrics 00:29:37.547 rmmod nvme_keyring 00:29:37.547 19:27:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:37.547 19:27:54 -- nvmf/common.sh@123 -- # set -e 00:29:37.547 19:27:54 -- nvmf/common.sh@124 -- # return 0 00:29:37.547 19:27:54 -- nvmf/common.sh@477 -- # '[' -n 3574171 ']' 00:29:37.547 19:27:54 -- nvmf/common.sh@478 -- # killprocess 3574171 00:29:37.547 19:27:54 -- common/autotest_common.sh@936 -- # '[' -z 3574171 ']' 00:29:37.547 19:27:54 -- common/autotest_common.sh@940 -- # kill -0 3574171 00:29:37.547 19:27:54 -- common/autotest_common.sh@941 -- # uname 00:29:37.547 19:27:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.547 19:27:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3574171 00:29:37.547 19:27:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:37.547 19:27:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:37.547 19:27:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3574171' 00:29:37.547 killing process with pid 3574171 00:29:37.547 19:27:54 -- common/autotest_common.sh@955 -- # kill 3574171 00:29:37.547 19:27:54 -- common/autotest_common.sh@960 -- # wait 3574171 00:29:37.547 19:27:54 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:37.547 19:27:54 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:37.547 Waiting for block devices as requested 00:29:37.547 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:37.547 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:37.547 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:37.548 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:37.548 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:37.806 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:37.806 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:37.806 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:37.806 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:38.063 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:38.063 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:38.063 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:38.063 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:38.321 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:38.321 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:38.321 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:38.321 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:38.579 19:27:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:38.579 19:27:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:38.579 19:27:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:38.579 19:27:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:38.579 19:27:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:38.579 19:27:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:38.579 19:27:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:40.475 19:27:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:40.475 00:29:40.475 real 1m7.686s 00:29:40.475 user 6m34.355s 00:29:40.475 sys 0m16.401s 00:29:40.475 19:27:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:40.475 19:27:59 -- common/autotest_common.sh@10 -- # set +x 00:29:40.475 ************************************ 00:29:40.475 END TEST nvmf_dif 00:29:40.475 ************************************ 00:29:40.475 19:27:59 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:40.475 19:27:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:40.475 19:27:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:40.475 19:27:59 -- common/autotest_common.sh@10 -- # set +x 00:29:40.733 ************************************ 00:29:40.733 START TEST nvmf_abort_qd_sizes 00:29:40.733 ************************************ 00:29:40.733 19:27:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:40.733 * Looking for test storage... 00:29:40.733 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:40.733 19:27:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:40.733 19:27:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:40.733 19:27:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:40.733 19:27:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:40.733 19:27:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:40.733 19:27:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:40.733 19:27:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:40.733 19:27:59 -- scripts/common.sh@335 -- # IFS=.-: 00:29:40.733 19:27:59 -- scripts/common.sh@335 -- # read -ra ver1 00:29:40.733 19:27:59 -- scripts/common.sh@336 -- # IFS=.-: 00:29:40.733 19:27:59 -- scripts/common.sh@336 -- # read -ra ver2 00:29:40.733 19:27:59 -- scripts/common.sh@337 -- # local 'op=<' 00:29:40.733 19:27:59 -- scripts/common.sh@339 -- # ver1_l=2 00:29:40.733 19:27:59 -- scripts/common.sh@340 -- # ver2_l=1 00:29:40.733 19:27:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:40.733 19:27:59 -- scripts/common.sh@343 -- # case "$op" in 00:29:40.733 19:27:59 -- scripts/common.sh@344 -- # : 1 00:29:40.733 19:27:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:40.733 19:27:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:40.733 19:27:59 -- scripts/common.sh@364 -- # decimal 1 00:29:40.733 19:27:59 -- scripts/common.sh@352 -- # local d=1 00:29:40.733 19:27:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:40.733 19:27:59 -- scripts/common.sh@354 -- # echo 1 00:29:40.733 19:27:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:40.733 19:27:59 -- scripts/common.sh@365 -- # decimal 2 00:29:40.733 19:27:59 -- scripts/common.sh@352 -- # local d=2 00:29:40.733 19:27:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:40.733 19:27:59 -- scripts/common.sh@354 -- # echo 2 00:29:40.733 19:27:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:40.733 19:27:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:40.733 19:27:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:40.733 19:27:59 -- scripts/common.sh@367 -- # return 0 00:29:40.733 19:27:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:40.733 19:27:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:40.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.733 --rc genhtml_branch_coverage=1 00:29:40.733 --rc genhtml_function_coverage=1 00:29:40.733 --rc genhtml_legend=1 00:29:40.733 --rc geninfo_all_blocks=1 00:29:40.733 --rc geninfo_unexecuted_blocks=1 00:29:40.733 00:29:40.733 ' 00:29:40.733 19:27:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:40.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.733 --rc genhtml_branch_coverage=1 00:29:40.733 --rc genhtml_function_coverage=1 00:29:40.733 --rc genhtml_legend=1 00:29:40.733 --rc geninfo_all_blocks=1 00:29:40.733 --rc geninfo_unexecuted_blocks=1 00:29:40.733 00:29:40.733 ' 00:29:40.733 19:27:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:40.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.733 --rc genhtml_branch_coverage=1 00:29:40.733 --rc genhtml_function_coverage=1 00:29:40.733 --rc genhtml_legend=1 00:29:40.733 --rc geninfo_all_blocks=1 00:29:40.733 --rc geninfo_unexecuted_blocks=1 00:29:40.733 00:29:40.733 ' 00:29:40.733 19:27:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:40.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:40.733 --rc genhtml_branch_coverage=1 00:29:40.733 --rc genhtml_function_coverage=1 00:29:40.733 --rc genhtml_legend=1 00:29:40.733 --rc geninfo_all_blocks=1 00:29:40.733 --rc geninfo_unexecuted_blocks=1 00:29:40.733 00:29:40.733 ' 00:29:40.733 19:27:59 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:40.733 19:27:59 -- nvmf/common.sh@7 -- # uname -s 00:29:40.733 19:27:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:40.733 19:27:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:40.733 19:27:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:40.733 19:27:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:40.733 19:27:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:40.733 19:27:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:40.733 19:27:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:40.733 19:27:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:40.733 19:27:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:40.733 19:27:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:40.733 19:27:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:40.733 19:27:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:40.733 19:27:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:40.733 19:27:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:40.733 19:27:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:40.733 19:27:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:40.733 19:27:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:40.733 19:27:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:40.733 19:27:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:40.733 19:27:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.733 19:27:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.733 19:27:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.733 19:27:59 -- paths/export.sh@5 -- # export PATH 00:29:40.733 19:27:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:40.733 19:27:59 -- nvmf/common.sh@46 -- # : 0 00:29:40.733 19:27:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:40.733 19:27:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:40.733 19:27:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:40.733 19:27:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:40.733 19:27:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:40.733 19:27:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:40.733 19:27:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:40.733 19:27:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:40.733 19:27:59 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:40.733 19:27:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:40.733 19:27:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:40.733 19:27:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:40.733 19:27:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:40.733 19:27:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:40.733 19:27:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:40.733 19:27:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:40.733 19:27:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:40.733 19:27:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:40.733 19:27:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:40.733 19:27:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:40.733 19:27:59 -- common/autotest_common.sh@10 -- # set +x 00:29:42.634 19:28:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:42.634 19:28:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:42.634 19:28:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:42.634 19:28:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:42.634 19:28:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:42.634 19:28:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:42.634 19:28:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:42.634 19:28:01 -- nvmf/common.sh@294 -- # net_devs=() 00:29:42.634 19:28:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:42.634 19:28:01 -- nvmf/common.sh@295 -- # e810=() 00:29:42.634 19:28:01 -- nvmf/common.sh@295 -- # local -ga e810 00:29:42.634 19:28:01 -- nvmf/common.sh@296 -- # x722=() 00:29:42.634 19:28:01 -- nvmf/common.sh@296 -- # local -ga x722 00:29:42.634 19:28:01 -- nvmf/common.sh@297 -- # mlx=() 00:29:42.634 19:28:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:42.634 19:28:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:42.634 19:28:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:42.634 19:28:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:42.634 19:28:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:42.634 19:28:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:42.634 19:28:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:42.634 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:42.634 19:28:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:42.634 19:28:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:42.634 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:42.634 19:28:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:42.634 19:28:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:42.634 19:28:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:42.634 19:28:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:42.634 19:28:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:42.634 19:28:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:42.634 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:42.634 19:28:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:42.634 19:28:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:42.634 19:28:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:42.634 19:28:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:42.634 19:28:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:42.634 19:28:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:42.634 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:42.634 19:28:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:42.634 19:28:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:42.634 19:28:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:42.634 19:28:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:42.634 19:28:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:42.634 19:28:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:42.634 19:28:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:42.634 19:28:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:42.634 19:28:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:42.634 19:28:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:42.634 19:28:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:42.634 19:28:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:42.634 19:28:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:42.634 19:28:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:42.634 19:28:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:42.634 19:28:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:42.634 19:28:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:42.634 19:28:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:42.634 19:28:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:42.634 19:28:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:42.634 19:28:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:42.634 19:28:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:42.892 19:28:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:42.892 19:28:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:42.893 19:28:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:42.893 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:42.893 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:29:42.893 00:29:42.893 --- 10.0.0.2 ping statistics --- 00:29:42.893 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:42.893 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:29:42.893 19:28:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:42.893 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:42.893 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:29:42.893 00:29:42.893 --- 10.0.0.1 ping statistics --- 00:29:42.893 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:42.893 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:29:42.893 19:28:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:42.893 19:28:01 -- nvmf/common.sh@410 -- # return 0 00:29:42.893 19:28:01 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:42.893 19:28:01 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:44.269 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:44.269 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:44.269 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:45.203 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:45.203 19:28:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:45.203 19:28:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:45.203 19:28:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:45.203 19:28:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:45.203 19:28:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:45.203 19:28:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:45.203 19:28:03 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:45.203 19:28:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:45.203 19:28:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:45.203 19:28:03 -- common/autotest_common.sh@10 -- # set +x 00:29:45.203 19:28:03 -- nvmf/common.sh@469 -- # nvmfpid=3586015 00:29:45.203 19:28:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:45.203 19:28:03 -- nvmf/common.sh@470 -- # waitforlisten 3586015 00:29:45.203 19:28:03 -- common/autotest_common.sh@829 -- # '[' -z 3586015 ']' 00:29:45.203 19:28:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:45.203 19:28:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:45.203 19:28:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:45.203 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:45.203 19:28:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:45.203 19:28:03 -- common/autotest_common.sh@10 -- # set +x 00:29:45.203 [2024-11-18 19:28:03.694424] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:45.203 [2024-11-18 19:28:03.694512] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:45.203 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.203 [2024-11-18 19:28:03.758874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:45.461 [2024-11-18 19:28:03.870259] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:45.461 [2024-11-18 19:28:03.870414] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:45.461 [2024-11-18 19:28:03.870431] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:45.461 [2024-11-18 19:28:03.870443] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:45.461 [2024-11-18 19:28:03.870509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:45.461 [2024-11-18 19:28:03.870568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:45.461 [2024-11-18 19:28:03.870698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:45.461 [2024-11-18 19:28:03.870702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:46.395 19:28:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.395 19:28:04 -- common/autotest_common.sh@862 -- # return 0 00:29:46.395 19:28:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:46.395 19:28:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:46.395 19:28:04 -- common/autotest_common.sh@10 -- # set +x 00:29:46.395 19:28:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:46.395 19:28:04 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:46.395 19:28:04 -- scripts/common.sh@312 -- # local nvmes 00:29:46.395 19:28:04 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:46.395 19:28:04 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:46.395 19:28:04 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:46.395 19:28:04 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:46.395 19:28:04 -- scripts/common.sh@322 -- # uname -s 00:29:46.395 19:28:04 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:46.395 19:28:04 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:46.395 19:28:04 -- scripts/common.sh@327 -- # (( 1 )) 00:29:46.395 19:28:04 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:46.395 19:28:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:46.395 19:28:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:46.395 19:28:04 -- common/autotest_common.sh@10 -- # set +x 00:29:46.395 ************************************ 00:29:46.395 START TEST spdk_target_abort 00:29:46.395 ************************************ 00:29:46.395 19:28:04 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:46.395 19:28:04 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:46.395 19:28:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.395 19:28:04 -- common/autotest_common.sh@10 -- # set +x 00:29:49.675 spdk_targetn1 00:29:49.675 19:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:49.675 19:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.675 19:28:07 -- common/autotest_common.sh@10 -- # set +x 00:29:49.675 [2024-11-18 19:28:07.556880] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:49.675 19:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:49.675 19:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.675 19:28:07 -- common/autotest_common.sh@10 -- # set +x 00:29:49.675 19:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:49.675 19:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.675 19:28:07 -- common/autotest_common.sh@10 -- # set +x 00:29:49.675 19:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:49.675 19:28:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.675 19:28:07 -- common/autotest_common.sh@10 -- # set +x 00:29:49.675 [2024-11-18 19:28:07.589204] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:49.675 19:28:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:49.675 19:28:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:49.675 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.203 Initializing NVMe Controllers 00:29:52.203 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:52.203 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:52.203 Initialization complete. Launching workers. 00:29:52.203 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13446, failed: 0 00:29:52.203 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1326, failed to submit 12120 00:29:52.203 success 721, unsuccess 605, failed 0 00:29:52.203 19:28:10 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:52.203 19:28:10 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:52.203 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.483 Initializing NVMe Controllers 00:29:55.483 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:55.483 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:55.483 Initialization complete. Launching workers. 00:29:55.483 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8713, failed: 0 00:29:55.483 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1220, failed to submit 7493 00:29:55.483 success 367, unsuccess 853, failed 0 00:29:55.483 19:28:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:55.483 19:28:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:55.483 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.763 Initializing NVMe Controllers 00:29:58.763 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:58.763 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:58.763 Initialization complete. Launching workers. 00:29:58.763 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31187, failed: 0 00:29:58.763 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2781, failed to submit 28406 00:29:58.763 success 534, unsuccess 2247, failed 0 00:29:58.763 19:28:17 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:58.763 19:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.763 19:28:17 -- common/autotest_common.sh@10 -- # set +x 00:29:58.763 19:28:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.763 19:28:17 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:58.763 19:28:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.763 19:28:17 -- common/autotest_common.sh@10 -- # set +x 00:30:00.135 19:28:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.135 19:28:18 -- target/abort_qd_sizes.sh@62 -- # killprocess 3586015 00:30:00.135 19:28:18 -- common/autotest_common.sh@936 -- # '[' -z 3586015 ']' 00:30:00.135 19:28:18 -- common/autotest_common.sh@940 -- # kill -0 3586015 00:30:00.135 19:28:18 -- common/autotest_common.sh@941 -- # uname 00:30:00.136 19:28:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.136 19:28:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3586015 00:30:00.136 19:28:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:00.136 19:28:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:00.136 19:28:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3586015' 00:30:00.136 killing process with pid 3586015 00:30:00.136 19:28:18 -- common/autotest_common.sh@955 -- # kill 3586015 00:30:00.136 19:28:18 -- common/autotest_common.sh@960 -- # wait 3586015 00:30:00.394 00:30:00.394 real 0m14.053s 00:30:00.394 user 0m56.084s 00:30:00.394 sys 0m2.319s 00:30:00.394 19:28:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:00.394 19:28:18 -- common/autotest_common.sh@10 -- # set +x 00:30:00.394 ************************************ 00:30:00.394 END TEST spdk_target_abort 00:30:00.394 ************************************ 00:30:00.394 19:28:18 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:00.394 19:28:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:00.394 19:28:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:00.394 19:28:18 -- common/autotest_common.sh@10 -- # set +x 00:30:00.394 ************************************ 00:30:00.394 START TEST kernel_target_abort 00:30:00.394 ************************************ 00:30:00.394 19:28:18 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:00.394 19:28:18 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:00.394 19:28:18 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:00.394 19:28:18 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:00.394 19:28:18 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:00.394 19:28:18 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:00.394 19:28:18 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:00.394 19:28:18 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:00.394 19:28:18 -- nvmf/common.sh@627 -- # local block nvme 00:30:00.394 19:28:18 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:00.394 19:28:18 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:00.394 19:28:18 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:00.394 19:28:18 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:01.768 Waiting for block devices as requested 00:30:01.768 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:01.768 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:01.768 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:01.768 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:02.026 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:02.026 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:02.026 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:02.026 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:02.284 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:02.285 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:02.285 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:02.285 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:02.542 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:02.542 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:02.542 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:02.800 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:02.800 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:02.800 19:28:21 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:02.800 19:28:21 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:02.800 19:28:21 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:02.800 19:28:21 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:02.800 19:28:21 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:02.800 No valid GPT data, bailing 00:30:02.800 19:28:21 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:02.800 19:28:21 -- scripts/common.sh@393 -- # pt= 00:30:02.800 19:28:21 -- scripts/common.sh@394 -- # return 1 00:30:02.800 19:28:21 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:02.800 19:28:21 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:02.800 19:28:21 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:02.800 19:28:21 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:03.058 19:28:21 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:03.058 19:28:21 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:03.058 19:28:21 -- nvmf/common.sh@654 -- # echo 1 00:30:03.058 19:28:21 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:03.058 19:28:21 -- nvmf/common.sh@656 -- # echo 1 00:30:03.058 19:28:21 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:03.058 19:28:21 -- nvmf/common.sh@663 -- # echo tcp 00:30:03.058 19:28:21 -- nvmf/common.sh@664 -- # echo 4420 00:30:03.058 19:28:21 -- nvmf/common.sh@665 -- # echo ipv4 00:30:03.058 19:28:21 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:03.058 19:28:21 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:03.058 00:30:03.058 Discovery Log Number of Records 2, Generation counter 2 00:30:03.058 =====Discovery Log Entry 0====== 00:30:03.058 trtype: tcp 00:30:03.058 adrfam: ipv4 00:30:03.058 subtype: current discovery subsystem 00:30:03.058 treq: not specified, sq flow control disable supported 00:30:03.058 portid: 1 00:30:03.058 trsvcid: 4420 00:30:03.058 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:03.058 traddr: 10.0.0.1 00:30:03.059 eflags: none 00:30:03.059 sectype: none 00:30:03.059 =====Discovery Log Entry 1====== 00:30:03.059 trtype: tcp 00:30:03.059 adrfam: ipv4 00:30:03.059 subtype: nvme subsystem 00:30:03.059 treq: not specified, sq flow control disable supported 00:30:03.059 portid: 1 00:30:03.059 trsvcid: 4420 00:30:03.059 subnqn: kernel_target 00:30:03.059 traddr: 10.0.0.1 00:30:03.059 eflags: none 00:30:03.059 sectype: none 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:03.059 19:28:21 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:03.059 EAL: No free 2048 kB hugepages reported on node 1 00:30:06.339 Initializing NVMe Controllers 00:30:06.339 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:06.339 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:06.339 Initialization complete. Launching workers. 00:30:06.339 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 44862, failed: 0 00:30:06.339 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 44862, failed to submit 0 00:30:06.339 success 0, unsuccess 44862, failed 0 00:30:06.339 19:28:24 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:06.339 19:28:24 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:06.339 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.621 Initializing NVMe Controllers 00:30:09.621 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:09.621 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:09.621 Initialization complete. Launching workers. 00:30:09.621 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81974, failed: 0 00:30:09.621 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20670, failed to submit 61304 00:30:09.621 success 0, unsuccess 20670, failed 0 00:30:09.621 19:28:27 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:09.621 19:28:27 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:09.621 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.949 Initializing NVMe Controllers 00:30:12.949 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:12.949 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:12.949 Initialization complete. Launching workers. 00:30:12.949 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 82801, failed: 0 00:30:12.949 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20690, failed to submit 62111 00:30:12.949 success 0, unsuccess 20690, failed 0 00:30:12.949 19:28:30 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:12.949 19:28:30 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:12.949 19:28:30 -- nvmf/common.sh@677 -- # echo 0 00:30:12.949 19:28:30 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:12.949 19:28:30 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:12.949 19:28:30 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:12.949 19:28:30 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:12.949 19:28:30 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:12.949 19:28:30 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:12.949 00:30:12.949 real 0m12.089s 00:30:12.949 user 0m5.955s 00:30:12.949 sys 0m2.381s 00:30:12.949 19:28:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:12.949 19:28:30 -- common/autotest_common.sh@10 -- # set +x 00:30:12.949 ************************************ 00:30:12.949 END TEST kernel_target_abort 00:30:12.949 ************************************ 00:30:12.949 19:28:30 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:12.949 19:28:30 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:12.949 19:28:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:12.949 19:28:30 -- nvmf/common.sh@116 -- # sync 00:30:12.949 19:28:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:12.949 19:28:30 -- nvmf/common.sh@119 -- # set +e 00:30:12.949 19:28:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:12.949 19:28:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:12.949 rmmod nvme_tcp 00:30:12.949 rmmod nvme_fabrics 00:30:12.949 rmmod nvme_keyring 00:30:12.949 19:28:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:12.949 19:28:30 -- nvmf/common.sh@123 -- # set -e 00:30:12.949 19:28:30 -- nvmf/common.sh@124 -- # return 0 00:30:12.949 19:28:30 -- nvmf/common.sh@477 -- # '[' -n 3586015 ']' 00:30:12.949 19:28:30 -- nvmf/common.sh@478 -- # killprocess 3586015 00:30:12.949 19:28:30 -- common/autotest_common.sh@936 -- # '[' -z 3586015 ']' 00:30:12.949 19:28:30 -- common/autotest_common.sh@940 -- # kill -0 3586015 00:30:12.949 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3586015) - No such process 00:30:12.949 19:28:30 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3586015 is not found' 00:30:12.949 Process with pid 3586015 is not found 00:30:12.949 19:28:30 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:12.949 19:28:30 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:13.515 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:13.515 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:13.774 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:13.774 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:13.774 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:13.774 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:13.774 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:13.774 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:13.774 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:13.774 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:13.774 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:13.774 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:13.774 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:13.774 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:13.774 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:13.774 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:13.774 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:14.032 19:28:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:14.032 19:28:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:14.032 19:28:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:14.032 19:28:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:14.032 19:28:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:14.032 19:28:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:14.032 19:28:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:15.931 19:28:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:15.931 00:30:15.931 real 0m35.339s 00:30:15.931 user 1m4.445s 00:30:15.931 sys 0m8.133s 00:30:15.931 19:28:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:15.931 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:30:15.931 ************************************ 00:30:15.931 END TEST nvmf_abort_qd_sizes 00:30:15.931 ************************************ 00:30:15.931 19:28:34 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:15.931 19:28:34 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:15.931 19:28:34 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:15.931 19:28:34 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:15.931 19:28:34 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:15.932 19:28:34 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:15.932 19:28:34 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:15.932 19:28:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:15.932 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:30:15.932 19:28:34 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:15.932 19:28:34 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:15.932 19:28:34 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:15.932 19:28:34 -- common/autotest_common.sh@10 -- # set +x 00:30:17.831 INFO: APP EXITING 00:30:17.831 INFO: killing all VMs 00:30:17.831 INFO: killing vhost app 00:30:17.831 INFO: EXIT DONE 00:30:18.765 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:18.765 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:18.765 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:18.765 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:18.765 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:18.765 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:19.023 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:19.023 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:19.023 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:19.023 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:19.023 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:19.023 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:19.023 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:19.023 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:19.023 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:19.023 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:19.023 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:20.398 Cleaning 00:30:20.398 Removing: /var/run/dpdk/spdk0/config 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:20.398 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:20.398 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:20.398 Removing: /var/run/dpdk/spdk1/config 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:20.398 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:20.398 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:20.398 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:20.398 Removing: /var/run/dpdk/spdk2/config 00:30:20.398 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:20.398 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:20.398 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:20.398 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:20.399 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:20.399 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:20.399 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:20.399 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:20.399 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:20.399 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:20.399 Removing: /var/run/dpdk/spdk3/config 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:20.399 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:20.399 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:20.399 Removing: /var/run/dpdk/spdk4/config 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:20.399 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:20.399 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:20.399 Removing: /dev/shm/bdev_svc_trace.1 00:30:20.399 Removing: /dev/shm/nvmf_trace.0 00:30:20.399 Removing: /dev/shm/spdk_tgt_trace.pid3316061 00:30:20.399 Removing: /var/run/dpdk/spdk0 00:30:20.399 Removing: /var/run/dpdk/spdk1 00:30:20.399 Removing: /var/run/dpdk/spdk2 00:30:20.399 Removing: /var/run/dpdk/spdk3 00:30:20.399 Removing: /var/run/dpdk/spdk4 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3314343 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3315120 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3316061 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3316624 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3317907 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3318857 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3319171 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3319508 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3319732 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3320059 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3320223 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3320383 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3320696 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3321168 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3324459 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3324638 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3324936 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3325074 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3325391 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3325534 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3325964 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3326103 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3326281 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3326420 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3326589 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3326731 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3327111 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3327388 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3327599 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3327772 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3327923 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3327981 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3328239 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3328404 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3328553 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3328728 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3328980 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3329137 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3329284 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3329563 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3329707 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3329867 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3330128 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3330290 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3330432 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3330696 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3330856 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3331017 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3331187 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3331445 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3331583 00:30:20.399 Removing: /var/run/dpdk/spdk_pid3331748 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3332010 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3332172 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3332312 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3332595 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3332738 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3332899 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3333161 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3333329 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3333469 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3333745 00:30:20.657 Removing: /var/run/dpdk/spdk_pid3333892 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3334051 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3334318 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3334481 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3334628 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3334910 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3335059 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3335214 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3335481 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3335643 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3335839 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3336052 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3338217 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3395600 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3398264 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3405512 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3408867 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3411457 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3411901 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3417641 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3417922 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3420612 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3424387 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3426634 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3433392 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3438932 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3440170 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3440878 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3452242 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3454613 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3457454 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3458672 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3460038 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3460315 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3460463 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3460740 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3461331 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3462701 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3463728 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3464175 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3467801 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3471388 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3475056 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3499479 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3502324 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3506293 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3507391 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3508521 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3511801 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3514376 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3518787 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3518820 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3521751 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3521998 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3522141 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3522418 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3522433 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3523656 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3524898 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3526116 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3527331 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3528547 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3529779 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3533776 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3534244 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3535565 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3536326 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3540116 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3542397 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3546517 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3550162 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3553826 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3554252 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3554797 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3555218 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3555809 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3556362 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3556919 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3557348 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3560145 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3560293 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3564160 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3564338 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3566106 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3571274 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3571283 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3574358 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3576076 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3577867 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3578627 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3580074 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3580865 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3586494 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3586894 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3587297 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3588779 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3589191 00:30:20.658 Removing: /var/run/dpdk/spdk_pid3589604 00:30:20.658 Clean 00:30:20.916 killing process with pid 3286642 00:30:29.027 killing process with pid 3286639 00:30:29.027 killing process with pid 3286641 00:30:29.027 killing process with pid 3286640 00:30:29.027 19:28:47 -- common/autotest_common.sh@1446 -- # return 0 00:30:29.027 19:28:47 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:29.027 19:28:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:29.027 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:30:29.027 19:28:47 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:29.027 19:28:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:29.027 19:28:47 -- common/autotest_common.sh@10 -- # set +x 00:30:29.027 19:28:47 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:29.027 19:28:47 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:29.027 19:28:47 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:29.027 19:28:47 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:29.027 19:28:47 -- spdk/autotest.sh@383 -- # hostname 00:30:29.027 19:28:47 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:29.284 geninfo: WARNING: invalid characters removed from testname! 00:30:55.811 19:29:13 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:59.090 19:29:17 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:01.617 19:29:19 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:04.145 19:29:22 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:06.671 19:29:25 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:09.198 19:29:27 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:11.786 19:29:30 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:12.044 19:29:30 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:12.044 19:29:30 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:12.044 19:29:30 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:12.044 19:29:30 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:12.044 19:29:30 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:12.044 19:29:30 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:12.044 19:29:30 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:12.044 19:29:30 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:12.044 19:29:30 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:12.044 19:29:30 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:12.044 19:29:30 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:12.044 19:29:30 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:12.044 19:29:30 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:12.044 19:29:30 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:12.044 19:29:30 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:12.044 19:29:30 -- scripts/common.sh@343 -- $ case "$op" in 00:31:12.044 19:29:30 -- scripts/common.sh@344 -- $ : 1 00:31:12.044 19:29:30 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:12.044 19:29:30 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:12.044 19:29:30 -- scripts/common.sh@364 -- $ decimal 1 00:31:12.044 19:29:30 -- scripts/common.sh@352 -- $ local d=1 00:31:12.044 19:29:30 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:12.044 19:29:30 -- scripts/common.sh@354 -- $ echo 1 00:31:12.044 19:29:30 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:12.044 19:29:30 -- scripts/common.sh@365 -- $ decimal 2 00:31:12.044 19:29:30 -- scripts/common.sh@352 -- $ local d=2 00:31:12.044 19:29:30 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:12.044 19:29:30 -- scripts/common.sh@354 -- $ echo 2 00:31:12.044 19:29:30 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:12.044 19:29:30 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:12.044 19:29:30 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:12.044 19:29:30 -- scripts/common.sh@367 -- $ return 0 00:31:12.044 19:29:30 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:12.044 19:29:30 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:12.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.044 --rc genhtml_branch_coverage=1 00:31:12.044 --rc genhtml_function_coverage=1 00:31:12.044 --rc genhtml_legend=1 00:31:12.044 --rc geninfo_all_blocks=1 00:31:12.044 --rc geninfo_unexecuted_blocks=1 00:31:12.044 00:31:12.044 ' 00:31:12.044 19:29:30 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:12.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.044 --rc genhtml_branch_coverage=1 00:31:12.044 --rc genhtml_function_coverage=1 00:31:12.044 --rc genhtml_legend=1 00:31:12.044 --rc geninfo_all_blocks=1 00:31:12.044 --rc geninfo_unexecuted_blocks=1 00:31:12.044 00:31:12.044 ' 00:31:12.044 19:29:30 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:12.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.044 --rc genhtml_branch_coverage=1 00:31:12.044 --rc genhtml_function_coverage=1 00:31:12.044 --rc genhtml_legend=1 00:31:12.044 --rc geninfo_all_blocks=1 00:31:12.044 --rc geninfo_unexecuted_blocks=1 00:31:12.044 00:31:12.044 ' 00:31:12.044 19:29:30 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:12.044 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:12.044 --rc genhtml_branch_coverage=1 00:31:12.044 --rc genhtml_function_coverage=1 00:31:12.044 --rc genhtml_legend=1 00:31:12.044 --rc geninfo_all_blocks=1 00:31:12.044 --rc geninfo_unexecuted_blocks=1 00:31:12.044 00:31:12.044 ' 00:31:12.044 19:29:30 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:12.044 19:29:30 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:12.044 19:29:30 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:12.044 19:29:30 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:12.044 19:29:30 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.044 19:29:30 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.045 19:29:30 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.045 19:29:30 -- paths/export.sh@5 -- $ export PATH 00:31:12.045 19:29:30 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:12.045 19:29:30 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:12.045 19:29:30 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:12.045 19:29:30 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731954570.XXXXXX 00:31:12.045 19:29:30 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731954570.E0ifuP 00:31:12.045 19:29:30 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:12.045 19:29:30 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:12.045 19:29:30 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:12.045 19:29:30 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:12.045 19:29:30 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:12.045 19:29:30 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:12.045 19:29:30 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:12.045 19:29:30 -- common/autotest_common.sh@10 -- $ set +x 00:31:12.045 19:29:30 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:12.045 19:29:30 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:12.045 19:29:30 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:12.045 19:29:30 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:12.045 19:29:30 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:12.045 19:29:30 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:12.045 19:29:30 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:12.045 19:29:30 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:12.045 19:29:30 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:12.045 19:29:30 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:12.045 19:29:30 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:12.045 + [[ -n 3243714 ]] 00:31:12.045 + sudo kill 3243714 00:31:12.053 [Pipeline] } 00:31:12.069 [Pipeline] // stage 00:31:12.074 [Pipeline] } 00:31:12.088 [Pipeline] // timeout 00:31:12.093 [Pipeline] } 00:31:12.107 [Pipeline] // catchError 00:31:12.112 [Pipeline] } 00:31:12.127 [Pipeline] // wrap 00:31:12.133 [Pipeline] } 00:31:12.148 [Pipeline] // catchError 00:31:12.157 [Pipeline] stage 00:31:12.159 [Pipeline] { (Epilogue) 00:31:12.174 [Pipeline] catchError 00:31:12.176 [Pipeline] { 00:31:12.190 [Pipeline] echo 00:31:12.192 Cleanup processes 00:31:12.199 [Pipeline] sh 00:31:12.479 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:12.479 3601595 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:12.492 [Pipeline] sh 00:31:12.771 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:12.771 ++ awk '{print $1}' 00:31:12.771 ++ grep -v 'sudo pgrep' 00:31:12.771 + sudo kill -9 00:31:12.771 + true 00:31:12.782 [Pipeline] sh 00:31:13.062 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:25.265 [Pipeline] sh 00:31:25.546 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:25.546 Artifacts sizes are good 00:31:25.559 [Pipeline] archiveArtifacts 00:31:25.566 Archiving artifacts 00:31:25.696 [Pipeline] sh 00:31:25.976 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:25.990 [Pipeline] cleanWs 00:31:26.000 [WS-CLEANUP] Deleting project workspace... 00:31:26.000 [WS-CLEANUP] Deferred wipeout is used... 00:31:26.008 [WS-CLEANUP] done 00:31:26.009 [Pipeline] } 00:31:26.025 [Pipeline] // catchError 00:31:26.038 [Pipeline] sh 00:31:26.317 + logger -p user.info -t JENKINS-CI 00:31:26.327 [Pipeline] } 00:31:26.342 [Pipeline] // stage 00:31:26.347 [Pipeline] } 00:31:26.364 [Pipeline] // node 00:31:26.370 [Pipeline] End of Pipeline 00:31:26.410 Finished: SUCCESS